Asee peer logo

Using NGOMSL for Formative Feedback Generation in a Virtual Learning Environment

Download Paper |


2019 ASEE Annual Conference & Exposition


Tampa, Florida

Publication Date

June 15, 2019

Start Date

June 15, 2019

End Date

October 19, 2019

Conference Session

Engineering Design Graphics Division Technical Session 1 - Current Issues

Tagged Division

Engineering Design Graphics

Page Count




Permanent URL

Download Count


Request a correction

Paper Authors


Yi-hsiang Isaac Chang Illinois State University

visit author page

Dr. Yi-hsiang Chang is an assistant professor in the Department of Technology at Illinois State University. He received a MSME degree from Carnegie Mellon University, a MSIE degree and a PhD degree in Technology, both from Purdue University. Dr. Chang has worked with several international corporations including Boeing, DaimlerChrysler, and Dassualt Systemes, as well as multiple small to medium size companies in both US and Asia. His current field of focus is in product innovation, process improvement, and technology diffusion.

visit author page


Kevin L. Devine Illinois State University

visit author page

Kevin is the Program Coordinator for the Engineering Technology major at Illinois State University. His primary teaching assignments are in engineering graphics, industrial robotics, and CNC programming/machining.

visit author page

Download Paper |


This research paper presents a feedback generation system using the Natural GOMS Language (NGOMSL) to describe the learner’s tasks and performance expectation in a virtual reality-based learning environment. The acronym GOMS stands for Goals, Operators, Methods, and Selection Rules, and is derived from Card, Moran, and Newell’s Human Processor Model. It is a representation of a series of “how-to’s” required by a system in order to accomplish the intended tasks. NGOMSL is a variation of GOMS that provides an easy-to-read framework that highlights the underlying procedural rules of the task and the assessment of learner mastery of the task. A robust NGOMSL model will be able to provide the essential instructions regarding how the learner’s perceptual, cognitive, and motor subsystems should work, and also improve the learner’s ability to complete the task with proficiency.

In this paper we first use the domain of industrial robot programming as an example to discuss the difference between the Virtual Reality (VR) based learning environment and the traditional learning environment. Second, using a typical task in industrial robot programming as the point of discussion, our previous work in GOMS and its limitation are discussed. Next the rationale of using NGOMSL to model the procedural knowledge in a VR-based learning environment is presented, along with a comparison of using the NGOMSL model for the same task previously described using the GOMS model. The preliminary results of time duration measurement is presented, along with the discussion of how the proposed feedback system will work. This paper will conclude with a discussion of future work needed to implement the NGOMSL instructional models in a classroom setting.

Chang, Y. I., & Devine, K. L. (2019, June), Using NGOMSL for Formative Feedback Generation in a Virtual Learning Environment Paper presented at 2019 ASEE Annual Conference & Exposition , Tampa, Florida. 10.18260/1-2--33511

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2019 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015