San Antonio, Texas
June 10, 2012
June 10, 2012
June 13, 2012
2153-5965
Computers in Education
11
25.243.1 - 25.243.11
10.18260/1-2--21003
https://peer.asee.org/21003
434
Han-lung Lin has received his master's degree at the University of Electro-communications in Japan. He is currently a Ph.D. student in computer science at University of California, Riverside.
Thomas Stahovich received a B.S. in mechanical engineering from the University of California, Berkeley in 1988. He received a S.M. and Ph.D. in mechanical engineering from the Massachusetts Institute of Technology in 1990 and 1995, respectively. He is currently Chair and professor in the mechanical engineering Department at the University of California, Riverside.
James Herold earned his B.S. in computer science at California Polytechnic State University, Pomona in 2004. He is currently a Ph.D. student in computer science at the University of California, Riverside.
Automatically interpreting handwritten solutions to Statics problemsIn previous research, we examined the relationship between students' homework solving processand the correctness of their work. More specifically, we conducted a study in which students inan undergraduate Statics course completed all of their coursework, including homework, quizzes,and exams, using LivescribeTM “Smartpens.” These devices record the handwritten solutions astime-stamped pen strokes, enabling us to see not only the final ink on the page, but also the orderin which it was written. We characterized the solution histories with a number of quantitativefeatures describing the temporal and spatial organization of the work. We found that thesefeatures correlate with problem correctness. However, some of the features require the individualpen strokes to be semantically labeled, for example, as free body diagram strokes or equationstrokes. Manually labeling strokes in this fashion is tedious and time consuming. In this paper,we present techniques we have developed for automatically labeling strokes intro threecategories: free body diagrams, equations, and cross-outs. The later class comprises strokes usedto cross out erroneous work.Our techniques are based on a machine learning approach. Each pen stroke is characterized by aset of 39 features describing its geometric and temporal properties. For example, ink at the top ofthe page and ink written early in the solution process are more likely to comprise a free bodydiagram than an equation. Pen strokes are also characterized with shape recognizers that attemptto identify common symbols, such as equal signs and summation symbols. We evaluated ourtechniques on 810 problem solutions containing nearly 300,000 strokes drawn by 90 students.The approach correctly classified 92% of the pen strokes. This accuracy is sufficiently high thatit should enable accurate automatic evaluation of student work.
Lin, H., & Stahovich, T., & Herold, J. (2012, June), Automatic Handwritten Statics Solution Classification and its Applications in Predicting Student Performance Paper presented at 2012 ASEE Annual Conference & Exposition, San Antonio, Texas. 10.18260/1-2--21003
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2012 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015