Asee peer logo

Adaptive Comparative Judgment in Graphics Applications and Education

Download Paper |


2017 ASEE Annual Conference & Exposition


Columbus, Ohio

Publication Date

June 24, 2017

Start Date

June 24, 2017

End Date

June 28, 2017

Conference Session

Engineering Design Graphics Division Technical Session 1: Instructional

Tagged Division

Engineering Design Graphics

Page Count




Permanent URL

Download Count


Request a correction

Paper Authors


Scott R. Bartholomew Purdue University

visit author page

I have instructed classes related to all CTE areas at the Junior High, High School, and College Level over the past 10 years. In addition to research activities I enjoying working with future and current Engineering/Technology Teachers. My interests revolve around adaptive comparative judgment, engineering design, teacher training, self-directed learning, and mobile devices in K-12 classrooms.

visit author page


Patrick E. Connolly Purdue University, West Lafayette (College of Engineering)

visit author page

Dr. Patrick Connolly is a professor and department head of the Department of Computer Graphics Technology in the Purdue Polytechnic at Purdue University. He has extensive experience in the aerospace design and CAD/CAE software industries, and has been serving in higher education for twenty years. Dr. Connolly has a BS degree in Design and Graphics Technology and an MS in Computer Integrated Manufacturing from Brigham Young University, and a PhD in Educational Technology from Purdue University. His research interests include spatial ability development, virtual and augmented reality applications, product data and lifecycle management, and innovative classroom methodologies.

visit author page

Download Paper |


One of the fundamental concepts behind Adaptive Comparative Judging (ACJ) is that it is easier and more accurate to comparison judge a series of products, and to develop a rank order of achievement, than it is to score products using a more subjective method or rubric approach. Research in the field of comparative judging has shown a very high level of validity and reliability in this assessment methodology. The assessment approach appears to be effective at varying levels of rigor and academic achievement. Studies have examined adaptive comparative judging techniques in academic areas such as writing/composition, science education, and geography instruction. The areas of design and technology have proven to be especially effective topics for ACJ assessment, and are of special interest to the authors.

This paper examines the fundamental principles of comparative judging and adaptive comparative judging, and discusses some of the most recent and relevant research on this topic. Several readily available web-based ACJ tools and products are reviewed, especially as they relate to academic settings. Applications in the areas of portfolio evaluation, graphics assignment (CAD, animation, Web, etc.) assessment, and peer critiquing are also explored.

Additionally, the potential for large-scale collaboration using this methodology for analyzing educational productivity, learning effectiveness, and collaborative research is considered. Adaptive comparative judging has proven to be a method or assessment tool that is relatively straightforward to learn for faculty, and somewhat easily applied to a wide variety of topics and assignment approaches. Lessons learned to this point in time and application best practices using ACJ are shared with an eye toward future applications of this approach that is rapidly growing in popularity.

Bartholomew, S. R., & Connolly, P. E. (2017, June), Adaptive Comparative Judgment in Graphics Applications and Education Paper presented at 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. 10.18260/1-2--27537

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2017 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015