Papadopoulos, C., & Davishahl, E., & Batista Abreu, J. C., & Self, B. P., & Dal Bello, D. J., & Degoede, K. M., & Howard, A. K. T., & Akcayoglu, A., & Ritz, H., & Kitch, W. A. (2023, June), Context Matters: Continued Study of Results of Common Concept Questions at Several Diverse Institutions  Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--42759

\bibitem{asee_peer_42759}
  Papadopoulos, C., \& Davishahl, E., \& Batista Abreu, J. C., \& Self, B. P., \& Dal Bello, D. J., \& Degoede, K. M., \& Howard, A. K. T., \& Akcayoglu, A., \& Ritz, H., \& Kitch, W. A. (2023, June), \emph{Context Matters: Continued Study of Results of Common Concept Questions at Several Diverse Institutions}
  Paper presented at 2023 ASEE Annual Conference \& Exposition, Baltimore , Maryland.
  10.18260/1-2--42759

Christopher Papadopoulos, Eric Davishahl, Jean Carlos Batista Abreu, Brian P. Self, Dominic J. Dal Bello, Kurt M. Degoede, Anna K. T. Howard, Azize Akcayoglu, Hadas Ritz, and William A. Kitch.  "Context Matters: Continued Study of Results of Common Concept Questions at Several Diverse Institutions".  2023 ASEE Annual Conference & Exposition, Baltimore , Maryland, 2023, June.  ASEE Conferences, 2023.  https://peer.asee.org/42759 Internet.  15 May, 2024

\bibitem{asee_peer_42759}
  Christopher Papadopoulos, Eric Davishahl, Jean Carlos Batista Abreu, Brian P. Self, Dominic J. Dal Bello, Kurt M. Degoede, Anna K. T. Howard, Azize Akcayoglu, Hadas Ritz, and William A. Kitch.
  "Context Matters: Continued Study of Results of Common Concept Questions at Several Diverse Institutions".
  \emph{2023 ASEE Annual Conference \& Exposition, Baltimore , Maryland, 2023, June}.
  ASEE Conferences, 2023.
  https://peer.asee.org/42759 Internet.  15 May, 2024

@INPROCEEDINGS{asee_peer_42759
author = "Christopher Papadopoulos, Eric Davishahl, Jean Carlos Batista Abreu, Brian P. Self, Dominic J. Dal Bello, Kurt M. Degoede, Anna K. T. Howard, Azize Akcayoglu, Hadas Ritz, and William A. Kitch"
title = "Context Matters: Continued Study of Results of Common Concept Questions at Several Diverse Institutions"
booktitle = "2023 ASEE Annual Conference \& Exposition"
year = "2023"
month = "June"
address = "Baltimore , Maryland"
publisher = "ASEE Conferences"
note = {https://peer.asee.org/42759}
number = {10.18260/1-2--42759}
}

TY  - CPAPER
AB  - Concept-based instruction is an approach to deploy “concept questions” which are qualitative and designed to elicit patterns of thought that complement or reinforce those required for procedural questions.  Typically, concept questions are multiple choice with one “correct” answer among several “attractive distractors”.  However, some concept questions may, by design, have “multiple defensible responses”, so as to engender debate and deeper discussion about multiple solution pathways, underlying assumptions, or other contextual details.  Also, the use of concept questions is arguably most effective when written explanations of answers are also collected, so as to better understand students’ reasoning, including the possibility that an “incorrect” answer reveals some measure of conceptual understanding (sometimes referred to as a “phenomenological primitive”).  Finally, use of concept questions is part of an evolutionary process of faculty development, in which the deployment, review of explanations, and feedback, is an ongoing process oriented toward effective teaching and learning outcomes.

A Community of Practice (CoP) of mechanics instructors from several diverse institutions (ranging in size, demographics, and identity), has been formed to use the Concept Warehouse (CW) as a platform to create, deploy, and assess the results of concept questions in Statics and Dynamics.  The CW is an online tool that contains several thousand concept questions, called “ConcepTests”, that range over several topics in engineering, including approximately 800 in mechanics.  The CW allows the instructor to deploy the ConcepTests in a variety of modalities, including online or offline, in-class or out of class, and with response time allocated to be “immediate” (say 2-5 minutes during class) or “extended” (say several hours or days as a preparatory or exploratory exercise).
The CoP has two teams, one for Statics, and one for Dynamics.  During the 2022-23 academic year, each member of each team will assign the same four “common questions” from the CW, at the point and in the modality appropriate to their course.  The following data will be collected from students: the answer to the question, corresponding written explanations (i.e., to explain or justify the chosen answer), and feedback (e.g., confidence and impressions as to the usefulness of the question).  Some students and faculty will be selected for follow-up interviews.

This work is the sequel to a work-in-progress (WIP) article published and presented at the 2022 Annual Conference & Exposition, that was conducted by four faculty teaching Statics.  The four common statics questions in this study are the same as used in the WIP.  The WIP reported two general findings:
(i) across all institutions, and independently of correctness of their answers, female students consistently reported lower confidence in their answers; (ii) among students selecting correct responses, only about one third to one half expressed reasoning that was considered “correct”.  Nevertheless, many “incorrect” answers contained portions of reasoning that suggested that some core ideas were being expressed, allowing for the possibility of further discussion to build understanding.

This study will add further data, including information from student and faculty interviews that was not available for the WIP, to validate or cross-examine these results.  In particular, the notion that scores of a concept question are an imperfect measure of students' conceptual understanding will be further explored.  The paper will also discuss if there is evidence to suggest similarities or differences results across the institutional contexts.

AU  - Christopher Papadopoulos
AU  - Eric Davishahl
AU  - Jean Carlos Batista Abreu
AU  - Brian P. Self
AU  - Dominic J. Dal Bello
AU  - Kurt M. Degoede
AU  - Anna K. T. Howard
AU  - Azize Akcayoglu
AU  - Hadas Ritz
AU  - William A. Kitch
CY  - Baltimore , Maryland
DA  - 2023/06/25
PB  - ASEE Conferences
TI  - Context Matters: Continued Study of Results of Common Concept Questions at Several Diverse Institutions
UR  - https://peer.asee.org/42759
DO  - 10.18260/1-2--42759
ER  -