Â鶹ÒùÔº

Research suggests multiple-answer question format in exams improves student attainment

New research from Bayes Business School suggests the inclusion of more than one correct response in multiple-choice examinations focuses students on deeper learning of material, and benefits attainment in other forms of assessment such as coursework and timed written tests.

Multiple-choice tests can be delivered in several formats. These include simple true or false statements, single-answer questions where only one answer from provided options is correct, and multiple-answer questions where candidates are asked to identify more than one choice with a penalty for incorrect responses.

The study by Dr. Yusuf Oc, senior lecturer in marketing at Bayes, and Dr. Hela Hassen from King's Business School, examined a quantitative and qualitative comparison of grades, learning time and attainment between single- and multiple-answer formats. The results are in the journal Marketing Education Review.

The research contained two stages. A total of 76 students were taught an online module over six weeks, including recorded videos, texts, readings, visual examples and weekly webinars. Students were then split into two groups and assigned identical multiple-choice assessments, but with either single- or multi-answer questions. They were asked to complete a questionnaire outlining their perceived difficulty of the task and preparedness for the test.

Three weeks later, students took a second test with a different batch of questions. Both groups completed the same test and questionnaire, but switched between formats so they had taken one of each. Five students from each group then reflected on their experiences in a focus group.

A second stage of the study looked at how perception variables might affect overall coursework marks, by measuring scores on an additional graded assessment.

Key findings from the tests and focus groups included:

• On average, students scored markedly lower scores on multiple-answer tests than on single-answer tests.
• However, they did not spend significantly longer preparing for tests with multiple-answer questions than with single-answer ones, nor was the perceived workload any heavier.
• Students observed that multiple-answer questions were more difficult than single-answer questions—and induced greater anxiety due to time pressures in the test—but brought a greater sense of achievement when receiving grades.
• The results of the second stage showed engagement and interest in study, perceived difficulty of assignments and estimated additional workload were all associated with higher overall grades.
• Qualitative findings from focus groups uncovered students' beliefs that multiple-answer questions required them to engage more deeply with the material, promoting critical thinking and analytical skills rather than merely encouraging recall of knowledge.

The study indicates advantages of including multiple-answer questions for both testing and enriching student knowledge of a subject area, but that due consideration must also go to the time given to students in such examination conditions.

Dr. Oc said, "Multiple-choice questions are a quick and time-effective way of testing knowledge. They are popular with examiners as they explore students' application of knowledge while being quick and easy to assess.

"Our study demonstrates the benefits of offering several correct answers in a multiple-choice format. Although this creates an additional challenge to students and heightens anxiety in an exam, we find no significant difference in time taken to prepare for single- and multiple-answer tests.

"In addition, the extra application involved in revising for a multi-answer test commonly results in greater interest in a subject and retention of knowledge, which we show tends to produce better overall coursework and module grades.

"On the other hand, examiners need to recognize the additional stress and time pressures that students suffer in a multi-answer scenario.

"One innovative approach could be to combine both multiple- and single-answer formats into the same exam, using a blend to establish baseline comprehension alongside wider application of knowledge.

"This in turn could combat grade inflation caused by solely using a single-answer approach, while limiting cognitive overload which a blanket multiple-answer format may induce."