Edinburgh Napier University

  Background: Formative online multiple‐choice tests are ubiquitous in higher education and potentially powerful learning tools. However, commonly used feedback approaches in online multiple‐choice tests can discourage meaningful engagement and enable strategies, such as trial‐and‐error, that circumvent intended learning outcomes. These strategies will not prepare graduates as self‐regulated learners, nor for the complexities of contemporary work settings. Objectives: To investigate whether providing only a score after formative online multiple‐choice test attempts (score‐only feedback) increases the likelihood of students to engage in self‐regulated learning compared with more directive feedback. Measurable outcomes included deeper learning, collaboration, information seeking, and satisfaction. Methods: Data in this mixed methods study were collected from nursing students through surveys, test results, focus groups, and student discussion board contributions. A quasi‐experimental design was used for quantitative data, and qualitative data were analysed thematically against domains of self‐regulated learning. Results and Conclusions: Students receiving score‐only feedback were more cognitively engaged with the content, collaborated constructively, and sought out richer sources of information. However, it was also associated with lower satisfaction. In this study, minimal feedback created states of uncertainty, which resulted in the activation of self‐regulatory actions. Implications for Practice: Providing overly directive feedback for formative online multiple‐choice tests is conducive to surface‐level learning strategies. By minimising feedback and allowing for extended states of uncertainty, students are more likely to regulate their learning through self‐assessment and problem‐solving strategies, all of which are required by graduates to meet the challenges of real‐world work settings.