SP 13 | AI and high stakes marking: thinking through the principles | Jo Handford
-
In this workshop session, we’ll explore the use of AI systems as part of the marking or scoring process in high-stakes assessments. Understanding the implications of AI use is necessary to inform both policy and practice in this area. Though AI systems are diverse and new models are developed all the time, we can gain clarity by taking a principles-based approach. In this interactive session, we’ll present our current thinking on the principles of AI use in marking and the implications for our context.
We’ll ask workshop participants to bring insights from their own areas of expertise, to challenge us and themselves on some fundamental questions, and to reflect on whether the principles discussed offer constructive ways to think about AI use in similar contexts. The major questions we’ll discuss are: • What are the knowns and unknowns of current cutting-edge AI?
• Can AI exercise judgement, and how does this matter to marking?
• How do the characteristics of current AI relate to the core characteristics of marking?
• Thinking practically, how should we evaluate the acceptability of AI use in marking?