Dr Anthony 'Skip' Basiel – Blended Learning Solutions

Learning Assessment Turing Test: Human or AI? 23/01/2025

Click for full-size image

I’m working with the York SJ Computing Science team on a British Council proposal. You can see the details at https://tinyurl.com/BC-STEM2025.
We are considering another AI related project for assessment review 

a) Give the AI the assessment learning outcomes and marking rubric to assign a grade. Compare to the human marks.

b) AI v. human – both feedback text to students to do a ‘Turing test’. Which is human? 

We are working on the research case study model to provide the student test groups with text samples of both AI and human generated marks and feedback. Using an online survey (human/AI composed) we will see if the students can spot the human feedback from AI comments. The lectures will determine if the AI marking falls in range with the human marks.

If you would like to collaborate on this project or join in the publication of the results, please contact me on abasiel@gmail.com