Case studies of elearning innovation 3

Posted on by Keith Aquilina

Case study: Moving from OMR to CBA

Area: e-assessment

Institution: The University of Nottingham

Author: Simon Wilkinson

Link: The University of Nottingham, Moving from Optical Mark Recognition (OMR) to Computer Based Assessment (CBA) for summative exams in medicine

Background & context

This case study focuses on the shift from OMR to CBA. This change was derived from ‘time pressures of marking increasing cohort sizes’ and from the ‘desire to create more realistic questions.’

Anticipated problems included 1) availability of large enough computer labs 2) possibility of increase in plagiarism

Various stakeholders were involved in this shift to CBA.

Training for staff and students was implemented.

Technology Used

TouchStone e-assessment platform.

Tangible benefits

Administrators

  1. External examiners have immediate access to the paper.
  2. Platform administrators can check whether an external has reviewed a paper by a particular deadline.
  3. Such a system provides a centralised storage space through which information may be viewed in various forms.
  4. Marking time is reduced drastically.
  5. Flexibility in timetabling.
  6. Saves paper and printing time.

Academics

  1. Use of multimedia and interactive questions is possible.
  2. Reduction in the probability of getting the answer correct through guessing.
  3. Any kind of image (eg x-rays) is easier and cheaper to reproduce on screen then on paper.
  4. Platform keeps an automatic change log.
  5. System does not allow concurrent editing.

Students

  1. Such a system accomadates easily certain disabilities (e.g. dyslexia)
  2. Online exam cleaner. No hickups such as marking multiple answers for same question.

disadvantages/drawbacks?

  1. Need large computer labs, powerful servers
  2. Anxiety amongst students and staff due to unfamiliarity with such a system.

Univeristy opted towards a different e-assessment software (Questionmark perception) whilst that department kept using Touchstone.

Lessons Learned

A need for greater involvement of all key stakeholders in online assessment from the outset.

Experience has shown that some of the usual stakeholders in exams take a step back when IT becomes involved.

Rigorous testing is a must to minimise failures.

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Unknown's avatar

Published by Keith Aquilina

Currently my professional role is that of Education Officer (Quality Assurance) within the Directorate for Quality & Standards in Education in the Ministry of Education, Malta. After eight years teaching Computing and ICT within a state secondary school, I moved to the Department of eLearning where my role focused on the organisation of national educational events of which the national eLearning awards and conference, Malta Robotics Olympiad and student competitions. In addition to the work within the Department of eLearning, as from 2011 I have taken the role of ICT coordinator within the Directorate for Lifelong Learning where for 5 years, I was involved in the development and organisation of ICT related courses within the directorate’s adult education centres and collaborating entities. In 2012, I completed my Masters studies in Online and Distance Education from the Open University. This blog started off as an online reflective diary for my studies in the Masters in Online and Distance Education with the Open Univeristy. As may be easily deduced, my main interest is in technology, learning and anything in between. Linkedin; mt.linkedin.com/in/keithaquilina/