Probity in Online Exams – Success at TEPARG for SDS and FMS TEL

This post highlights the work done by SDS and FMS TEL to support remote exams over the past few years. Successful techniques for keeping students informed and supported are discussed, including student voice.

Work done by the School of Dentistry and FMS TEL Team won first prize at the Trans-European Pedagogic Anatomical Research Group Hybrid Conference this year, for the presentation on ‘Adopting a flexible approach to professional anatomy spotter exams during COVID’. You can read the internal news item on Sharepoint.

This work was also subsequently presented at the Newcastle University Learning and Teaching Conference 2022. Newcastle Staff can view the poster here for an overview.

This work centres on how exams subject to oversight from professional bodies – in this case the General Dental Council – could be run with adequate probity when these could not be undertaken in person.

The first element of this is to run the exams ‘live’ rather than as a 24h format. This meant that teaching staff and professional staff could be on hand to resolve any technical difficulties or make invigilation decisions.

A variety of question designs were also thought through. The final format was a ‘stimulus’ question type on Canvas, allowing an image to be shown with answer options alongside. Now this question type can also be used with Inspera exams.

The support of students with SSPs was also a key consideration, and rest breaks were granted across the board when exams were very lengthy. Students were asked what they thought about the probity measures put in place, such as the use of an exam declaration, and checking responses which may have been copy-pasted. Overall, the response was positive.

A key element in the smooth running of these exams was the preparation offered to students beforehand, such as clear messaging via email and the opportunity to practice with the exam environment before undertaking their summative assessments. 99% of students agreed that they had been well-supported throughout the process and during the exams themselves via the Zoom exam hotline. Most calls were students double-checking their responses had been submitted, rather than having technical issues.

Learning from these exams has already been carried forward for digital exams running through the new Inspera exam system, and the confidence staff and students have in the procedure means that any future changes to circumstances will be much easier to navigate for these teams and cohorts.

First Steps into 3D scanning

This year, 2021/22, FMS TEL took their first steps into 3D scanning to find a solution for a project in Dentistry.

Below you will find a summary of our progress to date, with further developments to come as we learn the craft of creating 3D digital images.

Equipment

  • Artec Leo scanner
  • Artec Studio 15 editing software
  • Sketchfab hosting

Artec Leo Scanner

This is the Artec Leo 3D image scanner. It is a structured light scanner, using light to create geometrical shapes from objects to produce digital 3D versions of real world objects.

The Artec Leo is wireless and has an inbuild screen which you can view the progress of your scan on, rather than having to view on a computer screen like the other Artec scanners. You can store scans onto a micro SD card up to 256gb.

Artec Leo front
Artec Leo back

Find out more about he Artec Leo scanner: https://www.central-scanning.co.uk/product/artec-leo/

Artec Studio Editing Software

Artec Studio is used to edit scans, taking you through various processes to create a scan that is ready for online viewing or 3D printing.

Below is a screenshot from Artec Studio 15

 

Sketchfab Hosting

Sketchfab is one of a number of sites where you can host 3D scans.

Below are some examples of scans we have created and uploaded to Sketchfab

https://skfb.ly/osuCn

https://skfb.ly/osvxV

Authentic Assessment

Having a new assessment system (Inspera) offers the opportunity to redesign assessments, and there are many examples of authentic assessment already running throughout FMS.

What is Authentic Assessment?

Authentic assessment covers a wide range of assessment techniques, including setting tasks that students may be asked to undertake in their future careers. It also covers the setting of other purposeful tasks – assessments that have value beyond simply testing knowledge, such as reflective tasks.

During the FMS TEL conference, a session was run that covered several examples of authentic assessment. Examples came from the School of Dentistry, presented by Ruth Valentine and Chris Penlington, the School of Psychology’s Psychology of Religion module led by Patrick Rosenkranz, and the School of Biomedical Sciences, presented by Lindsey Ferrie. The resources can be accessed via the links below.

  • Video and Audio via Panopto directly.
  • Full set of resources on the FMS TEL Community on Canvas and the MLE.

Inspera Resources

Check out our previous posts on Inspera for more information, or read more on the LTDS website and Inspera’s corporate homepage.

Further Reading

Digital Code for Teaching Anatomy Online – Joanna Matthan

Jo Matthan (Director of Academic Studies, School of Dental Sciences) talks about the teaching of Head and Neck Anatomy (DEN1101) within the School of Dental Sciences (SDS) at the Faculty of Medical Sciences (FMS), and how the move to online teaching necessitated the development of a specialised Digital Code around the use of cadaveric imagery.

Background

In Present-in-Person (PiP) teaching, students attending this foundational head and neck anatomy course would typically have access to the Dissecting Room for their learning. This would be delivered over a six-month period in their first year on either the Dental Surgery (BDS) or the BSc Oral and Dental Health Sciences degrees. This face-to-face time has been reduced to 12 hours from the approximately 50 hours of hands-on anatomy teaching delivered, which left a considerable amount of content to be covered in the digital format. In normal times, a code of conduct is signed by every student the first time they enter the restricted Anatomy and Clinical Skills Centre teaching facility. This was utilised in a digital format during the pandemic but, due to the major overhaul in teaching delivery, there was no way of reinforcing the messages contained within the code of conduct on a regular basis. It felt like a tall order to expect students to remember and understand a list of statements that is seemingly far-removed from them at the start of their anatomy learning journey, and to retain this volume of information in the digital era.

Due to the highly sensitive nature of working with donated cadaveric material and the associated professional standards and ethical considerations linked to this usage, it was necessary to develop a set of guidance to protect the dignity of donors, whilst simultaneously guiding educators, students and institutions on the manifold issues to consider when transitioning to online cadaveric teaching. The sensitive material (i.e., cadaveric images) would not normally be available to students on an ad hoc basis on their own devices. As this content still needed to be covered to ensure the healthcare professionals received all of the necessary training they needed to practice their profession safely and keep patients safe, questions arose around the potential for covert screen-capture, unauthorised viewing and wider sharing of cadaveric content. Such breaches of professionalism have widespread implications, not merely for the course and programme but potentially for the institution. It became clear that it was necessary to collate clear guidance for staff and students to steer through the digital landscape.

Developing an In-house Digital Code

An in-house digital code was developed as part of the SDS Digital Delivery Working Group – a student-staff collaboration that convened over summer 2020 to specifically mitigate for any anticipated issues that could arise from the shift to online delivery for both students and educators within the School. Three different digital codes were created, each in the form of a holding slide that could be utilised in (1) Cadaveric Anatomy Teaching, (2) Clinical Teaching and (3) Seminar or Lecture-based teaching situations. These slides were circulated to the FMS TEL Group and then circulated for feedback from the other Schools that grapple with similar concerns around donor dignity and patient confidentiality. A basic confidentiality agreement was later put in place institutionally, but this was not specific to anatomy or teaching involving potential breaches of patient information. It was felt that, in the new era of digital delivery, it would be more beneficial to reinforce the message of a common digital code at every learning encounter to clearly communicate to students the expectations and behaviours appropriate for this form of teaching. For this purpose, the Digital Code for anatomy was developed, with the aim of utilising it as a holding slide for every synchronous encounter, and as a recorded slide at the start of each non-synchronous session that included cadaveric content.

Digital Code in Practice

The Digital Code slide is displayed at the beginning of every teaching session, whether synchronous or non-synchronous. In synchronous sessions, it is used as the ‘holding slide’ displayed as students enter the video call. When teaching begins, the slide is also reinforced verbally to signal the start of the learning and shared professionalism code of conduct. In practice, it may feel that the points around ethical standards and professionalism are somewhat overemphasised but, given how important they are, the Digital Code does bear repeating. In non-synchronous sessions, a pre-recorded initial slide is added to every lecture recording to reinforce the message not to view the recording in public and to adhere to the digital code. This is added to all recordings from all contributors.

The slide shows 10 dos and don'ts. Do find a quiet place for viewing, switch off from other devices and social media, be mindful many are working from home and disruptions may occur, focus on the session at hand, mute yourself when not speaking and unmute yourself when speaking, raise your hand if you want to ask a question, switch your camera on if possible when speaking. DO NOT view this material/session in a public place, breach confidentiality, take screenshots, use and screen-recording or recording devices to capture these sessions, share material from the sessions, post or discuss sensitive material on social media
The Digital Code slide (download .ppt slide at the end of the post)

The Digital Code slide gives a simple overview of both the required professional behaviours for healthcare professionals and unacceptable behaviours, bringing the more abstract guidance document into clear actionable focus. As a result, students are very clearly aware of the professional expectations expected of them in their chosen field of study, and these regular reminders serve to reinforce this. This is much more effective than simply citing a document which may have only been seen once at the beginning of the course. The existence of this Code is beneficial not only for students who, it is hoped, develop a sense of responsibility with the access to sensitive content, but also for donors, teachers and institutions who can rely on clear guidance but also appreciate that institutions have pre-defined consequences for any breaches – of which none have been reported thus far. Students have displayed high levels of professional conduct throughout the anatomy teaching in SDS and have adopted the digital code without any apparent reluctance or challenges. It is highly likely that, once students return to physical classrooms, this practice will be continued and developed.

Taking it a step further: Developing National Guidance for Online Cadaveric Imaging

Due to manifold misunderstandings on the legislation and guidance around the use of cadaveric images, it became clear at an informal National Designated Individual (DI) / Head of Anatomy Forum (convened to improve communication during the pandemic and consisting of heads of anatomy units and DIs from across the UK, as well as representatives of the regulatory bodies from each country) that educators could benefit from a unified front with regards to digital cadaveric education. A small group from within this informal forum (consisting of representatives from Brighton Sussex Medical School, Newcastle University and University of Nottingham) collated anecdotal and professional experiences with patient confidentiality and social media guidance documentation and developed a three-pronged approach to using cadaveric content online. The first step was to search for guidance from the relevant professional bodies. The Human Tissue Authority (HTA), the national body who regulate teaching related to cadaveric specimens in England, is virtually silent on the use of images of a cadaveric nature, and decisions relating to how images can be used are made by the local HTA DI within institutions. There is also a paucity of guidance on image usage in this context from the devolved nations’ regulatory bodies/inspectors. Some institutions do have some guidance around social media and images, but there is no unified and unambiguous guidance on cadaveric teaching in the online era.

The draft guidance document was circulated to the DI Forum and to the HTA for comments and the final document amended with suggested changes. The current version, along with a suggested PowerPoint slide, is already utilised at SDS for teaching purposes. It has recently been presented at the March 2021 meeting of the Trans-European Pedagogic Anatomical Research Group (TEPARG), at which it proved very popular across the European countries represented, and has been widely lauded for its clarity and utility during this period of intense change. The guidance document, with the digital code appended to it, is now in use across many institutions nationally and internationally and is being reviewed for formal dissemination.

Resources

Human Tissue Authority

TEPARG – Trans-European Pedagogic Anatomical Research Group

Newcastle University Digital Etiquette Guide

Newcastle University Staff – Join our Canvas Community for access to all resources

Download the Slide and Guidance from our Canvas Community