Category: Digital Assessment Service

Posted on

Inspera Authoring Videos Guides now available

LTDS now have a new range of short (10 minute and under) videos about creating your Inspera Digital Exam using the Authoring tool. These are available on our website, under the header Video guides for authors : https://www.ncl.ac.uk/learning-and-teaching/digital-technologies/inspera/

The content of these videos is designed to more briefly cover the 1-hour webinar available on the Learning Management System (LMS) ‘Creating and managing exam questions in Inspera’. These short videos group the content into more manageable self-help guides.

Video titleContent covered
Getting started with Authoring Questions on InsperaHow to access the Author tool via Canvas
Navigating the Author tab
Filtering and Labels
The difference between questions and question sets
Creating Questions sets on InsperaCreate and edit question sets
Adding /amended marks awarded per question
Previewing your question/question set 
Adding previously created questions into a question set
Basic Question set functionalitySharing a question set with colleagues
Printing a question set
The Design tab
Advanced Question set functionalityUsing sections in your question set
Question randomisation
Candidate selected questions
Using stimulus
Adding allowed resources

For all Inspera Digital Exams running in the standard Semester 1 assessment period, the deadline for the finalisation of Questions Sets within Inspera is November 17th.

We do still have some spaces left on our 1-hour webinar ‘Creating and managing exam questions in Inspera’ which is taking place on October 23rd virtually. Book your space on the Newcastle University LMS.

Posted on

Expressions of interest sought for an Academic Lead in Digital Assessment

Deadline for expressions of interest: Friday November 3, 2023 

We are seeking an enthusiastic Academic Lead to oversee the development of Digital Assessment at Newcastle University and drive improvements in line with our Education for Life strategy. The Digital Assessment Group supports the use of digital assessment and feedback tools such as Inspera, NUMBAS, Turnitin and Canvas. Reporting to the Digital Education Sub-Committee (DESC), the postholder will work with representatives from across the university to help guide, enable and support the innovative use of digital assessment and feedback tools. 

For more details see the Academic Lead for Digital Assessment Role Description. 

This is a non-remunerated role but has potential to enable demonstration of positive educational impact across the institution. 

To express your interest in this role, please provide a short biography and outline for how you see Digital Assessment evolving in the future. This should be no more than 1 side of A4 and submitted to Susan Barfield (susan.barfield@ncl.ac.uk). Selection will be based on the expression of interest and an informal interview of shortlisted applicants (w/c 13 November 2023). 

If you would like to learn more about what this opportunity involves please contact David Kennedy, Dean of Digital Education (david.kennedy@ncl.ac.uk) or Susan Barfield, Lead for Digital Assessment LTDS (susan.barfield@ncl.ac.uk). 

Posted on

Digital Assessment Webinar Training Programme Available

A photo of hands typing on a laptop keyboard.

We are pleased to share our Digital Assessment Training Programme for 2023-24. Our training sessions are delivered as webinars via Microsoft Teams.

Inspera Assessment (the university system for centrally supported digital exams) is supported by the Learning and Teaching Development Service with a range of training options open to all staff.

Follow the links below to find out more about each session and to book onto individual sessions via the University’s elements system. 

Inspera Webinars

Inspera for Professional Service Colleagues

  • 9 October 2023 – 11:00-12:00
  • 8 February 2024 – 10:00-11:00

Creating and Managing Exam Questions in Inspera

  • 23 October 2023 – 9:00-10:00
  • 19 February 2024 – 14:00-15:00

How to Grade using Rubric in Inspera

  • 9 November 2023 – 10:00-11:00
  • 26 February 2024 – 14:00-15:00

Marking and moderating an Inspera exam with manually marked questions

  • 13 December 2023 – 09:00-10:00 
  • 25th January 2024 – 10:00-11:00 
  • 1st May 2024 – 14:00-15:00  
  • 6th June 2024 – 14:00-15:00 

Marking an Inspera exam with auto marked questions

  • 14 December 2023 – 09:00-10:00 
  • 24 January 2024 – 09:00-10:00 
  • 29 April 2024 – 14:00-15:00 
  • 3 June 2024 – 14:00-15:00 

Digital Assignments: Canvas and Turnitin

Creating and Managing Digital Assignments

  • 19 October 2023 – 11:00-12:00 
  • 29 January 2024 – 15:00-16:00 

Online Marking and Feedback (Canvas)

  • 5 December 2023 – 14:00-15:00 
  • 24 April 2024 – 14:00-15:00 

Online Marking and Feedback (Turnitin)

  • 4 December 2023 – 14:00-15:00 
  • 22 April 2024 – 14:00–15:00 

Any queries?

If you have any queries on any of the above sessions, please contact digital.exams@newcastle.ac.uk.

Meet the Team

You can meet the Digital Assessment Team in this LTDS Blog post.

Posted on

Meet the Digital Exams Team

As the new 2023-24 academic year begins, we’d like to introduce the Digital Exams Team here in LTDS, who lead on the University’s Digital Exams via Inspera. A team of Learning Enhancement and Technology Advisers work together to facilitate digital exams through Inspera Assessment. Inspera Assessment is the University’s Digital Exam system used for present-in-person secure online assessments.

Meet the Team

First up we’ve got Maddie Kinnair who is one of our two Inspera Co-Leads. Maddie joined the team in September 2022 and has worked within the area of Learning and Teaching for 6 years. Maddie first joined HE in 2014 and has previously worked in the School of Computing, HaSS Faculty and within Central Services.

Maddie is also the lead for our peer assessment and feedback tool Buddycheck.

Next up, we’ve got Kimberly May-O’Brien, our second Inspera Co-Lead. Kimberly joined the team in July 2023, having worked at the University since 2019. Kimberly previously worked in the School of English Literature, Language and Linguistics, as well as the central Equality, Diversity and Inclusion team.

Finally, we have Susan Barfield who started working at the University 13 years ago, initially in NUIT as part of the ReCap team, she then joined LTDS in 2019 as lead on online marking and feedback using Canvas and Turnitin, whilst also supporting digital exams.

More Information

You can find out more about Inspera and the training webinars and videos available to colleagues via the LTDS website.

If you have any queries around Digital Exams, you can contact the Digital Exams Team via Digital.Exams@newcastle.ac.uk.

Numbas is the other centrally supported Digital Exam platform. You can contact the Numbas team via Numbas@ncl.ac.uk.

Posted on

The role of Digital Exam Support Assistants (DESA)

A photo of hands typing on a laptop keyboard.

Digital Exam Support Assistants (DESAs) are PGR students who support invigilators in digital exam venues to help students troubleshoot any technical issues using the safe exam browser software. Safe Exam Browser is software which works alongside Inspera offering a secure ‘locked down’ digital exam. Inspera Assessment is the University’s Digital Exam system used for present-in-person, secure online assessments.

How do DESAs support exam invigilators in digital exams?

DESAs are on-hand to support students and invigilators to troubleshoot issues faced when accessing Inspera for Bring Your Own Device (BYOD) exams. Exam invigilators have reported that the presence of DESAs makes them feel more confident in digital exam venues. Feedback has stated that DESAs have been a ‘confidence booster’ and that invigilators ‘couldn’t do it without them’. Invigilators reported that the DESAs were responding to queries quickly which has also been stated by students who had DESA support.

How do students find the DESA support?

39 students submitted their feedback on their Semester 1 22/23 BYOD exam. When asked how satisfied they were with the technical support available in their exam, two thirds of students (67%) reported that they were satisfied or very satisfied.

Students reported that ‘those who requested support were dealt with quickly and there was little hassle.’

How did the DESAs find their experience?

We asked some of our DESAs how they found their experience in the role this year. Check out some of the quotes below:

“I had a wonderful experience with the team. Enough training was given to staff. Would like to work with the team again. Thanks for giving me the opportunity.”

“Regarding my experience in the DESA role this academic year, it provided me with a valuable opportunity to contribute to the Digital Assessment Office and engage with fellow students. The role not only enhanced my understanding of digital assessment practices but also allowed me to develop essential skills in communication and collaboration. I am grateful for the experience and the chance to be a part of improving the assessment process at Newcastle University.”

What’s next?

We are pleased to report that the DESA role will be returning in the 2023/24 academic year. This support provision has been crucial in supporting our students with any troubleshooting during their BYOD digital exams. For more information you can email the Digital Assessment Team.

You can find out more about Inspera in our other blog posts on Inspera and on our Inspera Digital Exams webpage.

Posted on

New Inspera training offered

Inspera Assessment (the university system for centrally supported digital exams) is supported by the Learning and Teaching Development Service with a range of training options open to all staff. We now have a new training session aimed at Professional Service colleagues due to run on March 9 from 3-4pm. You can sign up via Elements.

This session will introduce the digital exam platform Inspera, and how to support an Inspera digital exam.

  • Introduction to Inspera
  • Creating an account
  • Reviewing crated questions and question sets
  • Basic functionality including randomisation and question choice options
  • Allow listing and adding resources
  • Checking the student view
  • Entering or amending question marks
  • Inspera Scan sheets

Who should attend?

This webinar is suitable for any professional services colleague supporting an Inspera digital exam.

Posted on

New functionality for Inspera digital exams: question choice and marking rubrics

Inspera assessment is the University’s system for centrally supported digital exams. Inspera can be used for automatically marked exam questions, for manually marked question types including essays, or for exams with a combination of both.

New functionality has recently been launched that enables colleagues to do more with digital written exams.

Question choice for students

Candidate selected questions is used to give students taking your exam a choice of which questions to answer from a list.

For example in an exam where students need to answer 2 essay questions from a list of 6 questions, you can set this up so that a student can choose a maximum of 2 questions to answer.

How does it work for a student?

If candidate selected questions is used in an Inspera exam the student sees information above each question that shows how many questions to select in total, and how many they have already selected. To choose a question to answer they change the ‘Answering this question?’ drop down box to yes.

Screenshot showing student view of Inspera, with the option to choose whether to answer a question. Below the question title is some text which reads 'Answering this question? 0 of 2 questions selected.' There is a drop down box at the right of the text with the options 'Yes', 'No', 'Undecided' available to select.
Screenshot showing student view of Inspera, with the option to choose whether to answer a question.

If a student starts answering a question without changing the ‘Answering this question?’ drop down box, Inspera automatically changes it to ‘Yes’.

When they have selected the maximum number of questions, the student cannot start answering any more questions. However, if they change their mind about which question(s) they want to answer, they can simply change the ‘Answering this question?’ drop down to no, and select a different question instead.

How does it work for a marker?

A marker only sees answers to the questions that a student has chosen to answer.

As students can only submit answers for the maximum number of questions they are allowed to choose, this means you can say goodbye to the dilemma of trying to work out which questions to mark when a student has misread the instructions and answered too many questions!

How can I use it in my exam?

The Candidate selected questions function is available when you are authoring a question set for an Inspera digital exam. Find out more in the Inspera guide for Candidate selected questions.

Rubrics for marking

You can now create a rubric to use for marking any manually marked question type in Inspera. Rubrics allow you to build the assessment criteria for an exam question into Inspera, and use them in your marking.

Choose whether you want to use a quantitative rubric to calculate the mark for a question, or a qualitative rubric as an evaluation and feedback tool, and then manually assign the mark.

How to introduce a rubric for your exam

  1. When you are creating the exam question in Inspera, set up the rubric you want to use for marking that question. The Inspera guide to rubrics for question authors explains how to create a rubric and add it to your exam question.
  2. After the exam has taken place, use the rubric to mark the students’ answers.
  3. If you’ve chosen to use one of the quantitative rubric types, as you complete it the student’s mark for the question will automatically be calculated. If you’ve chosen a qualitative rubric, once you’ve completed the rubric use it to evaluate the student’s answer and help you decide on their mark for the question.
  4. You can choose to add feedback to the candidate in the box below the level of performance you’ve selected for each criterion (you can see an example of this in the image below).
Screenshot of the Grader view of a sample points-range rubric in Inspera.
Screenshot of the Grader view of a sample points-range rubric in Inspera

Want to learn more about using Inspera for digital exams?

Come along to a webinar to learn about creating exam questions or marking in Inspera.

Enroll onto the Inspera Guidance course in Canvas to learn about Inspera functionality at your own pace.

Find out about the process to prepare an Inspera digital exam, and how the Digital Assessment Service can help on the Inspera webpage.

Contact digital.exams@newcastle.ac.uk if you have questions or would like to discuss how you could use Inspera for a digital exam on your module.

Posted on

Students evaluate using Inspera for 21/22 Digital Exams

Inspera Assessment, the University’s system for centrally supported digital exams, launched for the 21/22 academic year. A key part of understanding how we better use digital exams is to consider ways to improve the student experience of taking a digital exam. Following the launch, the Learning and Teaching Development Service (LTDS) asked for student feedback from those who took a digital exam in 21/22.

142 students submitted their feedback.

Here are our findings:

65% of students were somewhat or very satisfied with their overall experience of taking their exam using Inspera.

A pie chart titled ‘How satisfied are you with the experience of taking your exam(s) using Inspera?’ depicts that students reflected their experience(s) as: 1. Very dissatisfied 11%. 2. Somewhat dissatisfied 14%. 3. Neither satisfied nor dissatisfied 10%. 4. Somewhat satisfied 30%.   5. Very satisfied 35%.
Results of the Inspera Student Evaluation

How easy is Inspera to use?

81% of students found starting their Inspera exam somewhat or very easy.

80% of students found handing in/submitting their Inspera exam somewhat or very easy.

When asked to compare a written exam paper and an Inspera paper which included written questions where students could type their answers, 63% of students stated they found it somewhat or much better using Inspera.

Is Inspera better for Take Home or on Campus PC cluster exams?

85% of students were somewhat or very satisfied with their overall experience of using Inspera for their take home exam(s).

73% of students were somewhat or very satisfied with their overall experience of using Inspera for their PC Cluster exam(s).

Thoughts for the future

Inspera seems to be a hit with students overall; the experience of using it is largely positive, with Inspera Take Home papers gaining the highest satisfaction scores. PC Cluster Inspera exam satisfaction scores showed the majority of students were satisfied with their overall experience. Feedback clearly indicated many students felt re-editing written answers works well in Inspera (and is better than trying to edit paper based written exams).

The most common concern raised was around plagiarism. LTDS is keen to work with colleagues to alleviate student concerns and ensure that the provision is developed and supported going forward.

LTDS opened its provision for digital exams to all modules, and the number of planned digital exams for 22/23 has increased.

To better support students before their exam, the LTDS recommend students practise with Inspera. Our survey showed 60% of students tried at least one demo before their main exam; we’d like to get that figure up! Practice exams can help with learning to use the tool and they are accessible via Canvas.

Try it out:

Student Inspera Demo Course

Posted on

EAMS: 13 – 24 June, 2022

The School of Mathematics, Statistics & Physics will host the fifth international conference on E-Assessment in Mathematical Sciences (EAMS). The conference aims to bring together researchers and practitioners with an interest in e-assessment for mathematics and the sciences. It will consist of a mix of presentations of new techniques and pedagogic research, as well as workshops where you can get hands-on with leading e-assessment software including our own Numbas.

EAMS 2022 is an entirely online conference with a mix of live sessions and web-based activities, and plenty of opportunity for discussion and collaboration. Before the conference starts there will be a programme of optional training workshops available for participants to get hands-on with state-of-the-art maths e-assessment software.

Live talks will take place over Zoom at 9am and 4pm BST (UTC +1) each weekday, with recordings available later. The online format and longer timescale allow participants to engage more deeply with the material presented.

The call for talk and workshop proposals is currently open. If you have some research or an innovative technique related to mathematical e-assessment that you would like to present, then please submit an abstract at eams.ncl.ac.uk/call-for-speakers by 13th May. We’re actively seeking to increase the diversity of our attendees and speakers, and particularly encourage speakers from groups under-represented in previous editions of EAMS to submit proposals.

To attend the conference please register for free at eams.ncl.ac.uk/register.

Posted on

Inspera Assessment, Digital Exams Launch – Presentation Recording

Inspera joined us via zoom for a presentation about the new Inspera Assessment software.

The presentation was delivered by Graeme Redshaw-Boxwell and Susan Barfield from the Learning and Teaching Development Service, who were joined by Suzanne Keys and Harvey Tayman from Inspera. Graeme and Susan discussed the journey Newcastle has taken with Digital Exams, why we are excited about the new software and what it will allow future digital exams to do. Suzanne and Harvey went on to demonstrate the assessment software, from a student and academics perspective.

This is the link to the recording from the session.

The following questions and answers were discussed during the sessions

I want to introduce a digital exam using Inspera, what can I do next? 

Digital exams for semester 1 are only available for modules that have this listed in their 2021-22 MOFS. If you wish to run a digital exam for 2022-23, when you complete your 2022-23 MOF select “PC Examination” for  the Assessment Component.  

If you are interested in running a digital exam in future and would like to find out more, please see our Digital Exams webpages, or contact digital.exams@newcastle.ac.uk .  

We would like to pilot it on some modules, where do we start? 

Please see the  Digital Exams webpages for information on how to get started. I you have a semester 2 exam that you would like to turn into a digital exam, please email digital.exams@newcastle.ac.uk to discuss. 

What capacity is there for digital exams with large cohorts?  
We have previously supported exams with over 400 students and it possible to manage large cohorts, although this may be over several venues. 

Can external examiners access? 

All Canvas users have access to Inspera. If your external examiner has been set up with a Canvas account, they can access Inspera. 

Can you download a copy of the exam paper? 

It is possible to download a PDF version of the exam. 

Can I download feedback 

It is possible to download students’ submissions, feedback annotations and marks as two separate PDFs. 

Can you use Turnitin to check for similarity on typed essay questions? 

Turnitin has been integrated into Inspera, so it possible to check a student’s submission for similarity. The Turnitin marking tools are not available, so it is not possible to use QuickMarks. 

How do we ensure the academic integrity of digital exams? 

It is possible to use a lock down browser on cluster room PCs and students’ own devices exam for digital exams. Ahead of the exam, the students will be asked to install the Safe Exam Browser software on their own laptop if it is bring your own device exam. To start the exam, they must run Safe Exam Browser, which will lock their PC from being able to access anything else. When they submit their exam and close lockdown browser, they can use laptop as normal.

It is not possible for a student to access an exam that requires use of Safe Exam Browser without using Safe Exam Browser. There are warnings in the monitor module if a student had tried to exit the lockdown browser. 

The Inspera Assessment, Digital Exam Launch will continue with two more sessions taking place in person on the 9th and 10th November, click for further details and to book a place