Category: Assessment and Feedback

Posted on

New Inspera training offered

Inspera Assessment (the university system for centrally supported digital exams) is supported by the Learning and Teaching Development Service with a range of training options open to all staff. We now have a new training session aimed at Professional Service colleagues due to run on March 9 from 3-4pm. You can sign up via Elements.

This session will introduce the digital exam platform Inspera, and how to support an Inspera digital exam.

  • Introduction to Inspera
  • Creating an account
  • Reviewing crated questions and question sets
  • Basic functionality including randomisation and question choice options
  • Allow listing and adding resources
  • Checking the student view
  • Entering or amending question marks
  • Inspera Scan sheets

Who should attend?

This webinar is suitable for any professional services colleague supporting an Inspera digital exam.

Posted on

New functionality for Inspera digital exams: question choice and marking rubrics

Inspera assessment is the University’s system for centrally supported digital exams. Inspera can be used for automatically marked exam questions, for manually marked question types including essays, or for exams with a combination of both.

New functionality has recently been launched that enables colleagues to do more with digital written exams.

Question choice for students

Candidate selected questions is used to give students taking your exam a choice of which questions to answer from a list.

For example in an exam where students need to answer 2 essay questions from a list of 6 questions, you can set this up so that a student can choose a maximum of 2 questions to answer.

How does it work for a student?

If candidate selected questions is used in an Inspera exam the student sees information above each question that shows how many questions to select in total, and how many they have already selected. To choose a question to answer they change the ‘Answering this question?’ drop down box to yes.

Screenshot showing student view of Inspera, with the option to choose whether to answer a question. Below the question title is some text which reads 'Answering this question? 0 of 2 questions selected.' There is a drop down box at the right of the text with the options 'Yes', 'No', 'Undecided' available to select.
Screenshot showing student view of Inspera, with the option to choose whether to answer a question.

If a student starts answering a question without changing the ‘Answering this question?’ drop down box, Inspera automatically changes it to ‘Yes’.

When they have selected the maximum number of questions, the student cannot start answering any more questions. However, if they change their mind about which question(s) they want to answer, they can simply change the ‘Answering this question?’ drop down to no, and select a different question instead.

How does it work for a marker?

A marker only sees answers to the questions that a student has chosen to answer.

As students can only submit answers for the maximum number of questions they are allowed to choose, this means you can say goodbye to the dilemma of trying to work out which questions to mark when a student has misread the instructions and answered too many questions!

How can I use it in my exam?

The Candidate selected questions function is available when you are authoring a question set for an Inspera digital exam. Find out more in the Inspera guide for Candidate selected questions.

Rubrics for marking

You can now create a rubric to use for marking any manually marked question type in Inspera. Rubrics allow you to build the assessment criteria for an exam question into Inspera, and use them in your marking.

Choose whether you want to use a quantitative rubric to calculate the mark for a question, or a qualitative rubric as an evaluation and feedback tool, and then manually assign the mark.

How to introduce a rubric for your exam

  1. When you are creating the exam question in Inspera, set up the rubric you want to use for marking that question. The Inspera guide to rubrics for question authors explains how to create a rubric and add it to your exam question.
  2. After the exam has taken place, use the rubric to mark the students’ answers.
  3. If you’ve chosen to use one of the quantitative rubric types, as you complete it the student’s mark for the question will automatically be calculated. If you’ve chosen a qualitative rubric, once you’ve completed the rubric use it to evaluate the student’s answer and help you decide on their mark for the question.
  4. You can choose to add feedback to the candidate in the box below the level of performance you’ve selected for each criterion (you can see an example of this in the image below).
Screenshot of the Grader view of a sample points-range rubric in Inspera.
Screenshot of the Grader view of a sample points-range rubric in Inspera

Want to learn more about using Inspera for digital exams?

Come along to a webinar to learn about creating exam questions or marking in Inspera.

Enroll onto the Inspera Guidance course in Canvas to learn about Inspera functionality at your own pace.

Find out about the process to prepare an Inspera digital exam, and how the Digital Assessment Service can help on the Inspera webpage.

Contact digital.exams@newcastle.ac.uk if you have questions or would like to discuss how you could use Inspera for a digital exam on your module.

Posted on

Students evaluate using Inspera for 21/22 Digital Exams

Inspera Assessment, the University’s system for centrally supported digital exams, launched for the 21/22 academic year. A key part of understanding how we better use digital exams is to consider ways to improve the student experience of taking a digital exam. Following the launch, the Learning and Teaching Development Service (LTDS) asked for student feedback from those who took a digital exam in 21/22.

142 students submitted their feedback.

Here are our findings:

65% of students were somewhat or very satisfied with their overall experience of taking their exam using Inspera.

A pie chart titled ‘How satisfied are you with the experience of taking your exam(s) using Inspera?’ depicts that students reflected their experience(s) as: 1. Very dissatisfied 11%. 2. Somewhat dissatisfied 14%. 3. Neither satisfied nor dissatisfied 10%. 4. Somewhat satisfied 30%.   5. Very satisfied 35%.
Results of the Inspera Student Evaluation

How easy is Inspera to use?

81% of students found starting their Inspera exam somewhat or very easy.

80% of students found handing in/submitting their Inspera exam somewhat or very easy.

When asked to compare a written exam paper and an Inspera paper which included written questions where students could type their answers, 63% of students stated they found it somewhat or much better using Inspera.

Is Inspera better for Take Home or on Campus PC cluster exams?

85% of students were somewhat or very satisfied with their overall experience of using Inspera for their take home exam(s).

73% of students were somewhat or very satisfied with their overall experience of using Inspera for their PC Cluster exam(s).

Thoughts for the future

Inspera seems to be a hit with students overall; the experience of using it is largely positive, with Inspera Take Home papers gaining the highest satisfaction scores. PC Cluster Inspera exam satisfaction scores showed the majority of students were satisfied with their overall experience. Feedback clearly indicated many students felt re-editing written answers works well in Inspera (and is better than trying to edit paper based written exams).

The most common concern raised was around plagiarism. LTDS is keen to work with colleagues to alleviate student concerns and ensure that the provision is developed and supported going forward.

LTDS opened its provision for digital exams to all modules, and the number of planned digital exams for 22/23 has increased.

To better support students before their exam, the LTDS recommend students practise with Inspera. Our survey showed 60% of students tried at least one demo before their main exam; we’d like to get that figure up! Practice exams can help with learning to use the tool and they are accessible via Canvas.

Try it out:

Student Inspera Demo Course

Posted on

Outstanding Contribution to Feedback

Group of students

Dr Michael Waugh from the School or Arts and Cultures recently won Outstanding Contribution to Feedback at The Education Awards run by Newcastle University Students’ Union. Michael shares his approach below.

When I was contacted about producing a piece for the Learning and Teaching @ Newcastle University Blog, a result of my two recent TEAs for Outstanding Contribution to Feedback, I was quite apprehensive. Reading through previous posts and case studies on the topic, I found a lot of emphasis on strategy, curricular design, formalised processes – none of which I felt reflected my own practice. I wouldn’t say I do anything particularly innovative or have an especially unique approach to providing feedback, and I was surprised (not to mention incredibly honoured) to be awarded in such a category.

Instead, I have always operated in a more personable and individualised manner, a recurring theme in students’ nomination comments for my TEAs. I never feel like I’m doing anything out of the ordinary; I just try to take the time to get to know my students, even on big modules and programmes, making it easier to respond to the specific needs of each person I teach. Universities have a tendency to split the academic and pastoral aspects of student life too much, with students being allocated to personal tutors that they might never meet in a lecture or seminar room and learning from lecturers that refuse or neglect to discuss any issues that don’t pertain to their module and its assessments.

Continue reading “Outstanding Contribution to Feedback”
Posted on

Canvas & Turnitin Assignments: Key Issues

LTDS have offered each School the opportunity to receive a presentation ahead of the new academic year highlighting the key issues that should be considered when deciding how to implement coursework submission and marking procedures.​

For Schools and subject areas who are not able to take up this offer, or as a refresher for those who have been able to, a recording of the presentation and the presentation slides are now available.

​The presentation includes issues that have occurred across the last academic year that have caused extra workload for colleagues and impacted the student experience​, including:

Assignment Types

Canvas or Turnitin Assignment?

Using Similarity Checking 

Online assignment submission principles

Assessment and Feedback Procedure​

Avoiding common issues​

Assignment, online marking and feedback guides​

Student assignment submission guidance (ASK Website)

​Delegated Marking​

Canvas Delegated Marking​

Turnitin delegated marking

Moderated Marking​

Moderated grading and double blind marking

Where to find help

Canvas orientation​

All L&T Workshops and webinars​

To discuss any of the issues raised further, or if are any issues that we have not captured, please contact LTDS@ncl.ac.uk

Posted on

Authentic Assessment with Professor Tina Overton

Tina Overton

SAgE Faculty presentation on Authentic Assessment with Professor Tina Overton

Conversations about more authentic forms of assessment have proliferated of late, as Universities everywhere had to rethink assessment formats at short notice.

We are delighted and honoured that Professor Tina Overton has kindly agreed to work with the SAgE Faculty to help us examine how we currently think about assessment in STEM disciplines.

In this one-hour online session, Tina will share her experiences of implementing authentic assessment in Chemistry at Monash University, drawing from her distinguished career in STEM education.

A presentation will be followed by a Q&A session where you can raise issues of interest or concern about assessment in STEM subjects with Tina.

The session will be recorded and made available afterwards.

Time: Sep 15, 2021, 14:00 London

Colleagues can sign up here.

SAgE Faculty workshops on Authentic Assessment with Professor Tina Overton

In this one-hour online workshop, presented twice, Tina will encourage you to rethink your approach to assessment, to consider where you might already be providing authentic assessments, and to reflect on where and how you might want to do more in your programmes/modules. Supported by colleagues in LTDS, the session will be recorded and made available afterwards.

Workshop 1

Time: Sep 30, 2021 13:00-14:00 London.

Or Workshop 2

Time: Oct 4, 2021 13:00-14:00 London

Colleagues can sign up for either workshop here.

Biography: Professor Tina Overton

Tina was until recently Director of the Leeds Institute for Teaching Excellence, having previously been Distinguished Professor at Monash University where she successfully implemented large scale moves to active and context-based learning and authentic assessment in Chemistry. She has a 20 year plus track record in STEM education and is passionate about improving the student learning experience.

If you have any queries about these events please get in touch with LTDS@ncl.ac.uk

You might also be interested in other upcoming learning and teaching events and webinars.

Posted on

Getting ready for the new academic year

Colleague typing on a laptop

With the new academic year fast approaching, we at LTDS are offering a week of online interactive learning sessions to help you get ready for the new academic year.

Here are more details about the new and exciting sessions. You can enrol on each of the six sessions below.

Learning from strategic digital education projects 

This session will take place on Thursday 9 September, 12.00 – 13.00.

This session will outline the achievements made in three strategic blended learning projects in the School of Engineering, Newcastle University Business School and the School of Biomedical, Nutritional and Sports Sciences. It will demonstrate the changes made to programmes and provide an opportunity to ask how it was done in a Q & A.

Sign up to the session through elements.

How to Make a Podcast

This session will take place on Friday 10 September, 13.00 – 14.00.

Newcastle University Learning and Teaching podcast was launched recently. The appetite for podcasting in education is going through a surge in interest in using this engaging medium with students. This workshop will take you through everything you need to know to feel confident and capable to make your own podcast.  

Sign up to the session through elements.

Saving time and enriching your courses with Canvas Commons  

There are two sessions available on Tuesday 7 September, 14:00 – 15:00 and Thursday 9 September, 11:00 -12:00.

Canvas Commons gives us a really easy way of sharing, finding and importing course content into Canvas courses.  We can use Commons to share a whole range of content types including, assignments, pages, quizzes, images as well as entire modules.      

This hands-on webinar provides an opportunity to explore  Canvas  Commons.  You’ll add content from Commons to your sandbox course.  We will consider what you need to do before sharing content and  discuss  examples of how sharing content can save time and enrich your courses. 

Sign up to the session through elements.

Getting your Canvas course ready for next year  

There is a session taking place on Monday 6 September, 15.00 – 16.00 and you can find further dates here.

The aim of this short webinar is to support you while you create your new Canvas courses for the 2021/22 academic year.   You will learn the process for new course creation, how to build your canvas course, and how to check your content is accessible.

The topics that are covered include, blueprints, content and assignment import from the previous year’s course. As well as homepage, curse navigation menu, accessibility, and publishing your content and your canvas course.

Sign up to the session through elements.

Using H5P to create engaging digital content

There are three H5P sessions over the course of this week. Monday 6 September at 13.00, Wednesday 8  September at 9.00, and Thursday 9 September at 14.00.

What is H5P? H5P is a resource that lets you create simple interactive content like interactive videos, quizzes, games, presentations, and more.

This training webinar offers a 30-minute introduction to H5P looking at some of the benefits in using this tool, followed by an optional 30-minute task where you can try creating some H5P content, with guidance.

Sign up to the session through elements.

Digital assessment – outlining the possibilities and processes

This session will take place on Thursday 9 September, 15.00 -16.00.

Assessing students in new ways and delivering feedback remotely during the pandemic has given us as a community of educators and learners a wealth of new experiences and ideas.  As we begin to return to campus, further digital assessment opportunities open up with the introduction of the Unversity’s new digital exam system Inspera Assessment. 

This session will share some of these new possibilities and provide an opportunity to reflect on what to retain from our recent experiences, as well as exploring how digital assessment can further enhance authentic assessment and ensure it is accessible to all our students. 

Sign up to the session through elements.

If you have any questions please get in touch with LTDS@ncl.ac.uk.

Posted on

Announcing the University’s new Digital Exam System: Inspera Assessment

In September 2021 we will be launching a new system for centrally supported digital exams, called Inspera Assessment. Implementing the system will enable the Digital Exam Service to: 

  • Deliver secure locked down present-in-person exams on University computers and students’ own laptops, monitored by University invigilators 
  • Ensure that digital exams are accessible to all our students, and enhance the student experience of exams 
  • Increase the University’s digital exam capacity in the long term 
  • Enable more authentic exams by introducing new functionality

New exam types possible with Inspera will include:  

  • Students taking written exams online, by typing their answers on computer, and incorporating drawings or written calculations done on paper into their online answers where needed. 
  • Allowing access to specific online resources or applications during a secure exam, using allow listing functionality. 

Introducing Inspera is a big step forward for education, assessment and feedback at Newcastle University.  Adopting a specialist digital exam system allows us to do much more than would be possible if we continued to use the Virtual Learning Environment for digital exams.

Choosing a digital exam system 

Inspera has been selected as our digital exam system following a rigorous procurement process, which began with requirements mapping workshops in February 2020, attended by over 60 academic and professional services staff.  The procurement was postponed for a year as a result of the global pandemic, and restarted in semester 2 2020/21 when colleagues had the opportunity to feed in any new or updated requirements via an online survey.   

Once the tender was issued key digital exams stakeholders contributed to a rigorous evaluation process to decide on the system that best fit our requirements.  Students and staff were invited to volunteer for usability testing in each system that met the mandatory technical requirements. The team are very grateful to the 36 colleagues, and 13 undergraduate and postgraduate students, who completed a total of approximately 150 hours of usability testing between them! 

Inspera scored the highest overall for both usability, and for technical and functional requirements. 

Rolling out Inspera 

As standard all 2021/22 modules that have a present-in-person digital exam in MOFS will use Inspera.  If the public health situation requires, it will be possible for these modules to use the system for open book take home exams.

Numbas maths assessment system remains an option digital exams that need specialist mathematics functionality.

The system will be available for additional new digital exams from 2022/23 onwards.  There will be opportunities in the coming months to see demonstrations of the software, and learn more about the new types of assessment that it makes possible.  If you would like to learn more now, please contact digital.exams@newcastle.ac.uk. 

How to get started  

The Digital Exams Service team will contact all 2021/22 module teams with a digital exam in their MOF at the beginning of September, with details of the process for preparing their exam. 

Training will also launch in September 2021, and all colleagues who will be using Inspera in the new academic year are encouraged to sign up.   

Online resources to help students prepare for a digital exam will be published in September, and students will also be able to try out a demo exam in Inspera to help familiarise themselves with the system. 

If you are interested in introducing a new digital exam using Inspera in future, or if you have any queries about a 2021/22 digital exam, please contact digital.exams@newcastle.ac.uk. 

Posted on

Students: Have your say about digital exam software

Four students accessing electronic resources together

At Newcastle University we are choosing new software for students to take digital exams.  The exams will include auto-marked questions like multiple choice or fill in the blank, and written exams that you can take online.  Students will be able to use the software on their own laptops, or use university computers.  

The software we choose must be user friendly.  That’s why we’re inviting students to volunteer for usability testing.  Your input will be key in determining the software that students will use in the future at Newcastle. 

What’s usability testing and how can I get involved? 

  • Complete the testing online any time that suits you, between Monday 26 April 2021 and Friday 21 May 2021 
  • You need a computer connected to the internet 
  • You will be given login details, and a series of tasks to do in each system 
  • When you finish the tasks in each system, complete a survey about how user friendly it is  
  • You may need to install some software on your computer.  You can uninstall it when you’ve finished testing 
  • You will need to test up to 4 software systems.  Testing each one will take approximately 1 hour, and you can split the time up however you want, to fit your schedule 

Why take part? 

Sign up 

Complete this form by 12 noon on Wednesday 21 April 2021 to volunteer. 

You will receive further details when you sign up.  If you have any questions, please contact digital.exams@newcastle.ac.uk.   

Posted on

Buddycheck Updates

There has been a system update to Buddycheck which alongside some improvements to the student view has opened up some new functionality when creating evaluations. The major changes that users will notice are described below. User guidance available on the Digital Learning webpages has been updated to reflect these changes.

Creating an evaluation and reusing questions

When creating a new evaluation you will now be asked to add a title before moving to the full evaluation set up page. There is now the option to use a previous evaluation as a template. To use existing questions in a new evaluation you now need to select an old evaluation as a template.

Buddycheck create evaluation screen with title entry and template selection hihglighted

Student introduction

There is now an option to add in an introduction to the evaluation for students. This will appear to students before they begin an evaluation alongside some new additional guidance on the question types included in the Buddycheck evaluation.

Student introduction test entry

Question ordering

Question order can now be updated by using drag and drop. You can preview, edit or remove questions from an evaluation using the appropriate icon.

question ordering alongside edit, preview and delete icons

Adjustment factor cap

It is now possible to set a minimum and maximum value adjustment factor cap for an individual evaluation.

The adjustment Factor is the average rating of the student divided by the overall average rating for all members of the team. This is used to adjust the individual student mark

It is possible to use either the capped adjustment factor or the original factor with no cap applied when deciding final marks.

For more information on how the adjustment factor may impact marks see the adjustment factor guidance and the adjustment factor excel example.

adjustment factor amendment options

Adding team questions

Alongside the existing ability to create scored questions, it is now possible to create team questions that ask students to answer a 5-scale question about the team as a whole (strongly agree to strongly disagree). Team questions do not contribute to the adjustment factor. 

Team question creation screen

Option to ask students to ‘motivate’ peer question score

When creating a peer question it is now possible to ask students to optionally motivate  scores, i.e. provide a comment as to why they have selected a score for their peer. This is now possible as part of the question rather than through the use of open questions at the end of the evaluation.

Motivation selection toggle and student view of question

For any queries on these changes please contact LTDS@ncl.ac.uk or see the guidance at the Digital Learning webpages.