It is now possible to upload your students to grading committees via the csv upload option. This blog post works through the steps required to set up grading committees via CSV upload.
Over the last couple of months, Inspera have been making some updates to their Grade workspace. Graders may have noticed some name changes in the appearance or naming in the Grade area. Ahead of our Semester 1 assessment period, the Digital Exams Team wanted to share some information about the changes you will see.
To complete marking within Inspera, graders will use the different workspaces in the Grader workflow:
A question set is a group of questions created in Inspera. In Inspera you can make individual questions, or you can set up a question set and create a group of questions in there. Individual questions can also be imported into your question set.
Creating your question set
Accessing Inspera
All colleagues (and students) access Inspera via Canvas. Colleagues can either access a ‘test’ exam set up in their Canvas Sandbox area, or by going through an existing Inspera exam.
Naming your question set
You should give question sets meaningful names, e.g. ‘MOD1234 Semester 1 Exam 202425’. This makes it easier to identify the question set for the current academic year. Question sets are created in the Author tab of Inspera.
Remember to rename your individual questions too, so that you can easily find them in the question set. Each new question is automatically given the name ‘New Question’ so if you are creating question sets with multiple questions in, giving them a meaningful name will help you find specific ones later.
If you need to update a question, a meaningful name will make it easier and quicker to locate.
Adding labels to your questions
Adding labels to your individual questions can also help with locating and re-using your questions in other question sets.
If you’d like to know about adding labels and using filters to find questions, please see our dedicated label filtering blog post.
Content creation in question sets
There are various features you can use within Inspera to enhance your question sets. These are optional features you can apply within your question set.
For example, you can randomise the order in which the questions appear for students when they sit they exam. You can also use the random pulling feature to pull a sub-set of questions from a larger bank of questions, so that each student receives a different combination of questions.
If you are using both manually marked essay questions, and a set of multiple choice questions, you are able to put these into what is known as sections. This means you could apply randomisation to the multiple-choice questions only. You could also use another feature on the essay questions known as candidate selected questions.
There is a dedicated Content Creation Featureswebsite on our Learning and Teaching Inspera site which lists the full details on these different features.
Question set deadlines
Once the Module Leader has completed their Digital Exam Form to confirm the details about their Inspera Digital Exam, the next step is to start creating their question sets.
Question sets are created by the module team and shared with the Digital Exams Team via email to Digital.Exams@newcastle.ac.uk.
The question set deadlines for 2024/25 are detailed in the following table:
Semester
Question Set Deadline
Semester 1
15th November
Semester 2
7th March
Semester 1 August Resit (Semester 3)
17th April
Semester 2 August Resit (Semester 3)
8th July
A table with the question set deadlines for each semester.
Training webinars
The Digital Exams Team deliver a training webinar ‘Creating and managing exam questions in Inspera’ which colleagues can sign up to via the Elements training system. The training session covers an on-screen demos of setting up and adding questions to your question set.
Users can addlabels to individual questions to help with general organising and for locating questions with specific content.
Inspera have created the option to filteron labels that have been added to questions. Until now, if filtering on more than one label, the result has been to show all content with any of these labels. We know there is a need to search for all content that has all the selected labels. It is now possible to be able to filter on more than one label simultaneously.
Using labels in practice…
You can add labels to questionsin your question set. For example, you may wish to label your questions with the topic (e.g. Topic X, Y OR Z) but you may also want to add another filter, such as the year the question is from. When searching the question bank of all your questions in Inspera, it is now be possible to filter so that you can find questions that are say from ‘2023/24’ and from ‘topic X’, rather than all questions coming up with either of those filters.
How to filter using labels
Go to Author, and then select Questions
You will then select ‘filter’.
Select the ‘labels’ drop down and search for the labels you wish to find via the search box. You can then select these via the tickboxes.
Use the ‘any’ button if you would like to find any questions using any of the label(s) selected, or use the ‘all’ button if you wish to find questions that have all of the labels you have selected. This will exclude questions that only have one of the selected filters.
New Feature: Grading of Candidate Selected Questions (CSQs)
If you are marking an Inspera exam where students have been given an option to answer certain questions from a range of question options (i.e. students answer one out of three possible questions), this is known as Candidate Selected Questions (CSQs). When in use, the grading per student function (where markers would move to the next student awaiting grading using the downward direction arrow), meant that markers were shown the next student in the list, even if they had answered an alternate option.
Now, markers who move to the next student using the direction arrow next to the student information (as shown below), will find clicking the down arrow will take them to the next student who answered the same question option. This means that marking of a particular question can be achieved.
More information about the candidate selected questions feature can be found on the Inspera Help Centre.
New Feature: Deleting Multiple Questions
It’s now possible to select more than one question and delete in bulk. Previously, the deletion was only possible per question. Deletions should only occur if you no longer wish to use the question, for example, if you found errors or will no longer use the question in future.
Deleting questions can be done via the Author Tab.
To delete multiple, select the tick boxes on the left hand side of the questions you wish to delete.
Multiple questions can be deleted simultaneously by using ‘move to trash’ – a pop up which will appear on the bottom panel.
New Resources
The Digital Exams Team have created some new resources for colleagues. We have a brand-new website dedicated to the use of Grading Committees in Inspera. This website provides users information about what these committees are, how to use them and Frequently Asked Questions area.
As we enter the assessment marking period, the Digital Exams Team want to share some marking ‘hints and tips’ for Inspera Digital Exams. Check out some of our hints and tips listed below.
Hints and Tips
To attach yourself to an exam as a grader, make sure you click the link from the Inspera assignment point in Canvas. This takes you into the ‘Deliver’ area of the exam and you can click the ‘Open in Grade’ button to enter the ‘Grade area’.
If you need to search for a specific student, within the ‘Overview’ section of the Grader area, you can search for a student number to locate their submission. In the screenshot below, ‘stutestX’ is a placeholder for a student ID. In your exams you will see student numbers listed instead.
If you are in the Grade area and need to go back to the Deliver area (for example, to set the feedback settings), there is a shortcut available. Click the ‘Options’ button at the top of the screen and navigate to ‘Shortcuts’. Select ‘Deliver’ and click ‘Open test in Deliver’,
It is possible to download raw marks from Inspera as an Excel file. Click the ‘Options’ button at the top of the screen and navigate to ‘Downloads’. Select ‘Marks as Excel file’,
As standard the Digital Exams team will set up the Canvas assignment associated with your Inspera exam as 100 points. This means (once released) students will view their Canvas Gradebook mark as a proportion. If you’d like students to see raw marks, please edit the Canvas assignment points area to match that of your total Inspera marks.
For manually marked questions, Graders can add Annotations to student submissions. Within student submitted text, click the left mouse button and move the mouse across the text you want to annotate. Click Annotate:
Within the Grade ‘marking’ area there is a search icon for students now for all graders. When marking, use the bottom panel to navigate to specific students using their ID. For example:
Further Support
Webinars
The Digital Exams Team run two dedicated marking webinars which colleagues can book onto:
These training webinars cover a range of marking workflows, including how to amend auto-marked questions and adding annotations to manually marked questions such as essays.
Videos
There are a range of marking videos available on the Inspera L&T website which provide on-screen demonstrations of grading tasks.
Feedback Release
If you would like to release feedback to your students on your auto or manually marked Inspera questions, check out our dedicated webpage on Inspera Feedback Release for further information.
Further questions?
If you have any questions about marking an Inspera exam, please contact the Digital Exams Team via Digital.Exams@newcastle.ac.uk.
If you have any hints or tips that you think we could add to the above list, please do share them with the Digital Exams Team.
We’ve refreshed our Inspera support guidance materials on the Learning and Teaching site, where you will now find links to our new range of webinars and marking how-to videos. We will continue to expand our online guidance resources over the summer.
Inspera Assessment (the university system for centrally supported digital exams) is supported by the Learning and Teaching Development Service with a range of training options open to all staff. We now have a new training session aimed at Professional Service colleagues due to run on March 9 from 3-4pm. You can sign up via Elements.
This session will introduce the digital exam platform Inspera, and how to support an Inspera digital exam.
Introduction to Inspera
Creating an account
Reviewing crated questions and question sets
Basic functionality including randomisation and question choice options
Allow listing and adding resources
Checking the student view
Entering or amending question marks
Inspera Scan sheets
Who should attend?
This webinar is suitable for any professional services colleague supporting an Inspera digital exam.
Inspera assessment is the University’s system for centrally supported digital exams. Inspera can be used for automatically marked exam questions, for manually marked question types including essays, or for exams with a combination of both.
New functionality has recently been launched that enables colleagues to do more with digital written exams.
Question choice for students
Candidate selected questions is used to give students taking your exam a choice of which questions to answer from a list.
For example in an exam where students need to answer 2 essay questions from a list of 6 questions, you can set this up so that a student can choose a maximum of 2 questions to answer.
How does it work for a student?
If candidate selected questions is used in an Inspera exam the student sees information above each question that shows how many questions to select in total, and how many they have already selected. To choose a question to answer they change the ‘Answering this question?’ drop down box to yes.
If a student starts answering a question without changing the ‘Answering this question?’ drop down box, Inspera automatically changes it to ‘Yes’.
When they have selected the maximum number of questions, the student cannot start answering any more questions. However, if they change their mind about which question(s) they want to answer, they can simply change the ‘Answering this question?’ drop down to no, and select a different question instead.
How does it work for a marker?
A marker only sees answers to the questions that a student has chosen to answer.
As students can only submit answers for the maximum number of questions they are allowed to choose, this means you can say goodbye to the dilemma of trying to work out which questions to mark when a student has misread the instructions and answered too many questions!
How can I use it in my exam?
The Candidate selected questions function is available when you are authoring a question set for an Inspera digital exam. Find out more in the Inspera guide for Candidate selected questions.
Rubrics for marking
You can now create a rubric to use for marking any manually marked question type in Inspera. Rubrics allow you to build the assessment criteria for an exam question into Inspera, and use them in your marking.
Choose whether you want to use a quantitative rubric to calculate the mark for a question, or a qualitative rubric as an evaluation and feedback tool, and then manually assign the mark.
How to introduce a rubric for your exam
When you are creating the exam question in Inspera, set up the rubric you want to use for marking that question. The Inspera guide to rubrics for question authors explains how to create a rubric and add it to your exam question.
If you’ve chosen to use one of the quantitative rubric types, as you complete it the student’s mark for the question will automatically be calculated. If you’ve chosen a qualitative rubric, once you’ve completed the rubric use it to evaluate the student’s answer and help you decide on their mark for the question.
You can choose to add feedback to the candidate in the box below the level of performance you’ve selected for each criterion (you can see an example of this in the image below).
Want to learn more about using Inspera for digital exams?
Come along to a webinar to learn about creating exam questions or marking in Inspera.
Enroll onto the Inspera Guidance course in Canvas to learn about Inspera functionality at your own pace.
Find out about the process to prepare an Inspera digital exam, and how the Digital Assessment Service can help on the Inspera webpage.
Contact digital.exams@newcastle.ac.uk if you have questions or would like to discuss how you could use Inspera for a digital exam on your module.