{"id":6035,"date":"2021-01-11T12:17:18","date_gmt":"2021-01-11T12:17:18","guid":{"rendered":"https:\/\/blogs.ncl.ac.uk\/ltdev\/?p=6035"},"modified":"2021-09-16T15:47:44","modified_gmt":"2021-09-16T14:47:44","slug":"numbas-guidance-for-support-staff","status":"publish","type":"post","link":"https:\/\/blogs.ncl.ac.uk\/ltdev\/2021\/01\/11\/numbas-guidance-for-support-staff\/","title":{"rendered":"Numbas guidance for support staff"},"content":{"rendered":"\n<p>Numbas is an e-assessment system developed by the e-learning unit in the school of mathematics, statistics and physics.<\/p>\n\n\n\n<p>It\u2019s been in use for around a decade, within Newcastle and around the world.<\/p>\n\n\n\n<p>This page contains information for professional services staff supporting modules which use Numbas for assessment.<\/p>\n\n\n\n<!--more-->\n\n\n\n<h2 class=\"wp-block-heading\">Contents<\/h2>\n\n\n\n<ul class=\"wp-block-list\"><li><a href=\"#how-it-works\">How it works<\/a><\/li><li><a href=\"#settings\">Settings<\/a><\/li><li><a href=\"#documentation\">Documentation<\/a><\/li><li><a href=\"#the-numbas-app\">The Numbas app<\/a><\/li><li><a href=\"#support\">Support<\/a><\/li><li><a href=\"#what-you-might-need-to-do\">What you might need to do<\/a><\/li><li><a href=\"#frequently-asked-questions\">Frequently asked questions<\/a><\/li><\/ul>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"how-it-works\">How it works<\/h2>\n\n\n\n<p>Questions and exams are written in the Numbas editor, at <a href=\"https:\/\/numbas.mathcentre.ac.uk\/\">https:\/\/numbas.mathcentre.ac.uk\/<\/a><\/p>\n\n\n\n<p><em>Note: <\/em>\u201cExam\u201d is the name for any package of Numbas questions, whether it\u2019s practice material or a high-stakes assessment.<\/p>\n\n\n\n<p>The Numbas LTI tool manages the running of assessments. It\u2019s available as an external tool in Canvas, or in the Numbas app.<\/p>\n\n\n\n<p>A staff member creates the Numbas LTI link, uploads the exam package, and sets options like number of attempts and availability dates.<\/p>\n\n\n\n<p>Students click the LTI link, answer the questions, and their scores are saved to the LTI tool.<\/p>\n\n\n\n<p>The LTI tool can report scores directly back to Canvas. Staff members can click the LTI link to see all attempts, statistics, download scores, review individual attempts, change settings, or remark.<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"settings\">Settings<\/h2>\n\n\n\n<p>There are a variety of options in the Numbas editor and the LTI tool to control what feedback students get, and when.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"in-the-editor\">In the editor<\/h3>\n\n\n\n<p>When editing an exam, you can set:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>A password to begin the exam. <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/exam\/reference.html#term-password-to-begin-the-exam\">Documentation<\/a><\/li><li>Whether the student can do \u201cTry another question like this one\u201d. <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/exam\/reference.html#term-allow-user-to-regenerate-questions\">Documentation<\/a><\/li><li>The duration of time allowed to complete the exam. <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/exam\/reference.html#term-exam-duration\">Documentation<\/a><\/li><li>How much immediate feedback students get on their answers. <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/exam\/reference.html#feedback\">Documentation<\/a><\/li><li>How much feedback to show in review mode, once the exam is over. <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/exam\/reference.html#review-mode\">Documentation<\/a><\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"in-the-lti-tool\">In the LTI tool<\/h3>\n\n\n\n<p>Once you have uploaded an exam to the LTI tool, you can set the following options:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>The number of attempts students may make at the exam. <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#maximum-attempts-per-user\">Documentation<\/a><\/li><li>For exams which allow multiple attempts, how to calculate the student\u2019s total score. <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#grading-method\">Documentation<\/a><\/li><li>When students can see their total exam score on the attempts summary. <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#when-to-show-scores-to-students\">Documentation<\/a><\/li><li>When students can re-enter the exam in review mode. <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#allow-students-to-review-attempts-from\">Documentation<\/a><\/li><li>When students can attempt the exam. <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#available-from-and-available-until\">Documentation<\/a><\/li><\/ul>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"documentation\">Documentation<\/h2>\n\n\n\n<p>Numbas editor: <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/\">https:\/\/docs.numbas.org.uk\/en\/latest\/<\/a><\/p>\n\n\n\n<p>Numbas LTI tool: <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html\">https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"the-numbas-app\">The Numbas app<\/h2>\n\n\n\n<p>Numbas exams run entirely in the student\u2019s browser. For normal browsers, that means students can use the browser\u2019s built-in developer tools to cheat by seeing correct answers or modifying their score.<\/p>\n\n\n\n<p>The Numbas app is a locked-down browser, like the Respondus locked-down browser that is used elsewhere in the university. It doesn\u2019t have any developer tools, so students can\u2019t cheat that way. It\u2019s the only way of accessing our locked-down Moodle server (Moodle is a virtual learning environment like Canvas), so we can be sure that students don\u2019t have access to developer tools for credit-bearing assessments.<\/p>\n\n\n\n<p>There are instructions on installing the Numbas app at <a href=\"https:\/\/www.mas.ncl.ac.uk\/numbas\/help\/\">https:\/\/www.mas.ncl.ac.uk\/numbas\/help\/<\/a>.<\/p>\n\n\n\n<p>There are versions of the app for Windows, Mac, Linux, iOS and Android. It\u2019s installed on the Windows Virtual Desktop and cluster PCs.<\/p>\n\n\n\n<p>It\u2019s policy in MSP that all in-course Numbas assessment that counts towards module credit must run through the Numbas app.<\/p>\n\n\n\n<p>Both students and staff log in to the Numbas app with the same username and password as for other Newcastle IT services. For students, it&#8217;s usually of the form <em>b0000000<\/em> or <em>c0000000<\/em>, and for staff it&#8217;s usually of the form <em>nxxx<\/em>.<\/p>\n\n\n\n<p>For a module to use the Numbas app, the e-learning unit must do some setup work. Student enrolments are automatically synchronised with the university Active Directory.<\/p>\n\n\n\n<p>Lecturers and PS staff must be given access to modules individually by the e-learning unit.<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"support\">Support<\/h2>\n\n\n\n<p>Numbas is supported by the e-learning unit in maths, stats and physics.<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Chris Graham (<a href=\"mailto:christopher.graham@ncl.ac.uk\">christopher.graham@ncl.ac.uk<\/a>) &#8211; director of e-learning.<\/li><li>Christian Lawson-Perfect (<a href=\"mailto:christian.perfect@ncl.ac.uk\">christian.perfect@ncl.ac.uk<\/a>) &#8211; developer of Numbas.<\/li><li>George Stagg (<a href=\"mailto:george.stagg@ncl.ac.uk\">george.stagg@ncl.ac.uk<\/a>) &#8211; extra support.<\/li><\/ul>\n\n\n\n<p>Any queries about Numbas should go to the <a href=\"mailto:numbas@ncl.ac.uk\">numbas@ncl.ac.uk<\/a>, so they reach the whole team.<\/p>\n\n\n\n<p>LTDS does not at the moment have anyone assigned to supporting Numbas &#8211; they forward all queries to the MSP e-learning unit. We\u2019re happy to support Numbas use anywhere in the university.<\/p>\n\n\n\n<p>The school of engineering has a Numbas champion, Simon Lambert (<a href=\"mailto:simon.lambert@ncl.ac.uk\">simon.lambert@ncl.ac.uk<\/a>), who can help with day-to-day problems, or forward more complicated queries to the MSP e-learning unit.<\/p>\n\n\n\n<p>We\u2019d like other schools who use Numbas heavily to appoint Numbas champions, to help spread the support workload.<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"what-you-might-need-to-do\">What you might need to do<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"set-up-an-assessment\">Set up an assessment<\/h3>\n\n\n\n<p><a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#creating-a-new-resource\">Documentation<\/a><\/p>\n\n\n\n<p><strong>When:<\/strong> the lecturer has created an exam in the Numbas editor, and asked you to make it available to students.<\/p>\n\n\n\n<p>First, check that the settings for the exam in the Numbas editor are correct.<\/p>\n\n\n\n<p>Availability dates and limits on the number of attempts are set once you\u2019ve uploaded the exam to Canvas or the Numbas app.<\/p>\n\n\n\n<p>At the moment, if some students are allowed extra time for a time-limited assessment, you must set up a second copy of the exam with the expanded time limit.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"on-canvas\">On Canvas<\/h4>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in the Numbas editor, and click <em>Download SCORM package<\/em>.<\/li><li>Navigate to the appropriate module in Canvas, and create either an Assignment or an item in a Module.<\/li><li><strong>For assignments:<\/strong> Set \u201csubmission type\u201d to \u201cExternal tool\u201d, then click <em>Find<\/em> and select \u201cNUMBAS\u201d. Tick <em>Load this tool in a new tab<\/em>. <strong>For modules:<\/strong> Add \u201cExternal tool\u201d and select \u201cNumbas\u201d. Tick \u201cOpen in a new tab\u201d.<\/li><li>Open the link you created.<\/li><li>In <em>Upload exam package<\/em>, upload the SCORM .zip file you downloaded from the editor, and press <em>Submit<\/em>.<\/li><li>Set the availability and review dates.<\/li><\/ol>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"on-the-numbas-app\">On the Numbas app<\/h4>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in the Numbas editor, and click <em>Download SCORM package<\/em>.<\/li><li>Open the Numbas app, and navigate to the appropriate module. (The e-learning unit might need to give you access)<\/li><li>Click <em>Turn editing on<\/em>.<\/li><li>Click <em>Add activity or resource<\/em>.<\/li><li>Click <em>Numbas<\/em>.<\/li><li>Write a name in <em>Activity name<\/em>, then click <em>Save and display<\/em>.<\/li><li>In <em>Upload exam package<\/em>, upload the SCORM .zip file you downloaded from the editor, and press <em>Submit<\/em>.<\/li><li>Set the availability and review dates.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">Create a paper version of an exam<\/h3>\n\n\n\n<p>The exam author should use the &#8220;Printable worksheet theme&#8221; to create a PDF version of the exam. If they like, they can create a different version of the exam for each student, or just one version for everyone.<\/p>\n\n\n\n<p>Here&#8217;s a video showing how to do it:<\/p>\n\n\n\n<figure class=\"wp-block-embed-vimeo wp-block-embed is-type-video is-provider-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Create a printable PDF version of a Numbas test\" src=\"\/\/player.vimeo.com\/video\/528786881?dnt=1&amp;app_id=122963\" width=\"525\" height=\"295\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"reopen-a-students-attempt\">Reopen a student\u2019s attempt<\/h3>\n\n\n\n<p><a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#reopen-an-attempt\">Documentation<\/a><\/p>\n\n\n\n<p><strong>When:<\/strong> a student accidentally ends their attempt at an exam, you can reopen it for them.<\/p>\n\n\n\n<p>You shouldn\u2019t do this for high-stakes assessments where the student could have seen feedback or worked solutions after ending their attempt.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Attempts<\/em>, and search for the student\u2019s name.<\/li><li>On the line corresponding to the completed attempt, click <em>Reopen<\/em>.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"allow-a-student-another-attempt-at-an-assessment\">Allow a student another attempt at an assessment<\/h3>\n\n\n\n<p><a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#access-tokens\">Documentation<\/a><\/p>\n\n\n\n<p><strong>When:<\/strong> the module leader wishes to allow a student another attempt at an assessment which is normally limited to one attempt.<\/p>\n\n\n\n<p>You don\u2019t need to delete their first attempt.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>View individual student progress and grant access tokens<\/em>.<\/li><li>On the line with the student\u2019s name, click the <strong>+<\/strong> icon to grant an access token.<\/li><li>When the student next opens the assessment, they will have the option to start a new attempt.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"check-a-students--answers-have-been-recorded\">Check a student\u2019s answers have been recorded<\/h3>\n\n\n\n<p><strong>When:<\/strong> because of computer or internet connection troubles, or just cautiousness, a student is not sure if all of their answers have been saved.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"if-the-student-gives-you-a-receipt-code\">If the student gives you a receipt code<\/h4>\n\n\n\n<p><a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#validate-a-receipt-code\">Documentation<\/a><\/p>\n\n\n\n<p>When a student finishes an attempt, Numbas gives them a <em>receipt code<\/em>, a string of letters and digits, which contains encrypted information about their score. If a student sends you one of these codes, you can check it against the score saved in the database.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Validate a receipt code<\/em>.<\/li><li>Paste the code into the text box.<\/li><li>Click <em>Validate this code<\/em>.<\/li><li>You are shown the information from the receipt code and the information saved in the database. If they don\u2019t match, then the student\u2019s device may still have some unsaved data on it. They should access the attempt again and Numbas will try again to save data to the database. If they can\u2019t do that, then you should ask for evidence of their work such as screenshots or handwritten working.<\/li><\/ol>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"review-the-students-attempt\">Review the student\u2019s attempt<\/h4>\n\n\n\n<p><a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#review-an-attempt\">Documentation<\/a><\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Attempts<\/em>, and search for the student\u2019s name.<\/li><li>On the row corresponding to the student\u2019s attempt, click <em>Review<\/em>. This shows the student\u2019s attempt in review mode, with all their answers and any feedback visible. Click through the exam\u2019s questions to see what answers are saved.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"update-an-exam-package\">Update an exam package<\/h3>\n\n\n\n<p><strong>When:<\/strong> there was a mistake setting up the marking or wording of a question, and the lecturer has fixed this in the Numbas editor.<\/p>\n\n\n\n<p>You must decide if the fixed exam can safely be used as a replacement for the old one. A replacement is only unsafe if questions are added or removed, or the parts structure of a question changes due to parts being added, moved or removed. If you make an unsafe replacement, existing attempts will continue to use the old version, while new attempts will use the new one. If the change is just to marking settings or the text prompts, the replacement is safe, and all attempts will use the new package.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Settings<\/em>.<\/li><li>Click <em>Replace exam package<\/em>.<\/li><li>Tick <em>This is a safe replacement for the previous exam package<\/em> if appropriate.<\/li><li>Click <em>Update from editor<\/em>.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"automatically-remark-an-assessment\">Automatically remark an assessment<\/h3>\n\n\n\n<p><strong>When:<\/strong> there was a mistake setting up the marking of a question, you\u2019ve updated the exam package with a fixed version, and existing attempts need to be remarked.<\/p>\n\n\n\n<p>The remarking interface shows you all attempts at the assessment, along with their current scores, and allows you to remark them using the latest version of the exam. You must update the exam package if you haven\u2019t already done so &#8211; see the section above.<\/p>\n\n\n\n<p>Once you choose to save a changed score for an attempt, the original data is still kept, so this can be undone if necessary. At the moment, undoing a remarked score needs someone from the e-learning unit, but eventually it\u2019ll be available in the web interface.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Remark<\/em>.<\/li><li>Click <em>Remark all attempts<\/em>.<\/li><li>Remarking can take a long time. You will see a progress bar and an estimated finish time. No new scores are saved at this point.<\/li><li>Once the remarking has finished, you can compare the new marks against those saved in the database. You can choose to show all attempts, just changed attempts, or just those with increased\/decreased scores.<\/li><li>Either click <em>Save all changed attempts<\/em>, or click the <em>Save<\/em> buttons corresponding to individual attempts.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"manually-remark-an-assessment\">Manually remark an assessment<\/h3>\n\n\n\n<p><strong>When:<\/strong> the lecturer wants to apply their discretion to award a student a different mark for an answer.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Attempts<\/em>.<\/li><li>Search for the student\u2019s name.<\/li><li>In the row corresponding to the student\u2019s attempt, click <em>Remark<\/em>.<\/li><li>The table lists the student\u2019s scores for each part of each question of the exam. Find the row corresponding to the part you want to remark, and click the pencil icon.<\/li><li>Enter the new score in the score field.<\/li><li>Click outside the score field to save it. (This interface needs to be improved)<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"mark-a-students-unsubmitted-answers\">Mark a student\u2019s unsubmitted answers<\/h3>\n\n\n\n<p><strong>When:<\/strong> a student entered answers for one or more question parts, but didn\u2019t press <em>Submit<\/em>.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Remark<\/em>.<\/li><li>Tick <em>Use unsubmitted answers<\/em>.<\/li><li>Remark either an individual student\u2019s attempt, or all attempts.<\/li><li>If the total score changes, you must click <em>Save<\/em> to keep this new score.<\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"discount-part-of-a-question\">Discount part of a question<\/h3>\n\n\n\n<p><strong>When:<\/strong> student have already started attempts at an assessment, but the lecturer decides that part or whole of a question should not count towards the total score.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Discount question parts<\/em><\/li><li>In the row corresponding to the question part you want to discount, click <em>Discount this part<\/em>.<\/li><li>If this assessment is in Canvas, you will need to report the changed scores:<ol><li>Click <em>Dashboard<\/em>.<\/li><li>Click <em>Report scores back to VLE<\/em>.<\/li><\/ol><\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"produce-summary-statistics-for-an-assessment\">Produce summary statistics for an assessment<\/h3>\n\n\n\n<p><strong>When:<\/strong> an assessment\u2019s deadline has passed, and you want to know summary statistics such as the average score and score quartiles.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the exam in Canvas or the Numbas app.<\/li><li>Click <em>Statistics<\/em>.<\/li><li>You\u2019re shown:<ul><li>A table of the numbers of completed and incomplete attempts.<\/li><\/ul><\/li><\/ol>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"upload-scores-to-ness\">Upload scores to NESS<\/h3>\n\n\n\n<p><strong>When:<\/strong> an assessment\u2019s deadline has passed and the scores should be uploaded to NESS for release to students.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>Open the Numbas LTI link for the assessment. Click <em>Download scores as CSV<\/em>.<\/li><li>Go to NESS. Click <em>Coursework<\/em> -&gt; <em>Marking<\/em> -&gt; <em>Upload marks<\/em>.<\/li><li>Select the appropriate module and assessment.<\/li><li>File format: comma separated; Student no index: 4; Mark index: 5 for percentage, 6 for raw score.<\/li><li>Make sure the marks available in Numbas and NESS match.<\/li><li>Select the CSV file.<\/li><li>Click <em>Upload<\/em>.<\/li><li>The scores are now in NESS, but not released to students. Release the scores when appropriate.<\/li><\/ol>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"frequently-asked-questions\">Frequently asked questions<\/h2>\n\n\n\n<p>The following are answers to the most common questions from students.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"how-are-incomplete-attempts-handled\">How are incomplete attempts handled?<\/h3>\n\n\n\n<p>Incomplete attempts are included in the CSV score exports, so students won\u2019t lose out if they forget to click \u201cEnd Exam\u201d.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"can-students-leave-an-assessment-and-carry-on-later\">Can students leave an assessment and carry on later?<\/h3>\n\n\n\n<p>Yes, no matter what the settings for an assessment are, students can always reopen it before the deadline and carry on where they left off.<\/p>\n\n\n\n<p>Their answers are saved automatically. Students should click <em>Submit<\/em> after entering each answer, but Numbas makes its best effort to save even unsubmitted answers.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"what-happens-if-the-students-computer-breaks-during-an-attempt\">What happens if the student\u2019s computer breaks during an attempt?<\/h3>\n\n\n\n<p>They can reopen the attempt later on, on the same device or a different one.<\/p>\n\n\n\n<p>Data is saved to the student\u2019s computer before being sent to the Numbas server. If there was any data that hadn\u2019t been received by the server when the student\u2019s computer broke, it will be sent again when they reopen the attempt <em>on the same device<\/em>.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"what-happens-if-the-students-internet-connection-breaks-during-an-attempt\">What happens if the student\u2019s internet connection breaks during an attempt?<\/h3>\n\n\n\n<p>All the marking happens on the student\u2019s device, so they can continue working through an assessment even when there\u2019s no internet connection.<\/p>\n\n\n\n<p>If no connection is available for a long period (about a minute), a red warning box pops up telling the student that their data has not been saved to the database. It\u2019s still saved to their device.<\/p>\n\n\n\n<p>When the internet connection is restored, all data is sent to the server. Once all the data has been saved to the server, the red box disappears.<\/p>\n\n\n\n<p>If the student closes the exam while there\u2019s no internet connection, their data is not completely lost: the next time they open that attempt <em>on the same device<\/em>, the data will be restored from local storage and Numbas will try again to save it to the database.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"what-happens-if-the-deadline-passes-while-a-student-is-attempting-an-exam\">What happens if the deadline passes while a student is attempting an exam?<\/h3>\n\n\n\n<p>The attempt ends immediately. Any unsubmitted answers are not marked. If necessary, you can use the automatic remarking tool to mark unsubmitted answers.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"what-happens-if-the-availability-dates-change-while-students-are-attempting-an-exam\">What happens if the availability dates change while students are attempting an exam?<\/h3>\n\n\n\n<p>Each device with the exam open is sent the new dates, so all attempts will end at the right time.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"what-happens-if-the-student-opens-the-same-attempt-on-two-different-devices\">What happens if the student opens the same attempt on two different devices?<\/h3>\n\n\n\n<p>The first device to open the attempt is kicked out, assuming it\u2019s still connected to the internet.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"can-students-change-their-answers\">Can students change their answers?<\/h3>\n\n\n\n<p>Numbas does not limit how many times a student can submit answers. Students can change their answers to any question part at any time until the attempt ends.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Numbas is an e-assessment system developed by the e-learning unit in the school of mathematics, statistics and physics. It\u2019s been in use for around a decade, within Newcastle and around the world. This page contains information for professional services staff supporting modules which use Numbas for assessment.<\/p>\n","protected":false},"author":4898,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[394],"tags":[463],"class_list":["post-6035","post","type-post","status-publish","format-standard","hentry","category-numbas","tag-numbas"],"_links":{"self":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/6035","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/users\/4898"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/comments?post=6035"}],"version-history":[{"count":5,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/6035\/revisions"}],"predecessor-version":[{"id":6117,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/6035\/revisions\/6117"}],"wp:attachment":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/media?parent=6035"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/categories?post=6035"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/tags?post=6035"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}