Category Archives: Scores and reports

Regrading questions individually

If a question needs to be removed or the answer key changed and regraded for all students who have taken a test, you can do this by editing the test and regrading (separate post).

It is also possible to manually overwrite the automatic grades on a question for each student. This is particularly useful if you have used text entry questions (e.g. fill in the blank). For fill in the blank questions, you may just want to focus on the students who have submitted answers that are marked as incorrect and think about updating the test for the following year to account for different spellings etc.

To overwrite the automatic grade for a question:

  1. Go to the module/organisation in Blackboard and click Grade Centre, then Full Grade Centre under Control Panel. 
  2. Find the column for your exam/test. You may need to scroll to the right to find it.
  3. Use the drop down menu on the Column Header for your exam to access the Grade Questions feature.
  4. You will see a list of the questions. Click the response number on the right hand side to start grading that question.
  5. You can choose to regrade anonymously by ticking the box at the top left. Click Edit next to any given answer to make the change.

Student advice: Checking your score and viewing feedback

For OLAF Exams the scores are not released immediately after the exam.

Once the school decides to release the scores (and feedback if applicable) they should follow the steps below.

 

Student guide to accessing the score:

  1. Go to any computer with Internet access.
  2. Go to http://blackboard.ncl.ac.uk.
  3. Log in with your Newcastle University username and password.
  4. On the first screen that you come to after logging in (My Institution), click My Grades (under Tools)
  5. In My Grades, select the module for the exam you have taken.
  6. Find the row showing the grade for the exam. (If the test was an OLAF exam the exam name will include the word OLAF and the date the exam took place).
Image of My Grades screen
Click on the image to view full size

Student guide to viewing feedback:

In some cases, particularly practice tests, you can click the score and see more specific feedback.  Your tutor will let you know if this is available for your test.

  1. Click on the name of the test in the My Grades screen (see image above).
  2. In the View Attempts screen click on the grade
Image of View Attempts screen
Click on the image to view full size

Different types of feedback available are different for different tests.  Your feedback may include some or all of the following:

  • Your score for each question
  • Your answer, marked with a green tick if it is correct, or with a red cross if it is incorrect
  • The answer options, with a green tick next to the correct answer or answers
  • Feedback from the instructor about your answer

You can see examples of each of these types of feedback in the image below:

Image of example feedback types
Click on the image to view full size

 

Checking scores and post exam reports

Scores

To see the scores:

  1. Click ‘Grade Centre’ in the Control Panel (bottom left of the screen).
  2. Choose ‘Tests‘.
  3. Scroll to the right until you see the column for the exam. You can hover over the column headers to see the test’s full name.
  4. Scroll down to see individual student scores.
  5. Click a cell and click on the down arrow, choose attempts to see the individual student’s answers.

To save the scores to a spreadsheet (CSV file)

  1. From the Grade Centre, click Work offline (near top right) and then Download. 
  2. Choose selected column and then find the column for the exam form the drop-down list.
  3. Where it says delimiter type, choose Comma. 
  4. Scroll down and click Submit. 

Reporting

There are a number of reports built into Blackboard. Some do not work for exams with randomised question sets.

Attempts statistics

This report is helpful to check immediately after the exam to ensure the questions and answer key were correct. To see the Attempts Statistics report:

  1. Click the column header and then click the downward pointing arrow to bring up the drop down menu.
  2. Click Attempts statistics. 

Please note, this report may take a while to process.

The report will appear onscreen. Scroll down to see each questions, and the percentage of students that choose each answer. If you find that a large number of students have chosen the wrong answer, you might want to check the question is correct.  It is possible to re-score a question or test.  Get in touch with OLAF Admin if you need to do this.

Other settings/reports.

General statistics

  1. Click the column header and then click the downward pointing arrow to bring up the drop down menu
  2. Click Column statistics.

This will display score distributions and averages.

Setting the column to display a percentage instead of  a raw score

  1. Click the column header and then click the downward pointing arrow to bring up the drop down menu.
  2. Click Edit Column settings. 
  3. Change the primary display to percentage.
  4. You can also change the secondary display to score if you want to see both. The secondary display appears in brackets.

Item analysis

See this separate post for information about automated Item Analysis reports for Blackboard tests.

Hiding/unhiding scores and feedback

Sometimes it is appropriate to show students the results of their test, and possibly even feedback on each question, through Blackboard. If using this, please inform students whether the mark is final or provisional. We recommend viewing the Attempt Statistics report where possible to ensure the test looks correct.

Note: Whichever method you use, students will only see their own scores/feedback.

To reveal/hide the score in Grade Centre:

1. Log into the course.
2. Under Control Panel, click Grade Centre, then Full Grade Centre.
3. Scroll to the right to find the column for your test. Hover over the headers to see the full name.
4. Use the drop down menu to see the options. Click Hide from students on/off to switch the grades in the column from hidden to visible, or vice versa.

This will allow students to see their own grade by going to My Grades on the My Institution page when they log in to Blackboard.

Displaying individual questions, answer and feedback.

These settings are under the test options.

  1. In the Module, go to the area where the test was set (e.g. for OLAF exams the OLAF Admin area).
  2. Hover over the name of the test and click the downward pointing arrow that appears.
  3. Choose Edit test settings. 
  4. Scroll down to the section on feedback and tick the boxes as required. (click on image to see the details of the options available to you)

This post explains to students how to view their grade for a test, and any feedback that you have released.  You may want to share the link with your students once the grade and feedback is available for them to view.

‘Attempt in Progress’ icon in grade centre

Why this happens:

After you have run a Blackboard test or an OLAF exam that is automatically marked, the students’ grades appear in the grade centre as soon as they press the ‘Save and Submit’ button at the end of the test.  If a student forgets to press the button, instead of their grade in the grade centre you will see an ‘attempt in progress’ icon of a blue clock.   An example of this is shown below:

Gradecentre attempt in progress

To override this you can submit the attempt on behalf of the student.

 

To submit a test attempt on behalf of a student:

1. Hover your mouse over the grade centre cell with the attempt in progress icon, and click on the dropdown arrow.  Click on ‘Attempt’, as shown below:

Gradecentre click on attempt

2. The student’s attempt will open.  Click on the arrow at the right of the ‘Test Information’ bar to expand it.

3. The Status will show ‘In Progress’.  Click on the ‘Submit Attempt’ button, circled in the example below:

Expand test info, submit attempt button

4. A popup will appear asking you to confirm that you want to submit the attempt on behalf of the student.  Click OK.

5. The Status will now show ‘Completed’.  Either click ‘Exit’ to return to the grade centre, or use the left and right arrows on either side of the student’s name near the top of the screen to scroll to the next student’s attempt.

Item analysis tool

Use this:

  • Immediately after an exam to highlight questions that need checking for errors
  • Before updating the exam for the following year to check for errors, assess how difficult your questions are, and find out how well individual questions discriminate between high and low performers

To run an item analysis report:

  1. Go to the module and the Grade Centre (‘Tests‘ or ‘Full Grade Centre’).
  2. Find the column relating to your exam/test
  3. Click the column header and access the drop down menu to find ‘Item Analysis
  4. Select the test and click Run. It may take a while depending on the complexity of the exam, numbers of examinees and the load on the system. You will see a message telling you that the report is running. You can check back later.
  5. When the analysis has run, you will be able to select it from the list.

Interpreting the report

A summary at the top of the page shows you how many questions are good discriminators (distinguish between low and  high scoring students on the test overall). It also shows you the number of Easy, Medium and Hard questions.

Further down, you can see Discrimination and Difficulty scores for the individual questions. It also indicates questions that may need to be reviewed. See the key on the page.

Questions marked with a red dot have poor discrimination scores and/or easy or hard difficulty values. Click the blue question text to get more info on that individual question.

  • A higher discrimination score number suggests a question is a good discriminator. A low or negative score is a poor discriminator
  • The higher the difficulty score, the ‘easier’ the question was for the students taking the test

Click Edit Test to make a change to the question. If you change the correct answer, you can then ‘Re score’ the test. This will make the change for future tests as well.
See also the video guide from Blackboard on Demand

Item analysis tool Blackboard guide page

 

Transferring scores from Blackboard to NESS

To save the scores to a spreadsheet (csv file)

Note: It is much easier to transfer the scores if NESS is set up so that you can transfer the raw score. In other words, if the test is out of 55, set up the field in NESS  (in Exams>Setting>>Set Up Assessment)  to be out of 55. You can then download and import the raw score from Blackboard.

  1. Go to Grade Centre then Tests (or Full Grade Centre or other types of assessment).
  2. If necessary change the score to display as a score rather than as a percentage by selecting Edit Column Information from the drop-down menu on the column and change the Primary display to Score.  You can set the secondary display to percentage if you like without affecting the upload to NESS.
  3. Click Work offline (near top right) and then Download.

Choose selected column and then find the column for the exam form the drop-down list:

  1. Where it says Delimiter type, choose Comma. 
  2. Scroll down and click Submit.
  3. If you  have downloaded percentages, you may need to remove the percentage sign from the spreadsheet before upload into NESS. This is tricky to do so we would recommend setting NESS up to take the raw score (see note at top of page).

Upload into NESS

The following is from the NESS manual and explains how to upload into NESS

Exam Mark Entry – Upload Exam Marks

Top Tool Bar>EXAMS>MARKING

Side Menu drop down area>>Choose a MODULE CODE

Side Menu>>UPLOAD EXAM MARKS

Please be very careful about ticking: Register Students if Needed box as some students may have attended who are not actually taking the module. Only tick this if you are sure the extra student should be on the module.

The data in your file must be either Tab or Comma Separated and lines terminated with newline; you should select the appropriate option for Tab or Comma Separated, depending on the file type. In the Student No Index box enter the column number on your spreadsheet where the Student Number is and in the Written Examination 1 Mark box enter the column number where the mark is for the exam mark. Leave the other boxes blank. Then Browse for the file where your marks are stored and click Upload. There is a no store check box which should be used if you want to check before you store.

If you have set up the exam paper with separate questions you will not have the Written Examination 1 Mark box you will have Written Examination 1 Question 1 Mark Index etc. in which to enter column numbers (there will be a box for each question you have set up).