{"id":4293,"date":"2018-08-24T14:24:00","date_gmt":"2018-08-24T13:24:00","guid":{"rendered":"https:\/\/blogs.ncl.ac.uk\/ltdev\/?p=4293"},"modified":"2021-09-17T15:34:55","modified_gmt":"2021-09-17T14:34:55","slug":"expanding-online-exam-provision","status":"publish","type":"post","link":"https:\/\/blogs.ncl.ac.uk\/ltdev\/2018\/08\/24\/expanding-online-exam-provision\/","title":{"rendered":"Expanding and diversifying online exam provision"},"content":{"rendered":"<p>In 2017\/18 academic year the University launched a project that aims to make online summative assessment possible for a wide range of assessment types and in non-cluster environments, which is one of the objectives in the TEL Roadmap.<\/p>\n<p>The project focuses on two key areas:<\/p>\n<ul>\n<li>Expanding the types of online exams that we can deliver here at Newcastle<\/li>\n<li>Exploring the possibility of students using their own laptops to take secure online exams<\/li>\n<\/ul>\n<p><!--more--><\/p>\n<h1>The first pilot exams<\/h1>\n<p>Online exam software called WISEflow was used for 3 pilot exams in semester 2 2017\/18.\u00a0 All the students who took a pilot exam were given a briefing about how their exam would work, and had the opportunity to take a practice test so that they could try out the software before their exam.<\/p>\n<h1>Typed written\/essay exams<\/h1>\n<p>Two online exams that included a typed essay part took place successfully in semester 2 assessment period.\u00a0 The exams were taken by Stage 1 Biology and Stage 2 Psychology students, and all took place in university computer clusters.<\/p>\n<figure id=\"attachment_4474\" aria-describedby=\"caption-attachment-4474\" style=\"width: 1215px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/FLOWlock-exam-type-functionality.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-4474\" src=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/FLOWlock-exam-type-functionality.png\" alt=\"Image of interface, showing functions described in the blog post\" width=\"1215\" height=\"499\" srcset=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/FLOWlock-exam-type-functionality.png 1215w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/FLOWlock-exam-type-functionality-300x123.png 300w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/FLOWlock-exam-type-functionality-768x315.png 768w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/FLOWlock-exam-type-functionality-1024x421.png 1024w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/a><figcaption id=\"caption-attachment-4474\" class=\"wp-caption-text\">Student view of typed written exam interface<\/figcaption><\/figure>\n<p>The exam software has word processing functionality that allows the student to<\/p>\n<ul>\n<li>use text formatting options including numbering, bullet points, and showing emphasis with italics, font size, type and colour<\/li>\n<li>edit and reorder their work as they write<\/li>\n<li>insert headings and generate an automated contents page, which they can use to navigate between sections of a long piece of writing<\/li>\n<li>draw basic diagrams<\/li>\n<li>see earlier versions of their work, and revert back to an earlier version if needed<\/li>\n<\/ul>\n<p>The academic setting the exam can also choose whether to allow their students to use spellcheck during the exam.<\/p>\n<p>When they had finished their pilot exam all students were invited to complete an evaluation survey.\u00a0 This chart shows how students rated their experience of typing an essay exam:<\/p>\n<p><a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/Typed-written-exam-student-evaluation-chart.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-4329\" src=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/Typed-written-exam-student-evaluation-chart.png\" alt=\"\" width=\"890\" height=\"684\" srcset=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/Typed-written-exam-student-evaluation-chart.png 890w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/Typed-written-exam-student-evaluation-chart-300x231.png 300w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/Typed-written-exam-student-evaluation-chart-768x590.png 768w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/a><\/p>\n<h1>Bring Your Own Device<\/h1>\n<p>The first Bring Your Own Device pilot was a formative multiple choice test for Stage 1 Biomedical Sciences students, which took place during the semester.\u00a0 Students had the opportunity to opt in to taking the exam on their own laptops at an invigilated venue, instead of in a computer cluster.<\/p>\n<p>Before the day of the exam students who opted to take it on their laptop downloaded and installed the FLOWlock Browser that they would use to take the exam.\u00a0 The software locks down a student&#8217;s laptop in the same way that university computers are locked down for an OLAF exam, and means that they can&#8217;t access anything else on their machine or online during the exam.\u00a0 The students took a practice test on their laptops, so that they could confirm ahead of the exam that everything was working correctly.<\/p>\n<p>Everyone using their own laptop was asked to bring it to the exam fully charged, and power sockets were available in case anyone needed them.\u00a0 The exam was 45 minutes long, and no one needed to make use of the power sockets.\u00a0 A bank of University laptops were also available in case anyone had problems with their laptop, and 2 students made use of these.<\/p>\n<p>This chart shows the evaluation survey responses from students who opted to take the exam on their own laptops.<\/p>\n<p><a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/BYOD-student-evaluation-chart.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-4328\" src=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/BYOD-student-evaluation-chart.png\" alt=\"\" width=\"890\" height=\"633\" srcset=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/BYOD-student-evaluation-chart.png 890w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/BYOD-student-evaluation-chart-300x213.png 300w, https:\/\/blogs.ncl.ac.uk\/ltdev\/files\/2018\/08\/BYOD-student-evaluation-chart-768x546.png 768w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/a><\/p>\n<h1>National context<\/h1>\n<p>The Heads of eLearning Forum (HeLF) recently published the key findings from its 2018 survey on Electronic Management of Assessment (EMA) Digital Exams in UK Higher Education (HE).<\/p>\n<p>The survey found that in the majority of universities (61%) digital exams are replacing traditional exams in only 1 or 2 modules.\u00a0 Here at Newcastle the <a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/category\/olaf\/\">Online Assessment and Feedback (OLAF)<\/a> Service supported 162 online exams in 2017\/18 academic year.\u00a0 Alongside this <a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/category\/numbas\/\">Numbas<\/a> and Optical Mark Reader (OMR) systems are used to deliver specialist digital exams in certain subject areas, and the diversification of online exam provision is set to see\u00a0the number and range of online exams we deliver increase further in the coming years.<\/p>\n<p>The HeLF survey findings about barriers to online exam adoption make interesting reading, with 44% of respondents citing space as the biggest barrier, a factor that we need to consider here.\u00a0 45% of those introducing online exams are using or considering using laptops, but only 13% are focusing solely on Bring Your Own Device.\u00a0 A larger proportion, 28%, are focusing equally on delivering online exams using university-provided hardware and students own laptops.<\/p>\n<p>Did you know that the OLAF Service launched as an initial pilot in 2007\/08, and transitioned to a centrally supported service in 2010\/11?\u00a0 This\u00a0 means that 2018\/19 will be OLAF&#8217;s 12th academic year.\u00a0 The HeLF survey found that only 14% of UK HEIs that responded have been undertaking online exams for 10 or more years, so that&#8217;s definitely something to celebrate!<\/p>\n<h1>What next for online exams at Newcastle University?<\/h1>\n<p>Following the success of the initial pilot exams, the project expanding and diversifying online exam provision will continue for a further 4 years, with more pilot exams using WISEflow planned for 2018\/19.\u00a0 The next phase of pilots will aim to include:<\/p>\n<ul>\n<li>typed written answer\/essay exams from a wider range of disciplines, and which students taken on their own laptops<\/li>\n<li>Bring Your Own Device exams using an &#8216;opt out&#8217; rather than &#8216;opt in&#8217; approach, where students are expected to use their own laptop\u00a0 unless they submit a request to use a university machine<\/li>\n<li>new system marked question types offered in WISEflow that are not currently available in Blackboard for OLAF exams<\/li>\n<li>testing and potential pilots of &#8216;whitelisting&#8217; links, which could allow students to use an online resource or application during a secure locked down exam.<\/li>\n<\/ul>\n<p>If you are interested in participating in the pilot please get in touch with <a href=\"mailto:LTDS@ncl.ac.uk\">LTDS@ncl.ac.uk<\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In 2017\/18 academic year the University launched a project that aims to make online summative assessment possible for a wide range of assessment types and in non-cluster environments, which is one of the objectives in the TEL Roadmap. The project focuses on two key areas: Expanding the types of online exams that we can deliver &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/2018\/08\/24\/expanding-online-exam-provision\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Expanding and diversifying online exam provision&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1840,"featured_media":4323,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[47,265],"tags":[589,588,236,590],"class_list":["post-4293","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment-feedback","category-news","tag-bring-your-own-device","tag-online-assessment","tag-online-exams","tag-wiseflow"],"_links":{"self":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/4293","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/users\/1840"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/comments?post=4293"}],"version-history":[{"count":19,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/4293\/revisions"}],"predecessor-version":[{"id":4475,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/4293\/revisions\/4475"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/media\/4323"}],"wp:attachment":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/media?parent=4293"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/categories?post=4293"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/tags?post=4293"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}