{"id":2351,"date":"2016-04-20T11:28:21","date_gmt":"2016-04-20T10:28:21","guid":{"rendered":"https:\/\/blogs.ncl.ac.uk\/ltdev\/?p=2351"},"modified":"2021-09-17T14:53:20","modified_gmt":"2021-09-17T13:53:20","slug":"ucisa-learning-analytics-conference","status":"publish","type":"post","link":"https:\/\/blogs.ncl.ac.uk\/ltdev\/2016\/04\/20\/ucisa-learning-analytics-conference\/","title":{"rendered":"UCISA Learning Analytics Conference"},"content":{"rendered":"<p>On the 12th of April, I attended the UCISA event on learning analytics. This was a single day event held in Birmingham. Due to travel issues, we unfortunately missed the first speaker, Sarah Porter,\u00a0Co-Chair of the National Inquiry into data in HE, High Education Commission\u00a0&#8211; the author of the HEA report, &#8220;<a href=\"http:\/\/www.policyconnect.org.uk\/hec\/research\/report-bricks-clicks-potential-data-and-analytics-higher-education\">from bricks to clicks<\/a>&#8221;<\/p>\n<h4>OU Analyse <a href=\"https:\/\/www.ucisa.ac.uk\/~\/media\/groups\/cisg\/events\/2016\/learner\/2%20Open%20University.ashx\">(ppt)<\/a><\/h4>\n<p>Zdenek Zdrahal, Knowledge Media Institute, The Open University<\/p>\n<p>The second speaker was Zdenek Zdrahal from Media Unit at the Open University. He described the use of predictive analytics to attempt to identify at-risk students even before the first assignment had taken place, as 98.6% of students who failed the first assignment did not complete the programme. They used a combination of static data including gender and educational history, and fluid data notably VLE interactions. The accuracy of the predictions was increased greatly even when only using the count of &#8220;no of clicks&#8221; in the VLE.<\/p>\n<p>In practice, each item in the VLE was given a label and different paths were mapped to view the successful students possible paths and the typical failing student path. The \u00a0data analysis involved the use of 4 different data modelling techniques. If the student failed two of those techniques they were classified as at risk and intervention was put in place by the School. Spreadsheets were sent to the School highlighting the risk levels of each student. A dashboard has been created that highlights at risk students and the data used.<\/p>\n<p>A student dashboard has been created that shows the student their &#8220;nearest neighbours&#8221;. These are students showing similar engagement behaviours and the predicted outcome for those students. It also predicts whether the student will submit the next assignment. To improve the students predicted outcomes, various activities are recommended.\u00a0Currently, students cannot access this dashboard but\u00a0it is now a priority to release this. I think the extra step of showing suggested activity to students has a real benefit to the learning experience. There is an intervention strategy automatically suggested to the student. The key would be to make sure these suggestions are accurate and relevant.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-1648 size-full\" src=\"http:\/\/graemeboxwell.co.uk\/wp-content\/uploads\/2016\/04\/OULA.png\" alt=\"OULA\" width=\"972\" height=\"754\" \/><br \/>\nThey have released an anonymised open source dataset. &#8211;\u00a0<a href=\"https:\/\/analyse.kmi.open.ac.uk\/open_dataset\">https:\/\/analyse.kmi.open.ac.uk\/open_dataset<\/a><\/p>\n<p>Newcastle University does not have a retention issue overall but there may be areas where the use of data in this way may be beneficial &#8211; for example distance learning programmes.<\/p>\n<h4>JISC Learning Analytics <a href=\"https:\/\/www.ucisa.ac.uk\/~\/media\/groups\/cisg\/events\/2016\/learner\/3%20Jisc.ashx\">(ppt)<\/a><\/h4>\n<p>Michael Webb, the Director of Technology and Analytics at JISC talked about the history of learning analytics , then through some of the work that they are carrying out in the field of learning analytics.<\/p>\n<p>Michael described their work with learning analytics as &#8220;the application of big data techniques such as machine-based learning and data mining to help learners and institutions meet their goals.&#8221;<\/p>\n<p>Predictive learning analytics as seen in the Open University presentation was defined as the &#8220;statistical analysis of historical and current data derived from the learning process to create models that allow for predictions that can be used to improve learning outcomes. Models are developed by &#8216;mining&#8217; large amounts of data to find hidden patterns that correlate to specific outcomes.&#8221; JISC are confident that predictive learning models would be &#8216;fairly&#8217; transferable between institutions.<\/p>\n<p>JISC currently have a learning analytics project that has three core strands:<\/p>\n<ul>\n<li>Learning analytics architecture and service<\/li>\n<li>Toolkit<\/li>\n<li>Community<\/li>\n<\/ul>\n<div style=\"padding-left: 30px\">\n<p><span style=\"text-decoration: underline\">Learning analytics architecture and service<\/span><\/p>\n<div style=\"padding-left: 30px\">JISC are looking to create a national architecture that would help data modelling become transferable. They are working with several institutions to develop core services that institutions would be able to implement at a much lower cost than if developing themselves.<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-1649\" src=\"http:\/\/graemeboxwell.co.uk\/wp-content\/uploads\/2016\/04\/JISCLA.png\" alt=\"JISCLA\" width=\"934\" height=\"514\" \/>JISC demonstrated their student app. It&#8217;s based on fitness apps where users can view an activity stream with their (and their peers)\u00a0activity, including performance against student defined targets.<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1650 aligncenter\" src=\"http:\/\/graemeboxwell.co.uk\/wp-content\/uploads\/2016\/04\/phoneLA.png\" alt=\"phoneLA\" width=\"219\" height=\"414\" \/>JISC are also developing dashboards for students and for administrators:<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1651 aligncenter\" src=\"http:\/\/graemeboxwell.co.uk\/wp-content\/uploads\/2016\/04\/dashboardLA.png\" alt=\"dashboardLA\" width=\"443\" height=\"363\" \/> <img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-1652 aligncenter\" src=\"http:\/\/graemeboxwell.co.uk\/wp-content\/uploads\/2016\/04\/dashboardLA2.png\" alt=\"dashboardLA2\" width=\"451\" height=\"256\" \/><\/p>\n<div style=\"padding-left: 30px\"><span style=\"text-decoration: underline\">Toolkit<\/span><br \/>\nThey have released the <a href=\"https:\/\/www.jisc.ac.uk\/guides\/code-of-practice-for-learning-analytics\">JISC Code of Practice<\/a> that outlines some of the ethical considerations institutions should make before embarking on a learning analytics project. This has been worked on with consultation from NUS. They have released their own guidance to University Students&#8217; Unions.Michael finished off discussing what future developments may occur in learning analytics, including\u00a0links to the teaching excellence framework and personalised next generation e-learning.<\/div>\n<div style=\"padding-left: 30px\"><\/div>\n<h4>Beyond the dashboard: the practical application of analytics <a href=\"https:\/\/www.ucisa.ac.uk\/~\/media\/groups\/cisg\/events\/2016\/learner\/4%20Hobsons.ashx\">(ppt)<\/a><\/h4>\n<p>Ben Stein, Director, Student Success, Hobsons<br \/>\nBen from Hobsons spoke about the inevitable\u00a0rise in student dashboards. While dashboards are an integral part of learning analytics providing methods to display predictive statistics and recommended activities, \u00a0it is crucial that the support structures are in place that will provide positive interventions. Mark asked, &#8220;does a deeper understanding of the problem actually lead to a solution?&#8221; and stated, &#8220;ultimately it\u2019s what you do with the information that makes the difference.&#8221; Mark then demonstrated a\u00a0product from Hobsons that provide student \/ staff dashboards.<\/p>\n<h4>Personal tutor dashboards <a href=\"https:\/\/www.ucisa.ac.uk\/~\/media\/groups\/cisg\/events\/2016\/learner\/5%20University%20of%20Greenwich.ashx\">(ppt)<\/a><\/h4>\n<p>David Mutti, Head of Programme Management, University of Greenwich<br \/>\nDavid Mutti from the University of Greenwich showed their development of a personal tutoring system that pulls together various pieces of information about a tutee including a very basic application of learning analytics. Although feedback from academics was very positive, actual use was minimal. There was no compulsion to use the system. I thought the system was very well thought out with some good features, but the system was developed and promoted by the IT service. Would an increase in academic involvement lead to a greater take-up perhaps an academic lead?<\/p>\n<h4>Piloting learner analytics at the University of London International Programmes <a href=\"https:\/\/www.ucisa.ac.uk\/~\/media\/groups\/cisg\/events\/2016\/learner\/6%20ULCC.ashx\">(ppt)<\/a><\/h4>\n<p>Dave Kenworthy, Head of Software Services , University of London Computer Centre and Tom Inkelaar, Head of Management Information, University of London<br \/>\nTom described how the University of London International Programmes are using learning analytics with their students to try to improve retention. The University have 50,000 distance learning students across 100 countries.<br \/>\nThe University implemented Bloom Thrive analytics in partnership with ULCC and Altis. They used student record data along with VLE usage to determine at-risk students. As part of this data, they created a happiness block in their Moodle environments where students could say how happy they were as well as providing some free text comments.<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-1660\" src=\"http:\/\/graemeboxwell.co.uk\/wp-content\/uploads\/2016\/04\/happyLA.png\" alt=\"happyLA\" width=\"249\" height=\"333\" \/><br \/>\nThe University found it relatively easy to determine which students were at risk but the intervention is more difficult\u00a0when spread across such a wide geographical area. Another challenge they faced was regarding the data protection and whether the appropriate consent has been received for all students.<\/p>\n<p>The conference was a very useful event to attend, and it demonstrated that although we are not currently implementing any centralised learning analytics we are in a good place to do so as required. The data sets we have could provide a rich learning experience for students.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>On the 12th of April, I attended the UCISA event on learning analytics. This was a single day event held in Birmingham. Due to travel issues, we unfortunately missed the first speaker, Sarah Porter,\u00a0Co-Chair of the National Inquiry into data in HE, High Education Commission\u00a0&#8211; the author of the HEA report, &#8220;from bricks to clicks&#8221; &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/blogs.ncl.ac.uk\/ltdev\/2016\/04\/20\/ucisa-learning-analytics-conference\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;UCISA Learning Analytics Conference&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1446,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[305,265],"tags":[368,367],"class_list":["post-2351","post","type-post","status-publish","format-standard","hentry","category-events-awards","category-news","tag-learning-analytics","tag-ucisa"],"_links":{"self":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/2351","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/users\/1446"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/comments?post=2351"}],"version-history":[{"count":1,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/2351\/revisions"}],"predecessor-version":[{"id":2352,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/posts\/2351\/revisions\/2352"}],"wp:attachment":[{"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/media?parent=2351"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/categories?post=2351"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/ltdev\/wp-json\/wp\/v2\/tags?post=2351"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}