Student views on feedback forms

Group of students

To find out more a student intern, working with staff in LTDS,  evaluated existing feedback forms and gathered opinions from students to identify what works and what could be improved. The project considered a total of 66 forms from 19 different schools and included focus groups and interviews with individual students.

What did they find?

These are a few key findings and you can find full details in the project report.

Form Design

Have clear, separate sections showing:

  • Strengths and areas for improvement
  • Clear advice for future work

Only use tick boxes for objective areas of the marking criteria, such as grammar. When tick boxes were used for subjective areas, such as argument, students found this unhelpful.

Look at your feedback forms and consider whether these should be redesigned. Consult with the students in your school as part of the process.

Utilising the form

Type feedback, wherever possible.

Introduce structured opportunities to help students understand:

  • expectations of the marking criteria
  • the ways in which this is reflected in the feedback sheet

Discuss how you use marking sheets with your colleagues. Try to develop a consistent approach to:

  • the volume of feedback
  • the use of notes in margins

For more information get in touch with LTDS@ncl.ac.uk

Module Evaluation Results

How and when are results of Module Evaluations received by Academic Staff?

Each module should be evaluated every time it is delivered using the University’s module evaluation system, EvaSys. The results are usually sent to Academic staff via email in the form of PDF attachments, and this is done in one of two ways;

  1.  The survey is set up by local Professional Services staff to automatically send the PDF results upon closure of the survey. This option can be selected during the creation of the survey.
  2.  Local Professional Services staff manually send the results in PDF format from within the EvaSys system at an agreed time. This option can be used if the automatic dispatch is not selected during survey setup.

In both instances the timing of the surveys and the receipt of results should be agreed within the academic unit, paying particular attention to survey close times to allow for discussion of results with senior colleagues if required.

More information regarding Module and Stage Evaluations is available on our webpages

The Policy on Surveying and Responding to Student Opinion details who is entitled to see results of Module Evaluations.

Transforming Assessment Webinars

Dr Mathew Hillier, Monash Education Academy, Monash University, Australia and Professor Geoffrey Crisp, PVC-Education, University of New South Wales, Australia will be hosting a series of webinars over the coming months focusing on transforming assessment with  topics such as digital literacy, written and audio feedback and blended simulation-based learning. Take a look at the further details below. Continue reading “Transforming Assessment Webinars”

Case Study: Class generated content: Student Perspective

Picture of Sarah Atkinson

By Sarah Atkinson former Speech and Language Sciences student and current MSc student in the School of Education, Communication and Language Sciences

“Professional Issues… Sounds fascinating.” Thus my (admittedly extremely sarcastic) thought  upon hearing a module of this name would comprise the greater part of my workload during semester one of my final year becoming a speech and language therapist.

Despite hearing great things about it from my forebears in the year above, the prospect of this module did not fill me with delight. I certainly could not have guessed it would turn out to be one of the most enjoyable modules I have had the happy chance to participate in. Continue reading “Case Study: Class generated content: Student Perspective”

Downtime on Hadrian’s Wall @VindolandaTrust

As we move into the weekend and we start to think about how we are going to spend our downtime, and pursue leisure activities, we’d like to share a video with you which gives a lovely insight into leisure time on Hadrian’s Wall.

Meet Dr Andrew Birley, one of our guest contributors to Hadrian’s Wall: Life on the Roman Frontier. We asked Andrew to talk about his one of his favourite objects at Vindolanda where he is Director of Excavations.

Hadrian’s Wall: Life on the Roman Frontier is a Newcastle University free online course lasting 6 weeks which starts on Monday 19 February (www.futurelearn.com/courses/hadrians-wall)

We can’t wait for Monday! Can you?

Turnitin UK Academic Integrity Summit 2017

I recently attended the Turnitin UK Academic Integrity Summit 2017 held in Newcastle Upon Tyne.  This was a very timely conference following the release of the QAA report into contract cheating.  I was concerned that this would be a day-long sales pitch from Turnitin but was pleasantly surprised to find the opposite. There were many presentations from institutions around the world, but very little ‘grandstanding’ from Turnitin.

Stephen Gow, Academic Integrity Coordinator, University of York

The first session I attended was a look at the approach from the University of York towards academic integrity. They discussed the importance of the language used at the University, moving away from terms such as “plagiarism” towards “academic integrity”. All their students have a mandatory academic integrity online tutorial they must complete in Semester 1 of Stage 1. They are working closely with the student union on their “integrity week” and are also working more closely with staff, including on their Postgraduate Certificate in Academic Practice (PGCAP).

Turnitin Data Workflows

The second session was a discussion session with the Turnitin staff exploring the types of data and statistics institutions would like to get out of Turnitin. This included reports on feedback return time, statistics around number of students receiving extensions, archiving, learning analytics, and reporting on the various functions used. We hope Turnitin will use this in the further developments of the software.

Bill Loller, Turnitin

The third session was facilitated by Bill Loller, Chief Product Officer at Jobvite, who is working on a technical solution to expose contract cheating for Turnitin. They are using expertise from the field of forensic linguistics to develop a product. Forensic linguistics may be used in a court case to determine whether a person did, or did not, write a document. They are currently testing their modelling and developing a report that will provide a confidence score.

Bill continued this theme into a larger session with the group, showing some of the contract cheating/essay mills websites prevalent online. He admitted that Turnitin may have helped with this problem – “crack down on plagiarism and students will look elsewhere”. These websites offer 10,000 words for approximately £300.

Simon Bullock, QAA

Simon Bullock from the QAA was next to discuss his recent publication “Contracting to Cheat in Higher Education – How to Address Contract Cheating, the Use of Third-Party Services and Essay Mills.”  He discussed the risks to the public if students were obtaining their degrees through cheating but that despite attempts it is not yet illegal to offer essay mill services online. The QAA is exploring as many non-legislative methods as possible.

Irene Glendinning, Coventry University

Irene Glendinning of Coventry University presented her research work analysing the impact of policies for plagiarism in Higher Education across Europe. She highlighted the UK and Ireland as being some way ahead of many other countries in Europe. They have developed an academic integrity maturity model, a tool to compare the results of the impact analysis across 27 EU member states.

Cath Ellis, New South Wales

The presentation that had the most impact on me was from Cath Ellis from the University of New South Wales. Cath reported that there was too much anecdotal information forming decisions, and not enough hard data.

To find out how many students are using contract cheating services, Cath asked them anonymously. Out of the 14,096 students surveyed around 6% (n=814) admitted to cheating in some form during their programme. The vast majority of this cheating comes in the form of assistance from other or former students. It is not commercially driven. The cheating group’s attitudes show they are less likely to think it’s wrong, although there was no discernible difference between English and non-English speaking students. Non-English speaking students are as likely to think cheating is wrong as English speaking students. Other findings of the study showed that when there are perceptions that there are a lot of opportunities to cheat, cheating goes up. And when there is dissatisfaction with the teaching environment, cheating goes up.

Cath discussed the need for students to have “ethical fitness” – we should not try to remove every opportunity to cheat as students need to be ethical.

She then discussed the various types of contract cheating and review some of the typical websites.

Assessment design is widely advocated as a possible solution to contract cheating, but Cath argued that this is a myth. We should not change our assessment design because of a small percentage of cheaters. Reduced assessment time (shorter deadlines) will actually drive students towards essay mills.

Cath noted that we are not having the correct conversations with students and advised us to discuss contract cheating with them. Part of the study looked at the perceptions of how prevalent contract cheating is, compared to how damaging it is. The study showed that students in the cheating group thought that a lot of students were doing it and it was not that serious. Staff members thought it was not very common but it was very serious. Students in the non-cheating group followed the same path as the students in the cheating group. They also thought that lots of students were doing it while it was not very serious.

Professor Phil Newton – Swansea University

The last presentation was given by Professor Phil Newton from Swansea University. He presented various research projects that explored academic integrity.

I found the event extremely useful and I have reflected since on the way Newcastle University approaches academic integrity. The presentation from Cath Ellis convinced me that we should not be changing any approaches to assessment to attempt to counter the small number of cheating students, but we should be minimising their opportunities to cheat. We also need to be having more conversations with staff and students about the promotion of academic integrity, and the impact contract cheating could have on their career.


Assessment & Feedback Event – 1st Nov – all welcome

Assessment and feedback continue to be a source of student dissatisfaction across the sector. In particular student surveys highlight concerns about the alignment of feedback to marking criteria and inconsistencies in both the application of criteria and quality of feedback received.

The HaSS Faculty will be holding a workshop, to discuss these issues in the context of student transitions, on:

Wednesday 1st November 2017
1300-1600 (lunch will be provided)
Lindisfarne Room, Hadrian Building

Though hosted by HaSS, anyone interested in this event from any faculty is welcome to attend – please feel free to disseminate details of this event to your colleagues.

The session will explore the following questions:

  • How can we better understand assessment and feedback in the context of student transitions?
  • What are the assumptions inherent in our assessment criteria and feedback?
  • Can electronic assessment and feedback tools enhance students’ academic literacy?
  • Can we develop a ‘student as partners’ approach in assessment and feedback?

It will be particularly relevant for Degree Programme Directors and Module Leaders, whose input will help identify some key priorities for further action.

It will include presentations from Rowan South (Education Officer, Newcastle Union Students Union), Graeme Redshaw-Boxwell (Learning and Teaching Development Service) and Sarah Graham (Combined Honours).

To attend, please complete the booking form.

If you have any queries in the run up to the event, please contact susan.mclean@ncl.ac.uk.

Essay Mills and Contract Cheating

Wednesday 18th October 2017 marks the second International Day of Action against Contract Cheating, promoted by the International Center for Academic Integrity (ICAI).

Contract cheating occurs when one person completes academic work, such as an essay, assignment, test or exam, for another who then submits it for academic credit. This behaviour undermines academic standards and devalues the qualifications of those who do not cheat.

In 2016, in response to serious concerns among higher education providers and from government, the Quality Assurance Agency (QAA) published a report on the growing threat of third parties helping students to cheat, known as custom essay writing services, or ‘essay mills’. Following this, QAA has now this month published guidance for students and universities on tackling this problem and promoting academic integrity in higher education. It sets out the steps that universities can take to deal with forms of contract cheating, and recommends:

  • clear information for students on the risks of cheating, including academic misconduct being reported to relevant professional bodies
  • support for students to develop independent study skills, including academic writing
  • using a range of assessment methods to limit opportunities for cheating
  • blocking essay mill sites and taking action against essay mill advertising on campus
  • smarter detection, including new software and greater familiarity with students’ personal styles and capabilities
  • appropriate support for whistle blowing – to protect accuser as well as accused
  • student involvement on academic misconduct policies and panels.

Newcastle University is committed to defending academic integrity and freedom, and will be considering how best to take account of this guidance within its own policies and procedures.

The International Center for Academic Integrity has published an institutional toolkit against contract cheating that can be downloaded here.

PRES & PTES: Record Response Rates, High Satisfaction

Record Response Rates

Both the Postgraduate Research Experience Survey and the Postgraduate Taught Experience Survey closed with the highest response rates that Newcastle University has ever achieved at 65% and 57% respectively.

This is a fantastic achievement which would not be possible without the continued support and promotion of the surveys from colleagues across the university, thank you!

High Satisfaction

In terms of Newcastle’s overall satisfaction rate for the PRES, 85% of students agreed with the statement ‘Overall, I am satisfied with the experience of my research degree programme’. This represents an increase of 2% on 2015, and is 3% higher than the Russell Group average.

Also in the PRES, over 90% of students agreed that their supervisor has the skills and subject knowledge to support their research and that they have regular contact with their supervisor that is appropriate to their needs. This represents an increase of 2% on 2016

In the PTES Early results show that satisfaction has remained high with over 90% of students agreeing that staff are good at explaining things and are enthusiastic about their teaching.

 

For further information regarding student surveys please visit our webpage.

 

Postgraduate Taught Experience Survey: Open Now

The Postgraduate Taught Experience Survey (PTES) will remain open until Friday 16th June. hea_surveys_logos_ptes-colour

The PTES asks postgraduate taught students in universities across the United Kingdom about their course and their learning experiences.

What is it?

The survey asks eligible postgraduate taught students about the whole student learning experience including;

  • motivations for taking the programme
  • information they were given to help choose their programme
  • their experience of teaching and learning
  • the organisation of the programme
  • assessment and dissertation (or major project)
  • career development

Why is it important?

The survey presents an opportunity for students to shape the student experience: the feedback we receive is valuable in helping to enhance the postgraduate taught experience at Newcastle.

Incentives

All the respondents are entered into a prize draw (see terms and conditions). In 2017, the prizes include:

  • 1st Place prize: 9.7-inch iPad Pro (one available to win)
  • 2nd Place prizes: iPad mini 4 (two available to win)
  • 3rd Place prizes: £20 Amazon gift card (20 available to win)

Further details and support can be found on the LTDS webages. If you have any specific questions please contact LTDS@ncl.ac.uk