Supporting Placements

The Placements system has a focus on supporting assessment, reflection, and three-way communication and file-sharing during placements (students, external supervisors & NU tutors/staff). For 2023/4, the system was extended to support evidencing of individual competencies/outcomes, with a student dashboard and ability for ad-hoc assessors to provide assessment without the need to log-in.

Background

The Placements system was developed by FMS TEL as a sub-system of NU Reflect. It has been used by PGCE Programmes (ECLS) since 2017/18. The system absorbed established practice from the PGCE programmes, but was designed to be configurable for potential use by other programmes. It has been available to all programmes at the University from September 2019. It has been used by DClinPsy and other programmes.

Governance of NU Reflect (including Placements) is via a management team (academic lead, LTDS lead & FMS TEL lead), which reports to Digital Education Sub-Committee (DESC). A ‘baseline’ for the Placements system was developed following a period of consultation in 2022/23:

Baseline requirement  Description Purpose 
Custom forms Manage/create custom forms for a placement scheme The ability to develop context specific bespoke forms for student completion in line with programme requirements, supporting a range of functions e.g., assessment, reflection, placement evaluation etc. 
Rubric-based assessment Including scheme-specific skills/competencies and level identifiers The ability to assess student work against skills/competencies in line with programme context 
Three-way file sharing Between student, external supervisor & University tutor The ability to share forms with relevant users to support scheme requirements 
Competency sign-off Sign-off of skills/competencies/ outcomes, including by external supervisors. To support sign-off by external supervisors and other third parties. 
Reporting Data feeds or data download Required for reporting to funding/regulatory bodies. 
Admin access Tools to monitor placement cohort/assign to placement, location & supervisor etc. Set automated deadlines relative to placement dates. Scheme specific control to amend information as/when required, delegated to school/programme teams. 
Baseline requirements and features of the Placement system

PGCE students spend the bulk of their time on placements in schools around the region, with school-based supervisors who support and assess the students. A rubric-based assessment tool was developed and configured so that these supervisors can assess progress and provide feedback against national Teaching Standards (see Screenshot). They click on the desired Level Descriptors and can also add qualitative feedback.

Rubric-based Assessment in the Placements System

Additional forms (e.g. weekly progress) were set up; these were designed to be customisable as there were different requirements for Primary and Secondary PGCE programmes. A key design feature was to reduce the burden on admin teams, in particular by automating deadlines – in particular, forms are configurable with deadlines set relative to placement start and end dates, and set to who will complete these (supervisor, student, University tutor etc).

Students are automatically imported into the system, based on their programme or module registrations with the University. Programme administrators manage external accounts for placement supervisors, who do not have University logins.

Initially rubrics and forms were set-up by the development team; however, over time, the team in ECLS generally self-manage their use of the system in creating new forms and making old forms inactive. Form and rubrics data can be exported for reporting purposes and University tutors can view supervisors marks for the main Teaching Standards collated across the students (2 or 3) placements, before entering a final overall assessment. When there have been major changes to the professional frameworks, support was needed from the development team.

The DClinPsy programme (Psychology), where students spend the bulk of their time on placements, followed a similar model to the above PGCE programmes.

Developments for 2023/4

Pharmacy began using the Placements system in 2023/4. Requirements were significantly different to those of existing programmes using the system. These required extending the software, which was resourced by FMS. In particular, the focus is on evidencing individual competencies (rather than all competencies being assessed in the same rubric). Also, rather than a set-supervisor competing forms, there was a requirement for sign-off of competencies by ad-hoc supervisors, without the need to log-in. Established practice in MBBS was applied, with students entering the assessor’s Email address, which generates an Email with a secure link to the required assessment form. A ‘dashboard’ was developed for students and their tutors to see evidence by competency by year of the programme.

Student dashboard showing evidence by competency

The assessment tools and processes are indented to closely match those which students’ will need to use after graduating and using professional vocational ePortfolio. The new features of the software were designed to be configurable, to support the competency/skills frameworks of other programmes.

Further work will be undertaken, including developing a process for students to select a sub-set of items from their portfolio for each competency, for their end-point assessment.

OpenAI: Free Resources

The following list of free resources has been compiled by OpenAI and offers free training courses, lesson plans and student resources that can be shared with learners.

Online training and guidance on the use of AI in education

  • Wharton Interactive’s Faculty Director Ethan Mollick and Director of Pedagogy Lilach Mollick offer a free five-part online course for educators on how the latest large language models, including ChatGPT, can be used to enhance teaching and learning.
  • aiEDU hosts free webinars on the use of AI in education. Educators can sign up here for their upcoming webinars in the fall.
  • The International Society for Technology in Education (ISTE) offers a 15-hour, instructor-led online course to train educators on how to help their students learn about AI and a guide for school leaders that provides practical tips on how to promote the responsible and ethical use of AI in schools.
  • Microsoft offers a free online course for educators on how they can use AI to improve learning outcomes, reduce educator workload, and increase learner engagement.
  • Code.org, ETS, ISTE and Khan Academy offer a free online learning series for educators interested in learning about AI and how it can be leveraged to improve student outcomes.

Lesson plans and learning activities about AI

  • aiEDU provides a wide variety of free lesson plans and learning activities that any teacher, regardless of their level of AI expertise, can use to spark their students’ curiosity and engage them in lively discussions about AI capabilities, challenges and ethics.
  • MIT’s Day of AI offers free curriculum and activities that teachers can use to introduce K-12 students to AI and how it shapes their lives.
  • Stanford Graduate School of Education, Stanford Accelerator for Learning and Institute for Human-Centered AI offers CRAFT, a free online collection of research-based AI literacy resources developed with high school teachers that they can use to help students explore, question, and critique AI.

Education products built on top of OpenAI’s models

We’re also excited by the early promise of AI powered education tools that our partners are building on our platform. Here are just a few illustrative examples.

  • Khan Academy, a nonprofit that offers online lessons to students of all ages, uses GPT-4 to power Khanmigo, a tool that functions as both a virtual tutor for students and a classroom assistant for teachers.
  • Canva, an online design platform, uses OpenAI’s large language models to power Magic Write. It offers Magic Write for free to educators, who use the tool to create presentations, classroom activities and lesson plans.
  • Duolingo, a language online learning company, uses GPT-4 to power Roleplay, an AI conversation partner that practices real world conversation skills with learners, and Explain My Answer, which learners can use to gather deeper understanding on their mistakes.
  • edX, a global online learning platform, uses GPT4 and GPT3.5 to support digital tools that deliver real-time academic support and course discovery assistance to online learners.

Source: Are there any resources for educators to learn more about AI? | OpenAI Help Center

Copilot Notebook

Notebook is a new feature in the Web version of Microsoft Copilot, which Newcastle University staff and students currently have licenced access to via https://copilot.microsoft.com (make sure you sign in using your University credentials – you may also need to use “Switch to a work or school account” in the profile menu).

Screenshot of Copilot Notebook

The first thing to notice about Copilot Notebook is it’s extended character limit of up to 18,000 characters, which is much more than the standard Copilot chat, which has a character limit of 4,000. This is particularly useful when you need assistance with longer content, such as essays, papers, or articles that require proofreading or summarising.

The true power of Notebook lies in It’s facility for prompt iteration. In many A.I. Chat tools, tweaking a prompt usually generates brand-new results, often losing the context of the previous answer. However, in Notebook, your previous prompt remains intact after initial answers are generated. This means you can more easily tweak the original prompt and iteratively refine it, to optimise the answers that the A.I. generates.

Of course the disclaimer “Copilot uses AI. Check for mistakes” remains true of generative AI services in general. A.I. can generate many accurate answers, but occasionally have “A.I. Hallucination”, where convincing answers may include false or misleading information, presented as fact. Nevertheless, the time-saving benefits are potentially significant.

Using A.I. effectively involves you developing the skills and experience to write more precise prompts and to take the time to read results and quality assure them. The layout of the Web version of Copilot Notebook, with prompt on the left and results on the right (see screenshot), complement the development of these skills.

The current licence held by Newcastle University doesn’t include Copilot integration with your documents, Outlook Emails, Calendars etc. So don’t expect great results for questions which are University, Faculty or School specific (integrating contextualised University and Faculty-specific information is something we are exploring in our ERDP A.I. Chatbot project). However, Copilot Notebook can be very useful for generating general subject related answers, or refining your specific content.

In summary, Copilot Notebook gives you a new interface to refine your prompts to get more precise results. The more generous character limit is helpful, for example when drafting plans, generating ideas, or organising information.