Tag: virtual

GigXR

FMS TEL recently attended a presentation on a mixed reality platform called GigXR, a clinical simulation platform with a number of apps, including HoloScenarios and HoloHuman.

The target audience is mainly medical education courses at the moment.

This technology aims to:

  • create a consistency of experience for all students
  • provide repetitive training in a safe-fail environment
  • reach rural learners
  • reduce instructor time

How it works

A headset is connected wirelessly to a computer which generates a hologram of a patient into the room through the headset. There is equipment nearby, such as oxygen masks and blood pressure cuffs. You can interact with items and use them on the patient.

You are able to insert your own 3D digital objects into the software. For example, if you have created a 3D image of a heart from CT scans. GigXR can create a holographic version which you can view through the headset.

Conversational AI is being integrated, so you can talk to the patient and ask questions. Currently this is in text format using ChatGPT, but developments are being made and hopefully soon you will be able to actually speak to the patient.

For more information, see the Gig XR website

Augmented reality in physics laboratories – NULTConf

NULTConference – Augmented reality in physics laboratories how might this help in FMS?

An extremely interesting talk from Dr Aleksey Kozikov on using AR to allow students to operate equipment in a lab remotely.

We introduce augmented reality (AR) in online physics laboratories and demonstrate their operation. It allows students to see the real and virtual world overlaid with each other. Webcams stream videos of real hands-on experiments live into students’ computers. Virtual objects (buttons, switches, cables, etc.) overlay with the real scenes. As users handle virtual tools, they perform required tasks of experiments. We will also discuss advantages of having AR labs.

The full talk can be viewed here

Equipment was set out with a webcam in front of it. . The webcam was linked to a micro controller which allowed students to control it remotely. Students logged into an onscreen control panel. Virtual buttons were placed over the top of real buttons on the machines to allow students to have the effect of pressing them. The camera worked by using markers which were placed on the machines to help the camera with tracking and keep the virtual buttons in place.

There were also 360⁰ virtual tours of labs. Students could enter and walk around the labs, click on icons to learn more about equipment and click a weblink to a browser to do the experiment. There was no need for software, just a browser. Only necessary functionality was available. No need to log into university computers, and students could work remotely in groups.

Red circles were used as markers for the camera. Next steps were to use Fiducial markers (small QR codes) which can provide much more information. They are also looking for students to be able to use handheld controllers with VR glasses in future development. These would also be used in person in the labs and they would be able to comment to someone through the glasses on Zoom.

This concept may be transferable to some experiments done in FMS labs.

Art of the Possible – The Future of Education Spaces

Today, Tracy and Eleanor gave a lightning talk as part of the Art of the Possible series. We shared our recent work with 3D and virtualising spaces, as well as using technology for interactive teaching when students can’t all be Present in Person.

Resources and links from the session are available below. Some may only be accessible to Newcastle University staff.

Further Reading

Hardware Shown

360 Degree Images Examples