AR Medical on ENGAGE Platform

I decided to take a stroll through my garden with models created by Tripoint Lab which were used in remote Stanford Clinical Anatomy classes on the ENGAGE platform. www.engagevr.io
In this video you are viewing the excellent AR passthrough cameras from the Meta Quest 3 and our Athena AI which is powered by OpenAI. The AI model used here is the older 3.5 model, however, we are updating to the latest ChatGPT 4o either later this week or early next week.
What I am really demoing here are some of our Multimodal AI features where we connect multiple different features of our platform via AI. Towards the end of the video you will hear me ask Athena to tell me what I am looking at. She will then take a picture of my view and analyse it and give me a response.
This is the very early days of this technology but it’s developing extremely quickly. Metas AI Raybans can do this today using the cameras they have onboard and I can see this type of feature saving lives in the future. Imagine coming across an accident and seeing an injury and not knowing how to treat it or a strange rash you need diagnosed quickly. You can ask AI for help to understand the problem and how to treat it while you seek professional help.
ENGAGE is being used a lot in medical and corporate training and this is just a small sample of what the platform can do. If you have any immersive training needs or just want to know more about virtual or augmented reality why not reach out to us at www.engagevr.io