I observed an AR-assisted surgery with Dr. Robert Masson and eXeX at the Masson Spine Institute. Here’s what I learned.
- The problem this team sought to solve was in organization of tools and communication, all to ultimately benefit the surgeon’s flow-state. We observed the surgeon and scrub in sync, vibing to music together.
- The system incorporates AR head-mounted hardware, but consists of much more, including a web browser solution to manage data, and a mobile app that others in the OR or behind the desk can access to receive realtime updates on the surgery’s progress.
- This system saves over 10 minutes per hour of surgery time. That ROI means saved time, money, and benefits the health of the patient (less time under anesthesia).
- This system is unique in how the hands-free, AR, HUD experience is on the scrub technician and the staff carries tablets, receiving realtime updates from the scrub technician without having to say a word. The surgeon is free to focus on the case at hand. The improved efficiency prevents errors.
- The team described how even a veteran scrub technician, when paired with a new surgeon, will often make “mistakes” according to the preferences of the new surgeon, compromising time, money, safety, and efficiency. With this system, the preferences of the setup of the operating theatre, tray organization and tool preparation, and any other important details, are set along with visual aides and digital media that can be viewed in the tablet or headset during surgery.
- We observed the scrub technician using the HoloLens, and for the next surgery, used Apple Vision Pro. We were told the experience was built in Unity.
This experience was inspiring and encouraging to me, as a technical artist in Experience Engineering with a passion for medical innovation.
Thank you to Robert Masson MD, FACS FAANS for your hospitality and expertise. Thank you also to Kyle M. and Brett Masson, MBA for keeping us informed and taken care of. Feel free to correct any misinformation or add on in the comments.
Special thank you to Ariane Fikki for hearing my heart and how I want to honor the memory of my mother with my career and for making this possible (and for the photos!), Gary Haus for being a likeminded technical artist, to my new friend Gilberto Vallejo for his enthusiasm and shared joy, and of course the VR/AR Association - Central Florida Chapter.
#exex #medicalinnovation #ar #madewithunity #surgery
