SYSTEMS AND METHODS FOR IMAGE NAVIGATION USING ON-DEMAND DEEP LEARNING BASED SEGMENTATION

Abstract: a computing system and method are provided for image navigation using on-demand deep learning based segmentation. an example system may comprise an exoscope configured to capture image data from a field of view; an image segmentation module; an intent recognition module to capture a user's intent; and one or more robotic arms configured to move the exoscope. the system may receive, via the exoscope, image data relating to an image or a video stream of a surgical site; generate, via the image segmentation module, an augmented image comprising a plurality of labeled regions overlaying the surgical site; receive, via the intent recognition module, a voice command selecting a labeled region of the plurality of labeled regions; and cause, via the one or more robotic arms, a movement of the exoscope so that the selected labeled region is within the field of view of the exoscope after the movement.

Inventor(s): Mannat Rana, Kyle Kam, Murat Karaorman

CPC Classification: G06T7/11 (Region-based segmentation)

Search for rejections for patent application number 20250173873