SYSTEM AND METHOD FOR EYE TRACKING

Synopsis

Patent US 11,138,741 B2 describes a system and method for eye tracking. The invention focuses on providing robust and accurate eye-tracking capabilities, even under challenging conditions such as varying illumination, head movements, and partial occlusions. This is achieved by utilizing multiple illumination sources and a sophisticated image processing pipeline.
A key novel aspect of this patent is its multi-spectral and multi-directional illumination strategy, coupled with advanced image analysis. The system uses a minimum of three active illumination sources (e.g., infrared LEDs) positioned at different locations relative to the camera. This multi-source illumination helps to generate distinct "glints" (reflections of the light sources) on the eye's surfaces (cornea and pupil) regardless of the eye's orientation or partial occlusions. The patent details methods for processing the captured images to accurately locate the pupil and corneal glints, even when some glints are missing or obscured. It employs techniques like pupil detection using a threshold operation and glint detection by finding bright spots in the image. The precise geometric relationship between these glints and the pupil center allows for highly accurate gaze estimation. The system is designed to be tolerant to significant head movements and varying distances from the camera, making it suitable for real-world, unconstrained environments.
The commercial potential of this invention is substantial across numerous industries where accurate and reliable eye tracking can enhance user experience, provide valuable data, or improve safety. The ability to perform robust eye tracking under challenging conditions broadens its applicability significantly.

Possible applications include:
Human-Computer Interaction (HCI): Enabling new forms of interaction in augmented reality (AR) and virtual reality (VR) headsets, where gaze tracking can serve as an intuitive input method for navigation, selection, and foveated rendering (optimizing display quality where the user is looking).
Automotive Safety: Integrating into vehicles to monitor driver attention and detect drowsiness or distraction, providing alerts to prevent accidents. This is crucial for advanced driver-assistance systems (ADAS) and autonomous vehicles.
Marketing and Market Research: Analyzing consumer gaze patterns on websites, advertisements, and product displays to gain insights into user engagement and optimize design for maximum impact.
Gaming: Enhancing immersion and control in video games by allowing players to interact with the game environment using their gaze, providing a more natural and responsive experience.
Accessibility: Providing alternative input methods for individuals with disabilities, allowing them to control computers, communication devices, or environmental controls using only their eyes.
Medical Diagnostics and Research: Assisting in the diagnosis of neurological conditions, cognitive disorders, and ophthalmological issues by analyzing eye movements. It can also be used in psychological research to study attention, perception, and decision-making.
Training and Simulation: Creating more realistic and effective training environments (e.g., flight simulators, surgical training) by tracking trainee gaze to assess attention, identify areas of focus, and provide targeted feedback.

This patent offers a robust and adaptable eye-tracking solution, providing a foundation for innovation in user interfaces, safety systems, and data analytics across a wide array of commercial and research applications.