Assistive Vision AI
About the Project
BatVision is a modular, high-performance spatial awareness and navigation system designed to assist users in understanding their physical environment through real-time Artificial Intelligence. By fusing monocular depth estimation, lag-free open-world object detection, and dynamic 3D spatial audio, BatVision translates visual surroundings into intuitive acoustic and vocal feedback.
Unlike traditional detection models restricted to a fixed list of classes, BatVision utilizes YOLO-World, a cutting-edge, real-time open-vocabulary architecture. This allows the system to identify computationally unbounded categories of objects based purely on text prompts (e.g., "staircase", "door", "pothole", "obstacle") at ultra-low latency, ensuring safe and immediate navigation feedback.
Using the highly optimized MiDaS Small architecture, BatVision generates a dense 3D topological map from a standard 2D webcam feed. It continuously calculates the relative proximity of every pixel in the field of view without requiring specialized LiDAR or dual-stereo cameras.
Visual depth data is seamlessly translated into a dynamic soundscape through Stereo Panning (frequencies dynamically pan across left/right ear based on horizontal position) and Proximity Pitch Shift (as objects move closer, the pitch and intensity of the audio tone increase, mimicking natural echolocation). The vision engine specifically isolates and monitors the ground-level path to prioritize the detection of low-profile tripping hazards.