दिव्यनेत्र
DIVYANETRA

Two eyes to see. One mind to understand.

A gesture-controlled, fully local AI companion that watches, recognizes, and protects — no cloud, no subscription, nothing leaves the room.

Quick Access

Explore DivyaNetra

No endless scrolling. Tap any tile and jump directly to that part of the system.

01Three EyesUnderstand the core concept→ 02CapabilitiesSee what the AI does→ 03How It WorksFollow the system architecture→ 04HardwareSee the actual equipment→ 05RoadmapDone, current and next→ 06Our TeamMeet the people building it→
The Name

Why three eyes

In tradition, Shiva's third eye sees beyond ordinary sight — insight, not just vision. DivyaNetra is built around that same idea: two physical eyes that see, and a third that understands.

१

The Gesture Eye

Camera A. Watches your hands, not a mouse — hover-and-hold gestures control every part of the HUD.

LIVE
Tap for details →
२

The Guardian Eye

Camera B. Watches the room — faces, objects, falls — shown live inside the main dashboard.

LIVE
Tap for details →
३

The Inner Eye

A local LLM that turns what the two eyes see into understanding — and decides what to do about it.

IN PROGRESS
Tap for details →
What It Already Does

Working today, on real hardware

Everything below is running now on a Jetson Orin Nano — not a mockup, not a concept render.

Gesture Control

Hover-and-hold to toggle any feature. No mouse, anywhere in the app.

Tap for details →

Eye-Closure Monitoring

Detects sustained closed eyes and auto-engages a monitoring mode.

Tap for details →

Face Enrollment

Pose-guided capture — look left, right, up, down. Voice or keyboard, no manual steps.

Tap for details →

Face Recognition

Local database, cosine-similarity matching — known vs. unknown, instantly.

Tap for details →

Object Detection

YOLOv8, 80 object classes, running live on the guardian camera.

Tap for details →

Fall Detection

Flags a fast upright-to-horizontal posture change and holds the alert.

Tap for details →

Offline Voice Input

Local speech-to-text for enrollment — zero cloud dependency.

Tap for details →

System Vigilance

Live CPU load and temperature, watched on-device in real time.

Tap for details →

Fully Edge-Deployed

Migrated end-to-end from an x86 laptop to Jetson Orin Nano.

Tap for details →
How It's Built

Two cameras, split by purpose

Each eye runs on its own thread, so a heavy detection model on one never slows down gesture response on the other.

CAMERA A — GESTURE

Hand tracking, eye monitoring, HUD control

THE HUD

Shared display, picture-in-picture monitoring panel

CAMERA B — GUARDIAN

Face recognition, objects, fall detection

The Equipment

What it runs on

A real hardware manifest — what's already in hand, and what's needed to finish the vision.

NVIDIA Jetson Orin Nano
Edge AI compute — the core of the system
IN HAND
2× USB Webcams
Dedicated gesture and guardian cameras
IN HAND
ESP32 Microcontroller
Physical actuation layer — relays, sensors
NEEDED
Flame / Smoke / Temperature Sensors
Fire detection, fused with camera vision
NEEDED
Relay Modules, Water Pump, Exhaust Fan
Turning detection into physical response
NEEDED
Compact Projector
The HUD, projected into the room itself
NEEDED
The Roadmap

What's lit, what's next

A real build order — completed steps stay lit, upcoming ones are next in line.

Gesture-Controlled HUD
Hover-and-hold interaction, fully mouse-free.
Face & Object Systems
Enrollment, recognition, and 80-class object detection.
Fall Detection & Edge Migration
Heuristic fall detection, fully running on Jetson Orin Nano.
The Inner Eye — Local LLM
Natural-language command and decision-making, entirely on-device.
Voice Output & Wake Word
Spoken responses, hands-free activation.
Fire Sensing & Physical Actuation
ESP32 layer — sensors, relays, pump, fan.
Remote Alerts & Projector Display
Telegram notifications, and the HUD projected into the room.
The Team

Who built this

Five people, five distinct pieces of the system, one build.

MS

M Shubham Acharya

Leader

Overall project management, end-to-end fine-tuning, and ownership of the major system components.

AS

Adishree Senapati

Co-Leader — Research

Research and analysis — landscape review, competitive study, and the foundation behind the project's direction.

GB

Gopal Chandra Barik

Dataset & Training

Dataset handling and training — sourcing, preparing, and training the data behind the detection models.

DP

Dhiren Kumar Panigrahi

Fine-Tuning

Fine-tuning the end-to-end system — tuning accuracy and performance across the full pipeline.

AM

Ayush Mahapatra

Hardware

Hardware configuration and handling — the physical sensing and actuation layer running on real devices.

Ask DivyaNetra
Answers about this project only