You are browsing as a guest. Sign up (or log in) to start making projects!

Gesture Link

Hardware
  • 4 Devlogs
  • 30 Total hours

Gesture Link is a wearable assistive technology system that helps visually impaired, hearing impaired, and speech impaired individuals communicate more effectively. It combines AI-powered smart glasses, a gesture-to-speech glove, and a speech-to-Braille glove to create a real-time, offline communication platform using computer vision, speech processing, and haptic feedback.

Open comments for this post

5h 32m 3s logged

Devlog: Glove B Completed

After weeks of development, testing, and debugging, I have finally completed Glove B of Gesture Link.

In the video, Glove B is working successfully and responding exactly as intended. You may notice a buzzing sound in the recording. That sound comes from the vibration motors activating to transmit Braille characters.

For this demonstration, the speech input “Hello, how are you?” was converted into Braille and sent directly to the glove. Each finger contains three vibration motors. Two fingers work together to form one Braille cell, while the other two fingers form a second Braille cell. By activating specific vibration patterns, the glove communicates Braille characters through touch, allowing information to be read without visual or audio output.

This marks a major milestone for the project, as the complete speech-to-Braille pipeline is now functioning on Glove B. The system can capture speech, process the text, convert it into Braille patterns, and deliver the output through haptic feedback in real time.

Devlog: Glove B Completed

After weeks of development, testing, and debugging, I have finally completed Glove B of Gesture Link.

In the video, Glove B is working successfully and responding exactly as intended. You may notice a buzzing sound in the recording. That sound comes from the vibration motors activating to transmit Braille characters.

For this demonstration, the speech input “Hello, how are you?” was converted into Braille and sent directly to the glove. Each finger contains three vibration motors. Two fingers work together to form one Braille cell, while the other two fingers form a second Braille cell. By activating specific vibration patterns, the glove communicates Braille characters through touch, allowing information to be read without visual or audio output.

This marks a major milestone for the project, as the complete speech-to-Braille pipeline is now functioning on Glove B. The system can capture speech, process the text, convert it into Braille patterns, and deliver the output through haptic feedback in real time.

Replying to @Mokxsh_

0
2
Open comments for this post

9h 44m 22s logged

pulled an all nighter :D
worked on the VISORA code, it had some bugs took me a while to fix them. Also added a really nice UI to it.

pulled an all nighter :D
worked on the VISORA code, it had some bugs took me a while to fix them. Also added a really nice UI to it.

Replying to @Mokxsh_

0
12
Ship #1

What did you make?
> I built Gesture Link, a wearable assistive communication system designed to help visually impaired, hearing impaired, and speech impaired individuals communicate more easily. The project consists of three devices: Visora, a pair of AI-powered smart glasses that can identify objects and colors; Glove A, which converts hand gestures into spoken phrases; and Glove B, which converts speech into tactile Braille using vibration motors. Together, they create a real-time communication bridge that works completely offline.

What was the challenge?
> The main problem I wanted to solve was that many people with disabilities face communication barriers every day, and most existing solutions are either expensive, require internet access, or only address a single disability. I wanted to create a system that could help different groups communicate with each other directly.

From a technical side, the biggest challenge was getting multiple hardware devices, sensors, computer vision models, speech processing systems, and haptic feedback mechanisms to work together reliably. Since everything runs locally, I also had to optimize the software to work efficiently on resource-constrained hardware.

What are you proud of?
>I'm proud that I was able to take a real-world problem affecting billions of people and turn it into a complete working ecosystem rather than just a concept or a single prototype. Gesture Link combines computer vision, speech technology, wearable electronics, health monitoring, and haptic feedback into one integrated system designed to make communication more accessible. Over the past two months, I worked through numerous hardware and software challenges, from sensor integration and device communication to real-time processing, to bring all three modules together into a functional solution that can genuinely improve people's daily lives.

What should people know when testing your project?
>Gesture Link is primarily a hardware project, so it can't be fully tested directly from the repository. To make it as reproducible as possible, I've included the source code, documentation, component lists, and circuit diagrams for all the modules so anyone interested can build and test it themselves.

I'm also currently working on custom PCBs for the project and plan to open-source them soon, which will make the system much easier for others to build, modify, and improve.

  • 4 devlogs
  • 30h
Video of Project → See source code →
Open comments for this post

20m logged

I am currently developing a colour recognition system using an ESP32-S3 Sense camera and Python. At this stage, the ESP32-S3 Sense is being used primarily to capture and stream camera data, while all image processing and colour recognition tasks are performed locally on my computer using Python. The system is designed to detect and classify colours in real time.

I am currently developing a colour recognition system using an ESP32-S3 Sense camera and Python. At this stage, the ESP32-S3 Sense is being used primarily to capture and stream camera data, while all image processing and colour recognition tasks are performed locally on my computer using Python. The system is designed to detect and classify colours in real time.

Replying to @Mokxsh_

0
44

Followers

Loading…