
Voice Commands to Robotic Fingers
A student inventor explains how a voice command system turns spoken words into safe robotic hand movements using speech recognition, an AI action menu, a microcontroller, and servo motors. The episode also covers a signal delay bug, science fair safety rules, and how synthetic audio helps test the prototype.
Chapter 1
The Four Stage Relay Race from Voice to Fingers
Santi Voice Clone
Okay, so, um, picture this. You want a robot hand to pick up this paper cup on my desk, right? But instead of flexing your arm muscles, you just say it out loud.
Maria Voice Clone
Wait, so you just speak to it? Because I thought real bionic arms, like, like the Open Bionics Hero Arm, didn't they rely on muscle sensors?
Santi Voice Clone
Yeah! Exactly! Real prostheses like the Hero Arm use electromyography, or EMG sensors. They, uh, they stick to your residual limb and detect tiny electrical signals, like micro-volts from your muscles tensing, and then turn that into movement.
Maria Voice Clone
Micro-volts, wow. But for your invention fair tabletop model, you are replacing those muscle signals with spoken words.
Santi Voice Clone
Right! It is like a relay race with four runners passing a baton. If one runner drops it, the fingers do nothing.
Maria Voice Clone
A relay race, okay walk me through runner number one.
Santi Voice Clone
Runner one is voice input! Sound waves enter speech recognition software on the computer and turn into text. Then runner two, the AI agent, looks at the text and picks a command, like GRASP.
Maria Voice Clone
Got it. So text to command. Who gets the baton next?
Santi Voice Clone
Runner three is the microcontroller, like an Arduino board! The computer sends that command over a serial connection to the Arduino. And runner four, the Arduino tells the servo motors in my uHand UNO kit to rotate!
Maria Voice Clone
And those motors pull strings or tendons that curl the plastic fingers around the paper cup.
Santi Voice Clone
Yes! But, er, watch what happens when runner three stumbles.
Maria Voice Clone
Wait, what is it doing right now? It is just, uh, hovering right over the cup!
Santi Voice Clone
See? That was a signal lag between the computer and the controller! The computer sent GRASP, but the serial message got delayed, so the servos never turned, and the hand was just frozen in mid-air!
Maria Voice Clone
It looks like it is contemplating the cup instead of grabbing it!
Santi Voice Clone
I know! That is why testing every handoff in the relay is so important.
Chapter 2
Giving the AI Agent a Safe Action Menu
Maria Voice Clone
So if the computer is translating what you say, why not just let an advanced AI model figure out how to move the fingers directly?
Santi Voice Clone
Oh, no, no, no, that would be dangerous! In AI research, like the work from Anthropic, an agent is defined as a system where a model chooses steps or tools to reach a goal. But you do not want an AI inventing raw finger movements on the fly.
Maria Voice Clone
Right, because if it invents a move, it might crush the cup or snap a mechanical tendon.
Santi Voice Clone
Exactly! So my AI agent works like a dispatcher. It can only pick from a strict, approved action menu that I coded into the microcontroller.
Maria Voice Clone
So what is on this dispatcher menu?
Santi Voice Clone
Just four safe choices: OPEN, GRASP, RELEASE, and ASK. If a person says hold the cup, or grab this, or do not drop it, the agent translates all those different human phrases into GRASP.
Maria Voice Clone
Ah, clever! What if someone says something confusing, like, do the thing?
Santi Voice Clone
Then it triggers ASK, and asks which action you mean! And if there is background noise, it chooses to do nothing at all and stays completely still.
Maria Voice Clone
That makes total sense for safety. Now, how are you testing all these spoken commands for the science fair? Are you getting your friends to talk to it?
Santi Voice Clone
I, I wanted to! But the school packet has a strict rule: no testing on human subjects without prior approval! So I had to pivot.
Maria Voice Clone
Oh, right! Science fair rules can be tricky. So how do you test speech recognition without human test subjects?
Santi Voice Clone
I am using computer generated text to speech audio files! I play pre-recorded synthetic voices into the microphone to run standardized tests.
Maria Voice Clone
That is so smart, Santi! It keeps the test consistent every single time.
Santi Voice Clone
Yeah! I log every trial in my inventor notebook. If an action fails, I document why, fix the code, and try again. Science fair judges love seeing how you learn from failure!
Maria Voice Clone
Well, you have built a clear, safe design plan from voice command to moving fingers. Good luck at the fair, inventor!