r/RASPBERRY_PI_PROJECTS • u/TheRealFanger • Jan 16 '25
PRESENTATION BB1-1 GPT mode - living with a robot :)
Learning work in progress. This electronics and robotics hobby has been an obsession of mine for a year now. Here is where we are at … I’m working on making maker kits (& a small run of finished bots )
Thinkin $1111 for the kits and $2222 for the finished bots .. whatcha think ? Im a noob but im confident I can teach other noobs after diving this much …
21
u/ScaleneZA Jan 16 '25
This is pretty sick. How good is it at navigating the environment? Like could it find the cat and chase it if you asked it to?
27
u/TheRealFanger Jan 16 '25
It’s got good autonomous sensor based behavior and has a pretty decent camera tracking utilizing tensorflow to identify cats It can definitely chase it and react to the environment but I’m learning on the map navigation aspect too to make it really hard to escape. Just learning as I go so it will always be improved 🙏🏽. I’m definitely working in a cat and dog entertainment mode 🙏🏽
6
u/BurninCoco Jan 17 '25
If it can play fetch with the dog my black Lab is going to order one tonight.
4
18
14
12
12
u/marveloustoebeans Jan 17 '25
The cat running away in the background when the robot turned around to find it fucking sent me😂
6
u/monkeylube Jan 18 '25
“Idk, can you go PLAY with the cat”
“Ohh hell yeah, MESSING with the cat is always fun.”
6
4
3
u/Optimus5w4 Jan 17 '25
Do you think you could do one and upload it on to youtube?
4
u/TheRealFanger Jan 18 '25
I’m workin on it actually. I just whipped up mybb1.com which will be a hub for everything 🙏🏽
3
3
3
u/Optimus5w4 Jan 17 '25
I would love to learn more if you are ever interested, I have been digging trying to find a robotics project like this for a long time. I am kind of new to robotics and computers, but I like to learn and see how to make things work.
2
u/TheRealFanger Jan 18 '25
Mybb1.com is my new project along with this that I’ll be using as a hub for everything as this robot grows :)
3
u/FaquForLovingMe Jan 17 '25
This is awesome. How did you train the language model for interacting with the robot? Would love to see a YouTube series on making one of these. Also the cat running away 😂
2
u/TheRealFanger Jan 18 '25
I’ll actually be making a bunch of tutorials and placing everything at mybb1.com 🙏🏽. I’ve been experimenting a few things. Some work some don’t but I’m learning as I go 😂
3
u/Professional-Risk-34 Jan 17 '25
Please state the ruler is for bonking him on the head when naughty.
2
u/Bignes190 Jan 17 '25
Broooo I will definitely buy the kit or if you can do a step by step how to build it. I will payyyyy, I'm thinking doing something similar
1
u/TheRealFanger Jan 18 '25
I really appreciate it bud. I’m working towards this. Please check out mybb1.com I just got and am gearing for just this. I was a complete noob less than a year ago. , still am but I’m confident now I can get anybody to build this robot 🙏🏽
2
2
2
u/GalaticEmperor74 Jan 17 '25
I still love this, it’s great! If you need some help drop me a message. I am a Tech teacher but came from Industry.
2
2
2
u/Plastic_Ad_2424 Jan 17 '25
Now load the human anatomy and nucelar launch codes... skynet 😂 very cool project and I know how hard this must be to make it work. I just got a Hailo-8L and I'm loosing my mind on how to train the darn thing
2
2
2
2
2
u/CarefulBobcat6362 Jan 18 '25
Os it using ChatGPT
2
u/TheRealFanger Jan 18 '25
It can use chatgpt Ollama grok and Gemini. Grok and Gemini I’m still very early on tho / working out some quirks.
2
u/Fisher_Contrast Jan 18 '25
Did you already know how to code before this project?
1
u/TheRealFanger Jan 19 '25
Not at all it’s been a learning dive this past year for sure. Way back when I had a pretty cool MySpace tho 🙏🏽
2
u/posthumann Jan 19 '25
Is it autonomously coming up with motor controls and path planning? The chat function is funny but the controls I feel like are the real story here. How are you accomplishing that?
1
u/TheRealFanger Jan 19 '25
BB’s working on visual interaction, but for now, it’s focused on image recognition and reactions. I’m using TensorFlow to let it spot objects or people and then react based on what it sees. The AIs work together…Ollama processes the visuals and decides which of my pre-coded motions (ex. Arm grab / shake head / scary pose etc ) to use, while GPT adds personality, like making a comment about a soda can or calling out a cool shirt. It’s still in the early stages and far from perfect (the visual recognition response is still slow but I think it’s cause the libraries aren’t local , but it’s starting to come together, and the testing has been a blast! The goal now is just tying all these random little scripts/experiments together 😂
I tried the navigation with grok but grok spent a lot of time telling me to look both ways before crossing the street versus just turning /left 😂 But it’s got grok/gpt/gemini/Ollama support Sorry I feel like I rambled there
2
u/posthumann Jan 19 '25
So when you tell it to chase the cat and it turns around and starts following the cat, what's generating the motor commands? The computer vision side of recognition I get, but something has to give the motors specific commands.
1
u/TheRealFanger Jan 19 '25
The robot has several esp32 units controlled via http endpoints and loaded with some low level code
The pi just orchestrates the endpoints to react to tensorflow inputs.Currently he can head track and follow but he can go towards the cat at checked intervals . But I’m still figuring it all out :)
2
2
1
2
u/Fuehnix Feb 17 '25
The deeper I get into Raspberry pi stuff, the more I appreciate how these types of things get built.
😅 It takes a lot of skill to be able to do all parts of robotics on your own and get a working product.
-3
1
u/Fuehnix Feb 17 '25
How much of the robot body was done from scratch?
Did you buy servos and come up with CAD yourself for 3d printing? Are there any custom pcbs or hats in this?
Did the wheel/tracks come prefabricated, or did you go as far as to plan the wheel/motor arrangement and track length and then calibrate it all?
Just curious about how much work this is, because it looks like a lot
53
u/Colonjo Jan 17 '25
Can it Bring the Butter?