Furby AI Oracle - Hardware Hacking & Embedded AI Experimentation
A fun experimental side-project built to test modern AI APIs on vintage physical hardware. By rewiring the central belly button for physical triggers and retrofitting a 90s Furby with a Raspberry Pi 3, Whisper, and GPT-4, it becomes an eccentric fortune-telling oracle with pitched local voice synthesis.
Context & Experimental Approach
- AI API Testing & Tangible Computing (Just for Fun): Connecting modern LLMs and Speech Recognition directly to retro mechanics to create an absurd physical gadget.
- Physical Tactile Trigger: Repurposing the Furby's original central belly push-button to initiate the voice listening action with a simple press.
- Random Combinatorial Prompts: Dynamically generating oracle personas for every question. The Furby can act as an ancient mystical oracle in one turn, and switch to a fortune teller reading the future in cheese the next.
Technical Architecture & Python Pipeline
- Reverse Engineering & GPIO Control: Wiring the original belly button directly to the Raspberry Pi 3 GPIO pins to register user interactions and drive motor mechanics.
- Voice Pipeline (Whisper STT & Pitched Local TTS): Belly button press -> Mic audio capture -> Speech-to-Text via Whisper -> Response generation via GPT-4 -> Audio rendered via a local TTS engine with real-time pitch-shifting to emulate the iconic Furby voice timbre.
- Mechanical State Animations: Python scripts controlling motor animation loops (beak opening and eye movements) synchronized with speech playback and listening phases.
Technical Hacking Breakdown
1. Reverse Engineering & GPIO Control (Raspberry Pi 3)
Challenge: Interface the original Furby hardware to control movement and capture physical input triggers using a modern microcomputer.
Solution: Removed the original mainboard, wired the belly push-button to GPIO, and controlled the motor directly using Python scripts on a Raspberry Pi 3.
2. Belly Button Trigger, Whisper & Pitched Local TTS
Challenge: Trigger listening smoothly via tactile interaction, accurately transcribe speech, and output a signature pitched Furby voice without latency.
Solution: Integrated the central belly button to trigger Whisper audio transcription, generated randomized GPT-4 responses, and synthesized audio through a pitched local TTS model for retro character voice delivery.