Note: I’m based in Korea, so some context here is Korea-specific.
Preview of the smart home I built (Japanese audio warning)
1. HomeAssistant?
It all starts with a platform called HomeAssistant, which I’ve written about before .
For HomeAssistant, 2023 was the Year of Voice .
With AI led by LLMs becoming more sophisticated, it was the year I started thinking, “We can really build Jarvis now!”
2. So what do you actually want to say?
I just wanted to show off (…).
3. References and tools used
HotWordPlugin - Wake word detection on Android
Tasker - Detects HotwordPlugin events on Android and launches a specific app
Whisper - Speech-to-Text engine
extended_openai_conversation - Uses information about devices in the home and calls real device control functions via function calling.
Bert-VITS2 (TTS) - The character voice is cute, right?
Zigbee2Mqtt - An open-source project that bridges Zigbee signals to an MQTT queue.
SONOFF ZBDongle-P - A dongle that lets the Raspberry Pi transmit Zigbee signals.
Tuya IR remote - Receives Zigbee signals and emits IR signals.
Comments