Part 2/3:
Installing the Whisper speech-to-text and Piper text-to-speech add-ons.
Configuring the voice assistant to use these local services.
Testing the voice assistant's ability to control smart home devices like lights.
Expanding to Multiple Devices with the Wyoming Protocol
To create a more robust voice assistant system, the narrator introduces the Wyoming protocol, a peer-to-peer protocol for voice assistants. This allows them to set up additional "Wyoming satellite" devices, such as Raspberry Pis, that can communicate with the central Home Assistant system.
Integrating a Local Language Model (LLM)
Dissatisfied with the basic conversational abilities of the Home Assistant voice assistant, the narrator decides to integrate a more advanced language model. They set up an instance of the Llama 3.2 LLM on a separate laptop and configure Home Assistant to use it for the conversation agent.
Offloading Processing to Dedicated Hardware
[...]