WoL Spring 2024 Demo: Home Automation with Local Phi-3 & Whisper

Running Whisper and Phi-3 locally to automate the house. When Phi decides that something is better suited to a larger language model, it calls out to GPT 4o.

[@reoky7416]

Sick man

[@okachobe1]

Very cool! I wonder if openai is gonna release a faster version of whisper to reduce the latency.

[@galvanadr]

Very nice, could you release a how to video? Thanks!

[@Sachyel]

Hey. This has a lot of potential. Are you planning into explaining how to do it? open source it?
Thanks a lot. or even do a tutorial on it and put the code behind Patreon so you get something in return for your work
Thanks!

[@ineedgoodname]

Any idea on making this open source?

[@AshLeaFen]

There’s not much to it, but here’s some code (haven’t checked in the local Phi-3 version, but same basic idea)…
github.com/AshleyF/sandbox/blob/main/llm/home.py