Man, what you are sharing is absolutely amazing. I'm surprised you don't have more subscribers. Currently I am struggling with Google Home Assistant.. already have since a few years devices from Google through the house but they really aren't dependable. Now seeing your videos about building you own ChatGPT powered, private voice assistant. I just want to get on and start doing that. You just got a lifetime subscriber here, please do continue creating awesome content! All the best from a Romanian subscriber.
Great video! I just got into home assistant not too long ago and am still trying to get acclimated to it from Alexa. Future videos of automation examples and explanations would be AMAZING! Not all of them have to be long and in-depth, but talking through some of your automations/showing how you have stuff set up would be great!
I don't quite understand why you consider your setup unique because the speakers are in the ceiling. Maybe I misunderstood but what i mostly saw was you controlling various devices but single, rather small room. I have [Google] assistants throughout my home and achieve basically the same level of control having them placed on tables, counters, etc. Again, entirely possible I missed something here.
It’s unique because the voice assistant knows which room I’m in by tracking my Apple Watch’s Bluetooth signal, and because the voice assistant can initiate a conversation by herself instead of waiting for me to call out to her. Also, it’s unique because no matter what music or TV audio is playing in any room, the voice assistant turns down that device’s volume and speaks loudly so I can hear her voice, then turns the volume back up after the interaction.
It's a Whirlpool oven/microwave combo. Try as I might, I can't find the exact model. Unfortunately, this automation DOES require their cloud dependent Whirlpool + Alexa integration, which I hate, so it sits on my dedicated IoT SSID. Perhaps one day I can hack at this to get a fully-local solution.
I’ll go deep on this capability for us. Multiple people have asked about multiple choice. As far as I know there aren’t any YT vids or blogs sharing some of the techniques I’ve used. Happy to share! Coming soon..
Hey I really love your process and the way you think about the smart home experience. How are you able to make Alexa wait for your response after you ask it a question? Is it possible to do with google devices?
Hey technithusiast! Your GPT + Assist videos are legend. Exactly the direction I want to head! Awesome work man! To make Alexa wait for my response I slightly modified keatontaylor's alexa-actions skill so it POSTs HA events back to my server, and then leveraged HA's new "Response Variable" feature to wait for that event. Let's stay in touch!
@@FutureProofHomes thank you I’m happy to hear you enjoy my content 😁. I’ve been trying to find a way to use these tech giant’s devices as a portal to home assistant and your video was the first I’ve seen that has done it. Kudos! Would you happen to know a Google ecosystem equivalent Or have insight on how to pull off something similar within the google ecosystem?
Which capabilities is Google lacking specifically? Actionable notifications? When I compared Amazon and Google a year ago I remember both products being really similar. I ultimately went with Amazon because of tighter Sonos integration and keatontaylors Actionable Notification skill.
@@FutureProofHomes something I’ve been trying to do is speak to google and have it trigger specific nodes or webhooks. Additionally I need google to to ask me questions and wait for a response. I believe they have an API where I can possibly create my own local fulfillment (I’d rather not though) but I’m getting mixed messages on forums that even with local fulfillment it may not work.
Great Video! I have almost whole automatization in Node Red, which "call" you using for Alexa commands/notify? " node-red-contrib-alexa-remote2" require login through web every time when flow stop or re-deploy. How did you solve it?
Hi there, I really liked your video. What amplifier do you have the Alexa devices connected to? The only brand I know of that do this is HTD but unfortunately they don’t ship to Ireland… Anyway, love the setup 👍 Cheers, Mac
Correct! I used HTD. See the latest hardware video. I go deep into exactly how the system is built. So sorry to hear they don’t ship there. Anyway to get a proxy shipper? It’s worth it.
That makes sense, I haven’t seen another amp that has this feature… I will need to look into how to get it shipped here, especially now seeing it working this well. Ideally, some PoE device that works like Alexa but completely local would be great but I haven’t found anything yet. There are some DIY options but nothing offering the full options like Alexa does, like playing from Spotify for one… I’m in the planning for a new build here, like to get this all well planned before we commence the build. Anyway, thanks again 👍
PLEASE do share the process for building these out!! I don't use Amanada though. Can we use the built in voice assistant to do the same thing? - subbed!!!
Will absolutely go deeper into how to build these. When you say “built-in voice assistant” do you mean Home Assistants newly released “Assist” feature?
Yes. It is certainly possible, but there will be some fundamental changes to my current setup. I’ll discuss this in future videos as I’m working on migrating to HA Assist myself.
Whirlpool WOC54EC0HS oven/microwave combo. I’ve only managed to make the oven smart though, not microwave. Has limited compatibility with HA. I’d recommend buying something with more capability.
Subscribed! Great content/solution. May I ask how your scripts are working to make Alexa asking you and waiting for your response? I understand HA is spotting your Apple Watch (probably via ESP Presence). I guess the magic is in script.ask_alexa_actionable_notification. I would love to see that part of your setup in detail. Thanks in advance.
This in-ceiling voice assistant solution will work for any voice assistant, provided the voice assistant it has a 3.5mm or RCA auxiliary output (like the Amazon Echo Dot). Apple HomePod/Siri infamously doesn’t have an aux output so you’d have to hack a solution for Siri as far as I can tell.
Those are custom-built LED strips I soldered together with diffusers wrapped around them. The LEDs are smart/controlled by home assistant and an ESP32 running WLED. The LEDs change color based on anything I watch in the home theater too. I’ll make a video on them if you’re interested. :)
Short answer - I use everything. That’s the power of Home Assistant. Long answer - Locks are z-wave, motion sensors are Zigbee, I don’t use Shelly currently, but I like them. My lights are Lutron. I love Lutron. Very reliable.
First of all all the voice assistances only listen for the commands Hey, Google or Siri and Alexa second of all, they do not listen to conversations other than when you trigger them
You’re correct. Studies have inspected voice assistant network packets and confirmed the microphones are not sending voice recordings back to the mothership unless you summon them with the wake word. HOWEVER the company is still storing the recordings and collecting data on your home (how/when you use your smart devices, what devices you have, etc.) and selling that data. Furthermore, it is not proven the company can’t remotely turn on the microphone if they wanted to, or was instructed to do by an authority. In general, having a microphone in your home that is connected to the internet is something many “smart-homers” are sensitive about. Which is why my setup will keep pushing the boundaries until the solution is 100% local.
Great tutorial!!! Target: 1. Bluetooth Detection 2. Stealth Voice Assistant (Home Assistant, ChatGPT, Google Gemini) 3. Multi-Room-Audio Is there an off the shelf solution for this? I would like to avoid the effort described here: ua-cam.com/video/kS0agn13hhU/v-deo.html
Man, what you are sharing is absolutely amazing. I'm surprised you don't have more subscribers.
Currently I am struggling with Google Home Assistant.. already have since a few years devices from Google through the house but they really aren't dependable. Now seeing your videos about building you own ChatGPT powered, private voice assistant. I just want to get on and start doing that.
You just got a lifetime subscriber here, please do continue creating awesome content! All the best from a Romanian subscriber.
If you’re gonna go in deeper to home, assistant automations, I’m going to subscribe.
Looking forward to sharing it all. Stay tuned!
Great video! I just got into home assistant not too long ago and am still trying to get acclimated to it from Alexa. Future videos of automation examples and explanations would be AMAZING! Not all of them have to be long and in-depth, but talking through some of your automations/showing how you have stuff set up would be great!
Will do!
This is hella impressive! Nicely done!
Thanks a lot!
Ya were going to need a video on how you mounted the echo in the ceiling and hooked it up to an amp!
You got it man. I’m on it!
Good video. I'd really like to hear how you installed the echo devices into your ceilings and distributed audo out from them.
100%. Will do a video on the amplifier + cat6 baluns between amplifier and Alexa + the HTD amplifier I use.
Very interesting setup. Searching for something similar for my garage door. So I would love to see more details about your smart home.
Coming soon!
Great video series. Can you please share your unraid container settings? Thank you
I don't quite understand why you consider your setup unique because the speakers are in the ceiling. Maybe I misunderstood but what i mostly saw was you controlling various devices but single, rather small room. I have [Google] assistants throughout my home and achieve basically the same level of control having them placed on tables, counters, etc. Again, entirely possible I missed something here.
It’s unique because the voice assistant knows which room I’m in by tracking my Apple Watch’s Bluetooth signal, and because the voice assistant can initiate a conversation by herself instead of waiting for me to call out to her.
Also, it’s unique because no matter what music or TV audio is playing in any room, the voice assistant turns down that device’s volume and speaks loudly so I can hear her voice, then turns the volume back up after the interaction.
@@FutureProofHomes Yep. I missed those things. Nice!
3 minutes 49 seconds into the video and I just had to subscribe!
Edit: what oven is that? 😅
It's a Whirlpool oven/microwave combo. Try as I might, I can't find the exact model. Unfortunately, this automation DOES require their cloud dependent Whirlpool + Alexa integration, which I hate, so it sits on my dedicated IoT SSID. Perhaps one day I can hack at this to get a fully-local solution.
Thanks for subscribing by the way. Lots of content to come! So many ideas...
Very good work, the video is well made and you have some great ideas. Subscribed. 👍👍👍
Love it! Thanks @ajinfrance!
Nice video! random question, but is that sonys AI autoframing you are using ?
Great video, Subcribed! I'd like to know more about the multi choice alexa response, will you do a video or point in the direction to find out more
I’ll go deep on this capability for us. Multiple people have asked about multiple choice. As far as I know there aren’t any YT vids or blogs sharing some of the techniques I’ve used. Happy to share! Coming soon..
Sorry fot the OT... what remote is that please ? :-)
Thanks for the video
I would love a discrimination if how to set this up
Yea, lots of people are asking to go deeper. I’ll do it.
Hey I really love your process and the way you think about the smart home experience. How are you able to make Alexa wait for your response after you ask it a question? Is it possible to do with google devices?
Hey technithusiast! Your GPT + Assist videos are legend. Exactly the direction I want to head! Awesome work man!
To make Alexa wait for my response I slightly modified keatontaylor's alexa-actions skill so it POSTs HA events back to my server, and then leveraged HA's new "Response Variable" feature to wait for that event. Let's stay in touch!
@@FutureProofHomes thank you I’m happy to hear you enjoy my content 😁. I’ve been trying to find a way to use these tech giant’s devices as a portal to home assistant and your video was the first I’ve seen that has done it. Kudos!
Would you happen to know a Google ecosystem equivalent Or have insight on how to pull off something similar within the google ecosystem?
@@FutureProofHomes looks like google still doesn’t all this type of behavior :(
I may have to get back my echo dot 😪
But I agree! Let’s stay in touch!
Which capabilities is Google lacking specifically? Actionable notifications?
When I compared Amazon and Google a year ago I remember both products being really similar. I ultimately went with Amazon because of tighter Sonos integration and keatontaylors Actionable Notification skill.
@@FutureProofHomes something I’ve been trying to do is speak to google and have it trigger specific nodes or webhooks. Additionally I need google to to ask me questions and wait for a response. I believe they have an API where I can possibly create my own local fulfillment (I’d rather not though) but I’m getting mixed messages on forums that even with local fulfillment it may not work.
Great Video! I have almost whole automatization in Node Red, which "call" you using for Alexa commands/notify? " node-red-contrib-alexa-remote2" require login through web every time when flow stop or re-deploy. How did you solve it?
Try using the node-red-contrib-alexa-remote2-applestrudel version. Let me know if that resolves your authentication issues.
Hi there, I really liked your video.
What amplifier do you have the Alexa devices connected to?
The only brand I know of that do this is HTD but unfortunately they don’t ship to Ireland…
Anyway, love the setup 👍
Cheers,
Mac
Correct! I used HTD. See the latest hardware video. I go deep into exactly how the system is built. So sorry to hear they don’t ship there. Anyway to get a proxy shipper? It’s worth it.
That makes sense, I haven’t seen another amp that has this feature…
I will need to look into how to get it shipped here, especially now seeing it working this well.
Ideally, some PoE device that works like Alexa but completely local would be great but I haven’t found anything yet. There are some DIY options but nothing offering the full options like Alexa does, like playing from Spotify for one…
I’m in the planning for a new build here, like to get this all well planned before we commence the build.
Anyway, thanks again 👍
Stay tuned. My future videos will go into how to build a 100% local LLM/AI powered Voice Assistant. I’m working on it. :)
PLEASE do share the process for building these out!! I don't use Amanada though. Can we use the built in voice assistant to do the same thing? - subbed!!!
Will absolutely go deeper into how to build these.
When you say “built-in voice assistant” do you mean Home Assistants newly released “Assist” feature?
@@FutureProofHomes Yeah, the HA Assistant
Yes. It is certainly possible, but there will be some fundamental changes to my current setup. I’ll discuss this in future videos as I’m working on migrating to HA Assist myself.
Another question, what brand/model oven do you have? I'm building a new house and I would like to get voice controlled appliances.
Whirlpool WOC54EC0HS oven/microwave combo. I’ve only managed to make the oven smart though, not microwave. Has limited compatibility with HA. I’d recommend buying something with more capability.
Cool Stuff. Got a Sub! Will you have the NodeRed and HA automations available view / hard copy?
Good call. Yes, I can certainly share my JSON/YAML in a FutureProofHomes GitHub repo and link in comments. Will do this.
Subscribed! Great content/solution.
May I ask how your scripts are working to make Alexa asking you and waiting for your response? I understand HA is spotting your Apple Watch (probably via ESP Presence). I guess the magic is in script.ask_alexa_actionable_notification. I would love to see that part of your setup in detail. Thanks in advance.
I’m on it! That video is coming next and will deep dive into all of that. This is a big question I keep getting asked.
What camera is following you?
Just an iPhone camera with DJI Osmo Mobile 6. Future videos will have much better video/audio quality. I’m working on it.
👍👍
Ty!!
Are you going to use Alexa only ? I am a Siri user .
This in-ceiling voice assistant solution will work for any voice assistant, provided the voice assistant it has a 3.5mm or RCA auxiliary output (like the Amazon Echo Dot).
Apple HomePod/Siri infamously doesn’t have an aux output so you’d have to hack a solution for Siri as far as I can tell.
Home assistant does work with Siri. So you CAN control your home via the phone or watch Siri.
Nice video! What lights are behind you in the intro there?
Those are custom-built LED strips I soldered together with diffusers wrapped around them. The LEDs are smart/controlled by home assistant and an ESP32 running WLED. The LEDs change color based on anything I watch in the home theater too. I’ll make a video on them if you’re interested. :)
Highly recommend Chris Meher’s channel for LED stuff though. He taught me A LOT!
@@FutureProofHomes Absolutely, would love to see it! Chris is awesome!
Cool! Will add it to the “video idea” list. Specifically, how to set up HyperHDR + WLED and then integrate that into Home Assistant.
Are you using zwave for local control? Shelly's, something else?
Short answer - I use everything. That’s the power of Home Assistant.
Long answer - Locks are z-wave, motion sensors are Zigbee, I don’t use Shelly currently, but I like them. My lights are Lutron. I love Lutron. Very reliable.
First of all all the voice assistances only listen for the commands Hey, Google or Siri and Alexa second of all, they do not listen to conversations other than when you trigger them
You’re correct. Studies have inspected voice assistant network packets and confirmed the microphones are not sending voice recordings back to the mothership unless you summon them with the wake word. HOWEVER the company is still storing the recordings and collecting data on your home (how/when you use your smart devices, what devices you have, etc.) and selling that data. Furthermore, it is not proven the company can’t remotely turn on the microphone if they wanted to, or was instructed to do by an authority.
In general, having a microphone in your home that is connected to the internet is something many “smart-homers” are sensitive about. Which is why my setup will keep pushing the boundaries until the solution is 100% local.
Great tutorial!!!
Target:
1. Bluetooth Detection
2. Stealth Voice Assistant (Home Assistant, ChatGPT, Google Gemini)
3. Multi-Room-Audio
Is there an off the shelf solution for this? I would like to avoid the effort described here:
ua-cam.com/video/kS0agn13hhU/v-deo.html