Local Voice Assistant for Home Assistant Without All the Drama | ESP32-S3-BOX-3
Вставка
- Опубліковано 28 тра 2024
- ESP32-S3-BOX-3 (AliExpress Affiliate Links):
s.click.aliexpress.com/e/_DDL...
s.click.aliexpress.com/e/_DmC...
► MY ARTICLE ABOUT THAT TOPIC - peyanski.com/switching-from-a...
► MY HOME ASSISTANT INSTALLATION METHODS FREE WEBINAR - automatelike.pro/webinar
► DOWNLOAD MY FREE SMART HOME GLOSSARY - automatelike.pro/glossary
► MY RECORDING GEAR
MAIN CAMERA: amzn.to/3UKinKV
MAIN CAMERA LENS: amzn.to/3yoR2X9
2ND ANGLE CAMERA: amzn.to/44KbVYX
2ND CAMERА LENS: amzn.to/48bhxMZ
SD CARDS: amzn.to/3sT7fRy & amzn.to/3sS0wHu
MICROPHONE: amzn.to/466Kxne
BACKUP MIC: amzn.to/468BSkb
EDITING MACHINE: amzn.to/45LWdvS
► SUPPORT MY WORK
Paypal - www.paypal.me/kpeyanski
Patreon - / kpeyanski
Bitcoin - 1GnUtPEXaeCUVWdJxCfDaKkvcwf247akva
Revolut - revolut.me/kiriltk3x
Join this channel to get access to perks - / @kpeyanski
✅ Don't Forget to like 👍 comment ✍ and subscribe to my channel!
► LINK TO OFFICIAL ESP32-S3-BOX TUTORIAL
www.home-assistant.io/voice_c...
► LINK TO OFFICIAL PIPELINE CREATION TUTORIAL
www.home-assistant.io/voice_c...
► DISCLAIMER
Some of the links above are affiliate links. If you click on these links and purchase an item I will earn a small commission with no additional cost for you. Of course, you don’t have to do so in case you don’t want to support my work! - Навчання та стиль
![The TRUTH About Home Assistant [Vs SmartThings]](http://i.ytimg.com/vi/cSzuWKsyuKI/mqdefault.jpg)
Thanks for taking a bullet for the rest of us.
anytime :)
It's actually working much better that that. :)
I think we all want to get rid of our Alexa devices but their hardware, no doubt backed by millions in research, is very good, particularly their microphones and speakers, for their price. Microphones have to be very good for seamless integration into a smart home and I'm not used to yelling at Alexa.
true, sad but true, at least we are on the right direction and I will keep trying replace my cloud voice assistant with something local
Also, Is more expensive
Agreed, and that is why I think that is why those projects that reuse and de-Amazon or de-Google those companies devices are more promising.
If that's the case it makes me wonder why didn't people just reverse engineer it to see what it was, and just use a similar thing?
I think the time has come, sooner or later someone will definitely be able to run all this locally.
If you accept, that your music device can be separate from voice assistant, it makes switching process much faster. I already switched to Wyoming satellites in pretty much every room except living room, only because i'm still writing Assist integration to play music from Music assistant on user defined speaker with voice.
Glad to see fellow citizen, doing such videos🎉 on the topic I guess as much as we work on this and keep pushing in this direction, the fastest we will get there. Surely if person is curious can make such device on his own with better mic and speaker. If I don't forget I'll get back here later this year with feedback on the DIY topic once I'm done with the whole renovation and start bugging with the whole Homelab.
Thanks for the comment and please don't forget the feedback when you are ready!
Thank you for this so much! The timing is perfect, since I just got mine yesterday :) I like dark theme when my eyes are tired or hurt. I like light theme when it's the middle of the day :)
Wonderful! Hope you enjoy the device and yes you are right eye caring is more important than color preferences :)
Thanks for the video. If the report is true, Nabu Casa is supposed to release a microphone interface later this year.
I also head about that, I hope they gonna make it ;)
Thank you for this material. I see a need of the followup material in which you could show how things improved after you've put some time into adjusting the configuration (and maybe a camparison with the cloud processing?)
Noted! Thanks for the idea!
Great vid - very tempted to buy one and just have a play lol. Maybe just to open some blinds in my bedroom.
Go for it it is fun.... :)
wow it's working just after 10 attempts
haha correct :) And it is not working everytime, but nevertheless this is hell of a progress for a local voice assistant and I love it. I can't wait for the future developments
Thanks for your hard work
It's my pleasure :)
What hardware can you reccomend in order to have the best and fastest performance for piper and whisper. Could it be a seperate nvidia ai machine?
First of all, thanks for the video 🫶
Secondly, different “stands” for the screen have other functionalities, in particular, one of them is filled with sensors, such as an IR receiver/emitter, temperature sensor, etc
The question that interests me is: do you happen to know whether it is possible to simultaneously use the device as a voice assistant, as well as useful use of the mentioned sensors, as well as the screen itself, not only for displaying 6 states but also for displaying a dashboard from the home assistant, video output or something like that, using a touchscreen to control these widgets? I'll be appreciated for your answer 🤞
I won't be throwing out my Echos for now, though I am interested in local voice control. I'll check back in 6 months to see what improvements HA has made
fair enough :)
Wow, I am really glad I watched this because I had never messed around with the models before. When messing around with them it had mediums-us chosen. The local response was about 5 to 7 seconds. Changed to the default(tiny-init) and response times are just as fast as cloud of not faster.
I am running x86 image on a 2 year old AMD chip (no dedicated GPU) with 32GB of RAM. Overkill but my 12 year old Intel Nuc was dying which was my previous HA server. The add-on also uses less RAM. Odd but I'll take it.
Finally switching my default voice pipeline to local only! I've been using Nabu Casa cloud for years (and will continue to) for external access it was just an option for me to use the cloud. I certainly trust their servers and what day do they collect more than Google or Amazon..
You can get a discount if you get a year, which I believe is 35 to $40. At least it used to be.
Glad that I help you go local :) And yes, changing models is a great way to optimize response times for your system. Supporting Nabu Casa team is a good cause and I highly appreciate it, but just to mention that there are at least 3 other very good & free methods for Home Assistant remote access and I covered them all in my previous videos :)
ordered ;-) thanks
Enjoy!
Hi Kiril, yeah, thanks for the bullet :) and i have some questions :)
what is the max distance that it hears/understands correctly what you say?
What about the speaker, it seems that it doesnt have one. If not then no piper is needed?
Справя ли се добре с българския?
I didn't test the distance, I'm always invoking it from from 1-3 meters and it is fine. Regarding the audio response it's kind of a bug that I got lucky to hit during the video shooting, now it's fine and there is audio response after upgrading to the latest ESPHome FW. За Българския има какво да се желае, но работи все пак което е супер. На дисплея обаче излизат квадрати вместо текст не съм си играл да видя може ли да се оправи :)
@@KPeyanski great! It's nice it has an audio, I'm looking for something like that that is able to do audio announcements and it's important for me. Thanks!
Great tutorial, I am thinking about buying this unit for my setup. Has it been reliable?
it depends on what are your expectations :) same as with everything...
How do you get the log screen to show on the right side?
The S3 Boxes frustrating me - the mics are not very well designed - my raspi satelites works much better! Looking forward for their own hardware....
Darkmode is good, but for YT-Videos, the white-mode is very much better!
Yeah I agree
i saw tuto with rasberry pi zero w2 and Wyoming protocol and a microphone installe on it. It's look to work very well. Maybe you could try it for the rest of us :).
I'll think about it, but what will be different in terms of performance in such setup?
@@KPeyanski The raspberry pi zéro w2 only work for Wyoming protocole and microphone. And the home assistant server with rasbery pi 4 work for everything else. So i suppose it's enough for good performance. But i am suspicious with that....
I have two Pi Zero 2's with the Seeedstudio speaker hat as Wyoming Satellites and the performance is comparable to this video here. It's far from being anywhere as good as an Echo device. Sometimes I need to repeat the wake word several times until it is recognized. I regularly need to power cycle them despite watchdog scripts. When music is playing on an attached speaker they don't hear you at all.
Nice for playing around, but no good for day to day use. Spouse approval factor 1/10.
My experience exactly. I tried it in German and it almost everytime didn‘t understand anything but the wakeword. Sadly…
I am using HA on rpi 4 and tried this with esp32 and microphone but HA puts a lot of load on processor.
I would like to see the load on the processor and memory being used in your tutorials.
hmm, good idea! I will include that in my next video tests ...
I have one of these...i found if I stand to close, it doesn't understand me?
Strange, mine works better from closer positions....
I notice that your device is also not speaking back just writing on the screen!
Yes, It is strange, because the $13 M5 Atom Echo responded with voice and this device is not. I guess it is some sort of a setting somewhere or I have to use another mount.
@@KPeyanski It's really odd because if you watch the home assistant videos the s3 box is speaking. I read a post on the forum saying they rolled back the software and then the voice worked !
Making smart use of supply and demand. It's certainly not worth 80 euros.
I think they increased the price recently. Not sure why, but it was a bit more cheaper before...
80+ euros for a device that has a crappy small screen.....
microphones that are 50-50 working...
and a system that is 50-50 working....
nope. i will wait a year and see if things change.
if i can't beat my Google's nest performance on microphone and reaction... i will not be spending any money on devices like these
Fair enough :) As @INSIGHTSAU in one other comment I took the bullet for you...
Yeah, sticking to Alexa for now. Voice of the year has passed and this hasn’t matured more than what we saw in the beginning.
Oh, it is matured a lot! We didn't have a waking word at all in the beginning. Actually, we didn't have anything local that is working in the beginning. Also another voice chapter is coming later this month so nothing is passed yet :)
Struggling with your accent?
Sorry to hear that, I'm accepting english accent consultations as long as they are free and good ;)
@@KPeyanski It struggles with mine too and I am English.
In my opinion, it is not the device but the processing that needs advancing. Love to see a video with processing on Home Assistant cloud.
@@KPeyanski I think he meant to say that the device is struggling with your accent.