Both will be possible! I'll address this in a Q&A video, but mmWave can be added easily since all the GPIOs are exposed and the future enclosures will give us mmWave too. Also, a PoE to USB-C adapter will be available.
@@FutureProofHomesdrywall ceiling is fairly common in many places around the word or at least all the places I’ve been living, but there might be some additional requirements regarding inset devices compared to US.
Shout out from one of the Music Assistant devs. Great to see MA enabled products like these come to fruition. I would love to get my hands on one to start playing around with it🎉
This is going to be such an awesome kit. I love all the companies developing for a future-proof home. The market is really beginning to value products like this.
Thank you. Yes, I want FPH to be a full-blown consumer electronics startup for regular consumer electronics. It's a lofty goal, but that is where we're heading.
Looking forward to get the final consumer products😆!!! I know that's a little bit early but, Man, what you'v done is so cool and perfectly matchs my thoughts. I'm a software engeener also a fan of homelabing, but I have no idea about hardware things...I really need a stable product that has features like satellite1 to build my smart home. No joke, I'm planing pre install some cables (poe) on my new house celling for your products🤣. So keep going pls!!!
This is already so awesome. Really excited to see how this develops. I appreciate all the time and effort you have put into making this product. I think it has the potential to be huge. Especially if more sensors like PIR/mmwave are added. Great work demo and professional Brad.
This is a very exciting development! I'm not tech savvy enough to buy and set up the dev kit, but I'll be following closely and eagerly await a fully fledged commercial product!
That sounds great, happy to be a guinea pig if you need a test subject 😂 the idea of having an AI voice assistant is very exciting. I currently use Alexa and have a lot of smart home devices. All my lights, thermostat, smart plugs, fans. But I'd love to ditch Alexa! I'm a huge advocate for not relying on cloud services. However, at the moment I still need them.
I am so looking forward to this. I had the exact same product idea 2 years ago but I lacked the experience to build it. I am even leaning into the idea that this should be standard in every future house!
If built with top notch hardware and software to give a flawless user-experience (will take years of R&D) I too believe this product would transform the common home.
Hey congrats on your launch! This is some really exciting tech. It’s at times like this I wish I was a hardware dev but I look forward to creating dope software around this though 😁
Thanks @technithusiast! I'll send you one for review during private beta if you're interested? Hack away on it and push the thing to it's limit! You have my email. Cheers man!
Dude, this is amazing. I plan on buying several if the first dev kit works well. I already use Assist more than Alexa while sitting at the PC, would love to have a good solution off the shelf for all rooms (so I don't have to build 10 DIYs)
Looks dope! Mostly commenting for the algorithm :) This is my first exposure to your channel but I've been hoping to migrate to home assistant from a Google Home setup, and the last thing I really need for a complete replacement is solid voice control. I used home automation for accessibility/assisting in managing a chronic health condition, and I'm really excited by the prospect of a private, self hosted system that still helps me in the way I'm used to with my google home setup! Really excited to see the eventual final product!
Looking forward to this! Glad you’re thinking of it as a music player - that’s a core piece of a voice assistant that many esp based devices aren’t supporting (yet). Would be a perfect device if you can add Spotify Connect functionality and/or chromecast audio. Keep up the good work on this device!
Yes, audio playback is aiming to be best in industry. The Amp1 product will help us achieve this. See the roadmap on FPH website. Music playback is critical for me too. It's coming.
just to make a note, to the date, I built the same thing and currently in the testing phase, using 2 Esp 32 models in 1 device, 4 mics, speaker and all the most common sensors. If i fail for sure i will buy many from you, great work
@@FutureProofHomes connectivity/protocols on one and sensors on the other, they seem to work very well together. S3/C6, the mics i wanted also needed C6 so spread the load
Does it mean the user would need to juggle multiple serial USB connections and flash multiple ESPs individually, or did you find a way to flash both simultaneously such that the S3 is a "master" and the c6 is a "slave"?
I’m very excited about this project. I’ve slowly become more disenchanted with Alexa. I’ve been hoping something like this would become available so that local control was possible. I’ll keep an eye out for this. Please keep up the good work.
Definitely didn’t forget about that. You’ll be able to connect externally amplified speakers via the 3.5mm headphone jack on the Sat1. Also, after our AMP1 product launches later in 2025 you’ll be able to connect speakers directly to the amplifier.
YES! Intercom capability would be sick. This will be a bit in the future, but I'll look into what it might take to pull this off (probably a lot, but not impossible).
Having a voice assistant start the conversation is something I've wanted for a couple of years. Using dev tools it's apparently possible with Google Home but it all seemed too hard. This looks great!
First year or so is within the community. But I REALLY want to take HA and our suite of products out to average consumers in primary markets. To hit that goal we must build a great team and something very reliable and intuitive. That will take years and I would love to do exactly this for many years to come.
It’s early, but the mission is clear. I get excited when I think about achieving all our goals and this channel documenting all the milestones. Thanks for the support!
Congratulations on this!!! I do have a suggestion for gen 2… if you integrate POE into the board it would make a in ceiling option a lot easier and probably enable a longer longevity. I can’t imagine having to dig in a ceiling to replace a hidden 120 to usb adapter would be very fun. Yet having a cat5/6 dongle that has POE to it can remain dormant in the ceiling with no drawbacks.
OK this looks very cool, so I wanted to share with you my 'wishlist' for the ultimate smart device to place troughout my house: Devices liek the "Everything Presence Pro" or the "UltimateSensor" check many of the below boxes, but there is note that checks all of them :--) Some of these could be great to add to your sensor, some it could be nice to ensure that end-users can add them themselves if they want to. * ESP-based (for ESPHome): check * With all the features for voice: check * Speaker can be used as a media player: check * Bluetooth proxy support: check (I think) * Bluetooth presence detection: check (I think) * MMWave Sensor * PIR Sensor (for an alarm system) * CO2 Sensor (to monitor air quality, i.e. when to open a window or increase ventilation) * PoE support: (powering + networking over an ethernet wire). * Alarm cable support: allow it to be powered by an alarm system and also have it include a relay that can trigger the alarm system when the PIR sensor detects motion. * Colour LED's (to show a status)
Bluetooth proxy - check Bluetooth presence - check PoE - check (with adapter or future enclosure) mmWave -check (via GPIOs or future enclosure) LEDs for status - check All other ideas - TBD
I'm on the waitlist and really looking forward to this hardware. You're doing an awesome job, thank you and best of luck! I do have one request/suggestion, as an electronics engineer it drives me insane when companies make stupid design choices for powering equipment. I have seen a trend toward powering sensors with USB power supplies, what are people thinking? I know it's easy and simple to use a USB power supply when many of the designs incorporate an ESP32 or similar inside and all you have to do is jam in a micro USB connector to power it but you have to think about the practical aspects of form and function. When you want to place a sensor like a millimeter-wave sensor or any other occupancy or motion sensors it's ridiculous that with so many products on the market now you have to use a USB power supply and then try hide the power supply and cable going to the sensor. What am I missing? I want a nice clean installation and not have a sensor on my wall with a cable running down to an electrical outlet where it's plugged in. In a perfect world the device would support PoE, not an adaptor that I saw mentioned in another post, you want it integrated into the PCB design. RJ45 connectors are, unfortunately, large and I concede that is not ideal and a challenge to keep the device form factor small but this hardware is going to be a little larger because of everything it supports so I feel a RJ45 connector can be accommodated. If PoE proves to be too much of a challenge then please, please, please make provision for DC power terminals. A lot of homes don't have CAT5/6/7 running everywhere but most do have basic, two conductor security wiring that you can send 12 or 24VDC over (5VDC not ideal over long, small gauge copper). I frequently replace old PIR motion sensors with newer technology and use the 12 or 24VDC that was previously powering the device to power the new hardware which then keeps the installation of the device nice and clean and aesthetically pleasing (no stupid power cables hanging down the wall). Thanks to PoE being a power and low latency data/network solution it is ideal but at the very least it would be nice to have flexible power options. A while ago I purchased an ESP32 PoE Development Kit (EST-PoE-32) from Everything Smart Technology (EST) and it supports PoE, USB-C and 9-28VDC for power, it is a great, flexible, little board and proof that it can be done. One final point I'll add to this comment, that has become rather long, I really like being able to power all my devices in my home with a single PoE Ethernet switch which means I only have to worry about a single power source that is plugged into a UPS and not dozens of USB power adaptors plugged in all over the home. Great solution to keep everything protected and operational no matter what happens with mains power. Keeping a spare PoE Ethernet switch also makes for easy redundancy in place of dozens of USB power supplies that easily have their cords pulled out. Okay, perhaps I went a little overboard making my point 😁.
Great comment. I hear you. Here’s what is happening behind the scenes. Let me know your thoughts. What you saw in the video is the “HAT” and “CORE” boards. Behind the scenes we have a third board we call the “SHOE”. This SHOE board is responsible for all the I/O connections at the bottom of the hockey puck enclosure (3.5mm headphone jack, USB-C, 30w PoE+, and the available GPIOs). So if you’re running the CORE and HAT “naked” (with no enclosure) then you don’t get PoE unless you add-on the third SHOE board dangling from a ribbon cable. Obviously this decision is being made so that all the boards can fit in the enclosure. I know this isn’t ideal for hackers but we’re trying to avoid two variants of the HAT. Thoughts on this?
Finally. A local voice assistant that’s even better than amazons offering. It won’t be long before Amazon want to charge for basic Alexa so this is brilliant.
I hear rumors they're building a product internally they call "Remarkable Alexa" which is powered by their LLM in the cloud. Amazon will supposedly charge monthly for this. We'll see!
Sounds too good to be true.. I subscribed and will be waiting on new updates.. So far amazing job. Quick question? I know this is work in progress, but what's the chance of being able to integrate AI into the voice assistant?
Yes. The Sat1 will work with all of today's AI/LLM experiments. Set up a local LLM and connect it to HA (see HA's Ollama Integration) or use HA's OpenAI Conversation Integration to hook into ChatGPT (always be weary of connecting your home to any AI though, especially cloud based ones).
I'm looking forward to the day I can get rid of my Alexa devices. I know you can achieve local voice assistant capabilities with DIY solutions currently.. but I've never quite been satisfied enough from videos I've watched to actually try it. Looking forward to seeing this idea develop! Subscribed! Edit: I just went back through your channel and watched your video about local LLM and Home Assistant voice assistant. Yes, it did also blow my mind haha. I may give it a go this evening.
Thanks for watching and playing catch up on previous videos. If you've watched all the videos and read the website then you can see the bigger picture of what we're building. The bar is set high, but I want to build a really solid and reliable product here. Stay tuned!
This is awesome! With something like this that's planned to be placed evenly all around the house I've always wondered if it could also be a Zigbee/Thread router as well? Google/Apple Home products are starting to add that in their satellites.
lol sorry thought of another improvement. Me being passive house enthusiast.. I think you should make a mounting part where you can drywall the mount and then just snap in the satellite. That way we can make the device install easy and air tight between the living space and the attic.(if there is an attic above the room).. I would make a round mounting device with ethernet jack(Poe) so that above the device in the attic you just plug in the ethernet cord and on the other side (satellite side) the satellite just snaps to the mount. or we make the mount flush with the ceiling with mic holes.. etc.. either way.. We need to make sure when this is mounted it provides an air tight connection.. (safe for insulation..).. thanks :)
Subbed & liked. Very interested in the final product. As someone who utilizes Google Home for Whole-Home Audio via Groups (Bluetooth in-wall receivers connected to in-ceiling speakers, connected to the Google Home via Bluetooth), I'm hoping this supports this sort of configuration. In addition, id recommend allowing the Assistant to respond on the same Bluetooth speaker too, as it's one major reason I love using the Google Home still during cleaning or kitchen work. I haven't messed that much with the AI in Home Assistant, but this is the sort of thing that may get me to give it a shot. I do use HA for pretty much all actual smart-home & automation tasks, but I have vocal search & music still on the Google platform.
Yep. My goal is to win over users like you with reliability and functionality. Stay tuned. I really want this tech too. So selfishly I'm building it for me and my customers too.
Congrats. I've managed to have a working and stable enough system with a Korvo and tweaking, but I really hope your project is gonna work and become the perfect solution, cause nothing is for now.
@@FutureProofHomes Also, it might interest you but i've managed to make an reply function when the assistant (Assist in HA, with your A.I of choice) is asking a question. Basically, it checks the text of the answer and looks for a question mark. It works pretty well and avoids having to repeat the wake word (i don't know if your system has a solution like this).
Given how unique this product is, I reckon you would have a decent chance of a collab with one of the major channels like LTT. I know you're just as dev kit stage at the moment, but some of their best videos are when they are trying out new/not quite ready stuff. Linus often does 'upgrades' to his home system and I bet he would be interested in something like this. Defo worth an email I would think.
I'm just thinking this device could be as an amazing all-in-one room device, including using it as thermostat... Not sure how feasible would be to install it in the wall. Thinking on it as you can use the Sonoff NS-Panel that come with European and American versions (for the standard size).... So looking forward for the development. I would totally install one per room.
We will be shipping to Europe upon launch and have inventory there. Shipping across all of Europe looks like it will be less than $10 and 3-5 business days.
Very excited for this. It's exactly what I wanted and then some. I'd really like to see how you get responses faster from a local AI server. I wonder if there is a slimed down version. Where you can select categories of information. I'd be very interested what information you could pass from the web, like weather and air quality. Maybe that's just buikt into HA with other intigrations
Can't wait to cut Alexa out of my life! Listens about as well as a teenager these days! Price is roughly what I would expect for a finished product, great to see a dev kit for a accessible amount.
We're really trying to keep the prices low, but we need to make some profit to keep the lights on and continue building. Keep in mind everyone that Amazon and Google loose money on their voice assistant hardware sales because they make money on the backend from your data. That's not the kind of business we're trying to run here so privacy and good hardware will cost a bit more.
very interesting, waiting for more updates about the hardware. one question, are you using nvidia jetson nano for home assistant and openAI ? the delay on the responses are very low, I am impress.
I running all forms of the AI pipeline in many places. What you witnessed in this particular video is me using the standard Home Assistant conversation agent (no AI) on standard server hardware (not Jetson).
This looks really nice. Looking forward for what's to come in the future! Any reason you went with an ESP32 chip instead of something that could run on-board wake word like a Pi Zero? I know Micro Wake Word is now a thing but can an ESP32 do multi-room audio, audio ducking etc? Is it running ESPHome?
Our Hat board is compatible with RPI Zero. I’ll demo this in upcoming video. Basically we’re platform agnostic and this could be a great Wyoming Satellite too!
If the ESP is robust enough (I wouldn't think it is long-term), my only other request is PoE. Especially for ceiling mounting, USB is generally a non-starter.
I don't think the big-tech companies will ever give us this type of offline voice solution either. It's just not in their DNA. People want it though! So here we are...
This seems pretty much identical to the ReSpeaker mic array boards, just with an ESP32 inside. Seeed never delivered a firmware with working beamforming for the XMOS IC, let's hope this guy does better.
If we're thinking of the same ReSpeaker, then the Sat1 should be quiet a bit more versatile and powerful. e.g. Has better audio processing, music streaming, bluetooth presence detection, extra sensors, etc. Not to mention this will work with ESP32 and RPI. :)
The integrated ESP32 and the resulting form factor is very nice for sure. But for me a voice assistant gadget hinges on rock solid speech recognition (mainly wake word but also STT) no matter if there's music playing or water running in the room. The ReSpeaker didn't have that, despite also using an XMOS chip, that's why I'm having reservations if you can do it. (But very much hope so!)
This is quite cool! So... will it be able to be powered by POE, or just the USB-C options? I like the concept of in ceiling installation and running another POE Cat6e cable is so much easier than running a power outlet!
Can you think of competing with Movi Audeme on this? It hasn't had an upgrade since 2017. Can the voice be tinkered with an oscilloscope. Still have it be able to work with an arduino, stm32, or rpi5? 😊😊😊
Have you made an initial estimation of the price, with the case, speaker etc? It might be worth to have two versions, one simple, (only speaker) and a second one with all the sencors/features, just for the sake of diversifying the product line (...just saying).
Noice. On the waitlist. Just wondering, given the shape, would this maybe fit into a Google Nest mini shell? I'm guessing it's probably bigger though 🤔
I know you have a 3.5 to connect external speakers but I would prefer not to run wire (whole home audio amp in basement), will we have the ability to still modify the yaml in the esphome setup of the device so that I can set the output speaker to a home assistant media player? I currently have some m5 atoms that do this by specifying VLC media player ironically which is hooked in as a source to my whole home audio (already have speakers in many rooms throughout house) through my home assistant server. I use the on_tts_end: and on_tts_start I specify the entity_id of the vlc media player. The m5s work pretty well but the accuracy is very hit and miss as far as hearing you and they definitely can't hear you if other sound is going on in the room. The device looks awesome by the way and good luck with the launch!
this is awesome and can't wait to try it out. I think you did say there was a plans to maybe add a case for if ??? I plan on using home assistant to replace all of my echos in the house ( one in every room), one thing that was asked on my by mom and wife is can this have a clock on it, so that is my request is can you try and add a clock
Looking forward to this! Is there going to be a software disable mic feature? That's my biggest gripe with existing smart home speakers. I want to be able to control when to have the devices listening. IE: If I'm not home, I want the mics disabled and hardware button won't override the software disabled.
Looking forward to watching the development of this product.
Thank you! We've got a solid roadmap ahead of us. But we'll need these dev kits to sell so we can make revenue and blast to the next stage. :)
Add Poe and mm wave and this,would be the all in one room sensor of my dreams. I’d buy 20!
Both will be possible! I'll address this in a Q&A video, but mmWave can be added easily since all the GPIOs are exposed and the future enclosures will give us mmWave too. Also, a PoE to USB-C adapter will be available.
Stealth ceiling mounted FINALLY someone is thinking about this
Agree! Recessed mount for US (common with our drywall ceilings) and something slightly different for rest of world.
@@FutureProofHomesdrywall ceiling is fairly common in many places around the word or at least all the places I’ve been living, but there might be some additional requirements regarding inset devices compared to US.
Yep. Gotta follow proper protocol/regulations/codes for in-ceiling devices. Hence why a bit later in roadmap.
@@FutureProofHomes mains powered will ne a necessity as low voltage will be a pain the A$$
Shout out from one of the Music Assistant devs. Great to see MA enabled products like these come to fruition. I would love to get my hands on one to start playing around with it🎉
Awesome work over there at MA @Marvin060591! We'll be in close contact. Love all that you guys do!
Hardware companies are tough, but the rewards are big. Godspeed to you.
100%. Learning a lot and learning fast. Determined to succeed. Thanks for the well wishes!
Congrats on your launch! I know from my own startup experience how exhilarating it is. I look forward to seeing where this goes!
Thanks so much!
I couldn't get Onju Voice working at all so I am extremely excited for this to be released!
Cool beans! It's a long road and you're still moving forward!
Long road indeed. Gotta keep going though.
This is going to be such an awesome kit. I love all the companies developing for a future-proof home. The market is really beginning to value products like this.
Thank you. Yes, I want FPH to be a full-blown consumer electronics startup for regular consumer electronics. It's a lofty goal, but that is where we're heading.
Looking forward to get the final consumer products😆!!! I know that's a little bit early but, Man, what you'v done is so cool and perfectly matchs my thoughts. I'm a software engeener also a fan of homelabing, but I have no idea about hardware things...I really need a stable product that has features like satellite1 to build my smart home. No joke, I'm planing pre install some cables (poe) on my new house celling for your products🤣. So keep going pls!!!
This is already so awesome. Really excited to see how this develops. I appreciate all the time and effort you have put into making this product. I think it has the potential to be huge. Especially if more sensors like PIR/mmwave are added. Great work demo and professional Brad.
Thank you for all the support @techdad6135! More to come. Looking forward to sharing all milestones as we move towards the future.
So glad you followed up with this, I have been waiting!
It’s been rewarding. We’re going to go all the way too. The fun has just begun.
Yoo congratulations!!!! Love your iterative approach! Can’t wait to put these all over our house!
Hey Gregor! Thanks man. Enclosure is next. :)
Congratulations on your hard work and bringing such a great product to the community....I'm on the list..!
Thank you so much! Appreciate the support @222inverter.
this looks fantastic! can you put a radar like the LD2450 on there, would be awesome to have an all in one satellite with decent presence detection.
Yes! mmWave will be in the enclosure.
This is a very exciting development! I'm not tech savvy enough to buy and set up the dev kit, but I'll be following closely and eagerly await a fully fledged commercial product!
I will do my best to get this to a point that most people watching this channel can follow less than 10-steps to be operational.
That sounds great, happy to be a guinea pig if you need a test subject 😂 the idea of having an AI voice assistant is very exciting.
I currently use Alexa and have a lot of smart home devices. All my lights, thermostat, smart plugs, fans. But I'd love to ditch Alexa!
I'm a huge advocate for not relying on cloud services. However, at the moment I still need them.
I'd certainly be interested in this, depending on the price point.
There it is!
I am so looking forward to this. I had the exact same product idea 2 years ago but I lacked the experience to build it. I am even leaning into the idea that this should be standard in every future house!
If built with top notch hardware and software to give a flawless user-experience (will take years of R&D) I too believe this product would transform the common home.
Whoooosh, finally some prototypes of XMOS satellites! :)
Good luck, and will be waiting for news!
More to come!
Hey congrats on your launch! This is some really exciting tech. It’s at times like this I wish I was a hardware dev but I look forward to creating dope software around this though 😁
Thanks @technithusiast! I'll send you one for review during private beta if you're interested? Hack away on it and push the thing to it's limit! You have my email. Cheers man!
Dude, this is amazing. I plan on buying several if the first dev kit works well. I already use Assist more than Alexa while sitting at the PC, would love to have a good solution off the shelf for all rooms (so I don't have to build 10 DIYs)
Sounds like you’re a great fit for the Sat1 too! Thanks for the support. Launching soon!
Looks dope! Mostly commenting for the algorithm :)
This is my first exposure to your channel but I've been hoping to migrate to home assistant from a Google Home setup, and the last thing I really need for a complete replacement is solid voice control. I used home automation for accessibility/assisting in managing a chronic health condition, and I'm really excited by the prospect of a private, self hosted system that still helps me in the way I'm used to with my google home setup!
Really excited to see the eventual final product!
Thanks for the support Chris! I sincerely hope this product can increase your quality of life as the tech gets better and better.
Looking forward to this! Glad you’re thinking of it as a music player - that’s a core piece of a voice assistant that many esp based devices aren’t supporting (yet). Would be a perfect device if you can add Spotify Connect functionality and/or chromecast audio. Keep up the good work on this device!
Yes. Consideration of music playback capabilities is critical for this product. We have a plan to get us Spotify Connect & Airplay2.
Thank you for doing this. Can't wait until the final hardware will be there.
Thank you!
I am very looking forward to this!
Coming soon! Thanks for the support!
You're welcome, and thanks to you for making an amazing (hopefully!) product! I'm on the email list, and will definitely be backing you!
Also is PoE in the mix?
Yep! See all the other comments.
Oh! For a final product the audio quality for music playback is just as important if not more important than voice input reception 😊
Yes, audio playback is aiming to be best in industry. The Amp1 product will help us achieve this. See the roadmap on FPH website.
Music playback is critical for me too. It's coming.
How exciting. Congratulations on your launch 🎉
Thanks so much!!
just to make a note, to the date, I built the same thing and currently in the testing phase, using 2 Esp
32 models in 1 device, 4 mics, speaker and all the most common sensors. If i fail for sure i will buy many from you, great work
Why two ESP32s? One for ESPresense? :)
@@FutureProofHomes connectivity/protocols on one and sensors on the other, they seem to work very well together. S3/C6, the mics i wanted also needed C6 so spread the load
Does it mean the user would need to juggle multiple serial USB connections and flash multiple ESPs individually, or did you find a way to flash both simultaneously such that the S3 is a "master" and the c6 is a "slave"?
Ben Jackson looks very oddly like Bill Murray... hah. Looking forward to the development, great stuff!
Ben Jackson is one of Bill’s many cousins.
I’m very excited about this project. I’ve slowly become more disenchanted with Alexa. I’ve been hoping something like this would become available so that local control was possible. I’ll keep an eye out for this. Please keep up the good work.
Thank you! Many people feel like you and me it seems. If we can deliver then there is success for everyone.
Looks awesome! added myself to the wish list! pleaseee allow it to use external speakers as well!!!!
Definitely didn’t forget about that. You’ll be able to connect externally amplified speakers via the 3.5mm headphone jack on the Sat1. Also, after our AMP1 product launches later in 2025 you’ll be able to connect speakers directly to the amplifier.
Omg I've been waiting for this for ages. Adding an intercom feature between nodes would be amazing
YES! Intercom capability would be sick. This will be a bit in the future, but I'll look into what it might take to pull this off (probably a lot, but not impossible).
Having a voice assistant start the conversation is something I've wanted for a couple of years. Using dev tools it's apparently possible with Google Home but it all seemed too hard.
This looks great!
It’s magical when the ceilings of your home start talking to you at the right moments for the rights tasks.
It looks great! Intrigued as to how far it will eventually reach!
First year or so is within the community. But I REALLY want to take HA and our suite of products out to average consumers in primary markets. To hit that goal we must build a great team and something very reliable and intuitive. That will take years and I would love to do exactly this for many years to come.
This looks promising! Thanks for the work you have done for the community!
You bet! Love doing this stuff. The whole FPH team really appreciates the opportunity to build such cool stuff for the community.
How exciting! I've been waiting for this - thanks for all your hard work!
It’s early, but the mission is clear. I get excited when I think about achieving all our goals and this channel documenting all the milestones.
Thanks for the support!
Congratulations on this!!! I do have a suggestion for gen 2… if you integrate POE into the board it would make a in ceiling option a lot easier and probably enable a longer longevity. I can’t imagine having to dig in a ceiling to replace a hidden 120 to usb adapter would be very fun. Yet having a cat5/6 dongle that has POE to it can remain dormant in the ceiling with no drawbacks.
Our enclosure which will come out in early 2025 will have PoE. :)
Definitely excited for this. Looking forward to the final product and ceiling mount.
Yea, I’m really excited for ceiling mount too!
Yea, I’m really excited for ceiling mount too! The user-experience is almost magical when your whole room talks to you.
OK this looks very cool, so I wanted to share with you my 'wishlist' for the ultimate smart device to place troughout my house:
Devices liek the "Everything Presence Pro" or the "UltimateSensor" check many of the below boxes, but there is note that checks all of them :--)
Some of these could be great to add to your sensor, some it could be nice to ensure that end-users can add them themselves if they want to.
* ESP-based (for ESPHome): check
* With all the features for voice: check
* Speaker can be used as a media player: check
* Bluetooth proxy support: check (I think)
* Bluetooth presence detection: check (I think)
* MMWave Sensor
* PIR Sensor (for an alarm system)
* CO2 Sensor (to monitor air quality, i.e. when to open a window or increase ventilation)
* PoE support: (powering + networking over an ethernet wire).
* Alarm cable support: allow it to be powered by an alarm system and also have it include a relay that can trigger the alarm system when the PIR sensor detects motion.
* Colour LED's (to show a status)
Bluetooth proxy - check
Bluetooth presence - check
PoE - check (with adapter or future enclosure)
mmWave -check (via GPIOs or future enclosure)
LEDs for status - check
All other ideas - TBD
I'm going to buy this! Don't know if i'll succeed to make it work, but this is a great project and I want to help!
Oh and THANK YOU for not being Google and make it available for Europe 😂
We’re going to do our best to make it as easy as possible to set up w/ good documentation. Thanks for the support!
@@FutureProofHomes I really hope so! 🙏🏾🙏🏾🙏🏾
Awesome can't wait for the finished product, ceiling mount assistant is such a good idea
Coming soon!
I'm on the waitlist and really looking forward to this hardware. You're doing an awesome job, thank you and best of luck! I do have one request/suggestion, as an electronics engineer it drives me insane when companies make stupid design choices for powering equipment. I have seen a trend toward powering sensors with USB power supplies, what are people thinking? I know it's easy and simple to use a USB power supply when many of the designs incorporate an ESP32 or similar inside and all you have to do is jam in a micro USB connector to power it but you have to think about the practical aspects of form and function. When you want to place a sensor like a millimeter-wave sensor or any other occupancy or motion sensors it's ridiculous that with so many products on the market now you have to use a USB power supply and then try hide the power supply and cable going to the sensor. What am I missing? I want a nice clean installation and not have a sensor on my wall with a cable running down to an electrical outlet where it's plugged in. In a perfect world the device would support PoE, not an adaptor that I saw mentioned in another post, you want it integrated into the PCB design. RJ45 connectors are, unfortunately, large and I concede that is not ideal and a challenge to keep the device form factor small but this hardware is going to be a little larger because of everything it supports so I feel a RJ45 connector can be accommodated. If PoE proves to be too much of a challenge then please, please, please make provision for DC power terminals. A lot of homes don't have CAT5/6/7 running everywhere but most do have basic, two conductor security wiring that you can send 12 or 24VDC over (5VDC not ideal over long, small gauge copper). I frequently replace old PIR motion sensors with newer technology and use the 12 or 24VDC that was previously powering the device to power the new hardware which then keeps the installation of the device nice and clean and aesthetically pleasing (no stupid power cables hanging down the wall). Thanks to PoE being a power and low latency data/network solution it is ideal but at the very least it would be nice to have flexible power options. A while ago I purchased an ESP32 PoE Development Kit (EST-PoE-32) from Everything Smart Technology (EST) and it supports PoE, USB-C and 9-28VDC for power, it is a great, flexible, little board and proof that it can be done. One final point I'll add to this comment, that has become rather long, I really like being able to power all my devices in my home with a single PoE Ethernet switch which means I only have to worry about a single power source that is plugged into a UPS and not dozens of USB power adaptors plugged in all over the home. Great solution to keep everything protected and operational no matter what happens with mains power. Keeping a spare PoE Ethernet switch also makes for easy redundancy in place of dozens of USB power supplies that easily have their cords pulled out. Okay, perhaps I went a little overboard making my point 😁.
Great comment. I hear you.
Here’s what is happening behind the scenes. Let me know your thoughts.
What you saw in the video is the “HAT” and “CORE” boards. Behind the scenes we have a third board we call the “SHOE”. This SHOE board is responsible for all the I/O connections at the bottom of the hockey puck enclosure (3.5mm headphone jack, USB-C, 30w PoE+, and the available GPIOs).
So if you’re running the CORE and HAT “naked” (with no enclosure) then you don’t get PoE unless you add-on the third SHOE board dangling from a ribbon cable.
Obviously this decision is being made so that all the boards can fit in the enclosure. I know this isn’t ideal for hackers but we’re trying to avoid two variants of the HAT.
Thoughts on this?
Finally. A local voice assistant that’s even better than amazons offering. It won’t be long before Amazon want to charge for basic Alexa so this is brilliant.
I hear rumors they're building a product internally they call "Remarkable Alexa" which is powered by their LLM in the cloud. Amazon will supposedly charge monthly for this. We'll see!
Sounds too good to be true.. I subscribed and will be waiting on new updates.. So far amazing job. Quick question? I know this is work in progress, but what's the chance of being able to integrate AI into the voice assistant?
Yes. The Sat1 will work with all of today's AI/LLM experiments. Set up a local LLM and connect it to HA (see HA's Ollama Integration) or use HA's OpenAI Conversation Integration to hook into ChatGPT (always be weary of connecting your home to any AI though, especially cloud based ones).
@@FutureProofHomes absolutely can't wait... Be steadfast and stay healthy.. We need more people like you in the world.. 👍
Fantastic project... I'm looking forward to the developments.
Thanks for staying tuned. I’ll keep sharing updates.
I'm looking forward to the day I can get rid of my Alexa devices. I know you can achieve local voice assistant capabilities with DIY solutions currently.. but I've never quite been satisfied enough from videos I've watched to actually try it.
Looking forward to seeing this idea develop! Subscribed!
Edit: I just went back through your channel and watched your video about local LLM and Home Assistant voice assistant. Yes, it did also blow my mind haha. I may give it a go this evening.
Thanks for watching and playing catch up on previous videos. If you've watched all the videos and read the website then you can see the bigger picture of what we're building. The bar is set high, but I want to build a really solid and reliable product here. Stay tuned!
Super excited about this 🎉🎉
Me friggin' too!
This is awesome! With something like this that's planned to be placed evenly all around the house I've always wondered if it could also be a Zigbee/Thread router as well? Google/Apple Home products are starting to add that in their satellites.
Zigbee/Z-Wave/Thread radios could definitely be added in later iterations of the product. It's on the list.
I would love to see this with an integrated millimeter wave sensor
Enclosure will have mmWave. And it's simple to connected mmWave to the HAT's exposed GPIOs.
LETS GOOOOOO!
Heck yea. Go, go!
lol sorry thought of another improvement. Me being passive house enthusiast.. I think you should make a mounting part where you can drywall the mount and then just snap in the satellite. That way we can make the device install easy and air tight between the living space and the attic.(if there is an attic above the room).. I would make a round mounting device with ethernet jack(Poe) so that above the device in the attic you just plug in the ethernet cord and on the other side (satellite side) the satellite just snaps to the mount. or we make the mount flush with the ceiling with mic holes.. etc.. either way.. We need to make sure when this is mounted it provides an air tight connection.. (safe for insulation..).. thanks :)
Check the roadmap. You're describing what we're building. :) ;)
Subbed & liked. Very interested in the final product. As someone who utilizes Google Home for Whole-Home Audio via Groups (Bluetooth in-wall receivers connected to in-ceiling speakers, connected to the Google Home via Bluetooth), I'm hoping this supports this sort of configuration. In addition, id recommend allowing the Assistant to respond on the same Bluetooth speaker too, as it's one major reason I love using the Google Home still during cleaning or kitchen work. I haven't messed that much with the AI in Home Assistant, but this is the sort of thing that may get me to give it a shot. I do use HA for pretty much all actual smart-home & automation tasks, but I have vocal search & music still on the Google platform.
Yep. My goal is to win over users like you with reliability and functionality. Stay tuned. I really want this tech too. So selfishly I'm building it for me and my customers too.
Congrats. I've managed to have a working and stable enough system with a Korvo and tweaking, but I really hope your project is gonna work and become the perfect solution, cause nothing is for now.
Yep. I also pushed the Korvo to its limits and bumped into those limits. Hence why we’re building this. Thanks for the well wishes!
@@FutureProofHomes Also, it might interest you but i've managed to make an reply function when the assistant (Assist in HA, with your A.I of choice) is asking a question. Basically, it checks the text of the answer and looks for a question mark. It works pretty well and avoids having to repeat the wake word (i don't know if your system has a solution like this).
Given how unique this product is, I reckon you would have a decent chance of a collab with one of the major channels like LTT. I know you're just as dev kit stage at the moment, but some of their best videos are when they are trying out new/not quite ready stuff. Linus often does 'upgrades' to his home system and I bet he would be interested in something like this. Defo worth an email I would think.
Our Sat1 enclosure should arrive in Q1 2025 and it gives the PoE connection. :)
I'm just thinking this device could be as an amazing all-in-one room device, including using it as thermostat... Not sure how feasible would be to install it in the wall. Thinking on it as you can use the Sonoff NS-Panel that come with European and American versions (for the standard size).... So looking forward for the development. I would totally install one per room.
Perhaps a few years from now we could have a high quality in-wall panel too. That’d be a fun addition to the ecosystem.
I won't by the dev kit but once you have a consumer version (enclosure and speaker) then I'm buying a couple
Totally get it. I’ll make sure we get there for you!
Flight enshittification! I'm all up to it!
Nice work!
Thank you! Cheers!
Congrats on the project, looking forward to seeing the next steps! What are you planning for power? PoE for the in-ceiling concept?
Yes, can connect PoE adapter to USB-C.
Nice! Now please find a friend in Europe so we can enjoy the ride to! Maybe team up with QuinLED?
We will be shipping to Europe upon launch and have inventory there. Shipping across all of Europe looks like it will be less than $10 and 3-5 business days.
@@FutureProofHomesthis is awesome news. Now this is a Christmas present I'll be looking forward to.
Very excited for this. It's exactly what I wanted and then some. I'd really like to see how you get responses faster from a local AI server. I wonder if there is a slimed down version. Where you can select categories of information. I'd be very interested what information you could pass from the web, like weather and air quality. Maybe that's just buikt into HA with other intigrations
Congratulations !!
Thank you! Cheers!
Heck yea! I'm excited!!
Thank you! Us too. :)
Can't wait to cut Alexa out of my life! Listens about as well as a teenager these days! Price is roughly what I would expect for a finished product, great to see a dev kit for a accessible amount.
We're really trying to keep the prices low, but we need to make some profit to keep the lights on and continue building. Keep in mind everyone that Amazon and Google loose money on their voice assistant hardware sales because they make money on the backend from your data. That's not the kind of business we're trying to run here so privacy and good hardware will cost a bit more.
Pls consider Australia as well...
Will do. We’re discussing this in discord channel. I’ll try and get logistics setup there.
6:38 ben jackson looks kinda familiar lol
Beat me to it. I was wondering if this was some sort of inside joke
@@paullees6687 definitely recorded before the website was finished. Picture is changed to the real Ben jackson
Lol read the other Bill Murray comments in the threads. It's definitely and inside joke. :)
POE would be ideal
agree. We'll have it.
very interesting, waiting for more updates about the hardware.
one question, are you using nvidia jetson nano for home assistant and openAI ?
the delay on the responses are very low, I am impress.
I running all forms of the AI pipeline in many places. What you witnessed in this particular video is me using the standard Home Assistant conversation agent (no AI) on standard server hardware (not Jetson).
Nice can't wait.... Will it be able to play a music playlist by voice per unit, pause and play by voice
Yes! Short set up time, but yes!
Excellent.
Thank you! Cheers!
This is really cool, I would love to review this on my channel!
Hey Simon! I enjoy your channel too! Would be happy to have you review this. I’ll reach out when the time comes to help get one in your hands. Cheers!
@@FutureProofHomes Hey there Brad! Fantastic thank you so much that would be awesome! You are killing it!
I'd suggest making the waitlist link clickable. It took me a second to find the link in the description and then it required a copy and paste.
Done! Thank you for heads up.
This looks really nice. Looking forward for what's to come in the future! Any reason you went with an ESP32 chip instead of something that could run on-board wake word like a Pi Zero? I know Micro Wake Word is now a thing but can an ESP32 do multi-room audio, audio ducking etc? Is it running ESPHome?
Our Hat board is compatible with RPI Zero. I’ll demo this in upcoming video. Basically we’re platform agnostic and this could be a great Wyoming Satellite too!
this is fantastic! Congrats!
Thank you so much!!
Is there a way to presence detection without bluetooth? using 5mm micro wave sensors?
Yep! See all the other comments. :)
Very cool 😎👏🏻
Thanks for the support @romanbauer!
I'm hoping this works better then my home made one... HAHAHHAHAH Can't wait!!!
Yea, I made my own homemade ones too. This will definitely outperform those DIY projects. :)
Wow. Can’t wait. This is so what I was looking for. Any thoughts on maybe making it POE so if we want to mount it in the ceiling?
Yep. We will have small USB-C to PoE adapter.
Imagine a mic speaker lights and presence sensor and Poe Ethernet. Then put one in the ceiling of each room. And get all talk to home assistant.
That’s exactly what we’re imagining/building. :) it’s time!
@@FutureProofHomes excited
If the ESP is robust enough (I wouldn't think it is long-term), my only other request is PoE. Especially for ceiling mounting, USB is generally a non-starter.
PoE is possible now. Sat1 will support PoE. :) :)
Hell ya
Ben Jackson's Photo is Bill Murray
lol! It’s updated now. :)
Ben didn’t give me his photo before I filmed the video. So that was his punishment. :P
Now that's interesting, I would never have an internet connected home control system, it's just too open to abuse, but this may just tickle my fancy.
I don't think the big-tech companies will ever give us this type of offline voice solution either. It's just not in their DNA. People want it though! So here we are...
This seems pretty much identical to the ReSpeaker mic array boards, just with an ESP32 inside. Seeed never delivered a firmware with working beamforming for the XMOS IC, let's hope this guy does better.
If we're thinking of the same ReSpeaker, then the Sat1 should be quiet a bit more versatile and powerful. e.g. Has better audio processing, music streaming, bluetooth presence detection, extra sensors, etc. Not to mention this will work with ESP32 and RPI. :)
The integrated ESP32 and the resulting form factor is very nice for sure. But for me a voice assistant gadget hinges on rock solid speech recognition (mainly wake word but also STT) no matter if there's music playing or water running in the room. The ReSpeaker didn't have that, despite also using an XMOS chip, that's why I'm having reservations if you can do it. (But very much hope so!)
I signed up for the waitlist. Will you ship to Europe too? I hope so. It would be a nice Christmas present 😍
Yes of course! Shipping to Europe too! :)
@@FutureProofHomesawesome 😍😍
This is quite cool! So... will it be able to be powered by POE, or just the USB-C options? I like the concept of in ceiling installation and running another POE Cat6e cable is so much easier than running a power outlet!
When the enclosure comes out in Q1 it will have a PoE connection.
@@FutureProofHomes Beautiful! Thanks!
Looking forward to throwing my money at you. Surprised it's not already out by someone else.
The race is on now. You’ll probably have lots of options soon. Hoping to build the best product.
Can you think of competing with Movi Audeme on this? It hasn't had an upgrade since 2017. Can the voice be tinkered with an oscilloscope. Still have it be able to work with an arduino, stm32, or rpi5? 😊😊😊
Want it right NOW
Working as fast as we can! :)
Have you made an initial estimation of the price, with the case, speaker etc?
It might be worth to have two versions, one simple, (only speaker) and a second one with all the sencors/features, just for the sake of diversifying the product line (...just saying).
What is the alternative to the ceiling mount kit for renters that can’t mount to the ceiling?
Noice. On the waitlist.
Just wondering, given the shape, would this maybe fit into a Google Nest mini shell? I'm guessing it's probably bigger though 🤔
Actually. It might. If I remember correctly, the hat is 3.14 inches in diameter. I’m curious what the Onju voice is.
signed up so looking forward to how this goes forward... I'm curious which mics are on the board?
I know you have a 3.5 to connect external speakers but I would prefer not to run wire (whole home audio amp in basement), will we have the ability to still modify the yaml in the esphome setup of the device so that I can set the output speaker to a home assistant media player? I currently have some m5 atoms that do this by specifying VLC media player ironically which is hooked in as a source to my whole home audio (already have speakers in many rooms throughout house) through my home assistant server. I use the on_tts_end: and on_tts_start I specify the entity_id of the vlc media player. The m5s work pretty well but the accuracy is very hit and miss as far as hearing you and they definitely can't hear you if other sound is going on in the room. The device looks awesome by the way and good luck with the launch!
You will absolutely have the ability to modify the ESP32's YAML to output audio another media player of your preference.
this is awesome and can't wait to try it out. I think you did say there was a plans to maybe add a case for if ??? I plan on using home assistant to replace all of my echos in the house ( one in every room), one thing that was asked on my by mom and wife is can this have a clock on it, so that is my request is can you try and add a clock
Clock capability (and timers and alarms too) are already there (thanks to the Home Assistant team).
Enclosure is early 2025.
Amazing work. Wish you all the best. But it's not for me...
This looks really cool! Any plans to integrate mmWave presence sensors into this and open sourcing the software? Thanks :)
Yep. mmWave will be included in the enclosure. Alternatively, you can use the PCB kits exposed GPIO and quickly connect a mmWave sensor.
Firmware and hardware will be open sourced too. See the website and GitHub for all details. :)
Looking forward to this! Is there going to be a software disable mic feature? That's my biggest gripe with existing smart home speakers. I want to be able to control when to have the devices listening. IE: If I'm not home, I want the mics disabled and hardware button won't override the software disabled.
Yes! Software and hardware mute.