Hands down the best and most comprehensive and usable instruction! I am using exactly the same software setup except not on Docker and it took me weeks to get there, The maker community owes you big time Andreas! Thanks Greeting from 🇨🇦 and hope to see you someday here!
It took the team also quite some time to get it to the current status. But now we can profit. I planned to come over to the Supercon in Pasadena. But it seems not to take place. Maybe next year...
There are also options to set primary storage to one of the many s3 compatible buckets like MinIO, wasabi, digital ocean spaces,... So basically you can have a nextcloud instance with an infinite storage volume in the cloud. Wasabi is at 6$/month for 1TB and free ingress/egress. We run it here at office like this. I never have to worry about disk failures, backups of my nextcloud etc... Because all my data is already in a replicated cloud storage. Nextcloud hosted locally on my Pi4 just provides me a local and fast web interface
Thank you Andreas, this was exactly what I needed to hear. You presented the red thread to start with and showed what more possibilities one have. Great work!
@@AndreasSpiess Hi Andreas, I was told to contact you via leaving a comment under your UA-cam. I want to know whether you are interested in SONOFF smart home products? Please let me know whether you are willing to test SONOFF? Thanks for your answer.
Hi, you may have a look at my easy install script for the Raspberry Pi. With it you can install HomeAssistant, NodeRED, Nextcloud, Grafana, PiHole, IOBroker, FHEM, OpenHab etc. with one shot and also remove it again. You find it on my channel ( The ei23 Open Source Smart Home Installation Script )
Or HoMaHA. Sounds like Chinese. But is British! Just returned from an extended Bicycle tour with my "ghost". Because we also use e-bikes I thought about your videos during the journey.
@@AndreasSpiess Sounds good although I avoided some of the cruder options that came to mind. Just added a second 1kW hub drive - so now have both wheels powered now. Great torque but it's really heavy. I suppose a ghost is so light that it must achieve many kilometers on a single charge.
Vielen Dank Andreas! Ich (15) habe ewig lange versucht NextCloud auf dem Pi zu installieren und habe es nicht hinbekommen. Dank dir habe ich NextCloud und noch "ein paar" mehr Sachen😉. Vielen Dank!🤗👍 Ich verfolge deine Videos schon lange. Sie sind immer informativ, lustig und kein Fake. 👍😂
Hi Andreas, it is very astonishing how often you meed my needs with your topics! Thanks for your rock solid work, you bring professionalism in my hobby.
How do you always know exactly what I've been looking for? No internet cloud, no service fees, total independence, and perfect hardware (that you've previously convinced me to purchase ;)! Rut-roe, now I need to change my underwear!
@@AndreasSpiess If you do a video about NextCloud, could you please also cover the drive redundancy (e.g. OpenZFS) as well because safe data is the biggest reason to have a private cloud?
If I had this video 3-4 weeks ago I would had saved a lot of time :-) I have been working with a similar project for few months now (yes, I'm slow....). As a beginner I find this IOT thing to be nightmare to figure out. There are so many applications and solutions to figure out, it's a real challenge to figure out what all of these applications do and in which order to start. After a lot of searching I choose to start with Home Assistant on a Raspberry PI 2 (it's a little slow but it works), installed Node-Red, Mosquitto MQTT Broker, InfluxDB, and Grafana and also installed support for these applications in Node-Red included support for IFTTT. As a sensor I use a BME280 connected to an ESP32 and it was fairly easy to add MQTT code to send sensor data to MQTT broker, I send raw data and do not convert to JSON, I use a connected Nextian display to display this data and chose not to use ESP Home (ESP Home will give you the option to update ESP code over WIFI). When I figured out how to configure Node-Red it was fairly easy to get data from the ESP32 -> MQTT Broker -> InfluxDB -> Grafana. In Home Assistant everything is "boxed in" so it's easier to configure (maybe) but using docker will probably give you more options (maybe). I will need to get me an Raspberry PI 4 and try out this docker approach.
You came already a long way. So I assume you by now have enough know-how to do the right decisions. Or at least to continue experimenting till you have found it.
Thank you for this phenomenal walkthrough of using Raspberry Pi 4 as a Home Automation Server. This opened me up to build it myself rather than buy retail products that unfortunately are very limited or cost a lot.
Great video Andreas, I follow your post all the time, really surprised there was no mention of Domoticz for home automation, been running this for years and it's a very good platform. Keep up the excellent work!
@@AndreasSpiess It's still very popular and being worked on constantly, beta version gets updates every few days. Have you seen the rpitx project, I use this, well just the pocsag bit of it to send critical alerts to an old radio pager from my home automation, works well for local (a few hundred metres) range.
4 роки тому
I also like domoticz because lots of functions can be implemented in one system. There is a PR for domoticz: github.com/SensorsIot/IOTstack/pull/5 I have not tried it but it looks working.
Dave Wright I am using Domoticz myself, and for me it’s a very good platform. Get all I need in one package, though there is some programming needed inside Domoticz to make it work. The Domoticz forum has been helping me a lot. Best regards Ulf
Andreas, I love your videos and they have all been super helpful to help me learn programming. I am very grateful for your dedication to getting them so well produced and your attention to detail. I just wanted to say thanks, so much!
This is brilliant work! A big thanks to you and the opensource community. I was surprised to find out how easy it was to set things up and how efficiently the dockerized environments are using the resources of a "humble" pi. Running 12 containers (including unifi & LOKI that I added myself) all running smoothly from an SSD. Thanks again!
I'm really sorry for giving only one thumbs up. Very great guide! I'm using similar set up, but I prepared d.compose file manually. And with a good knowledge in Linux and docker it took me a while. Great job!
Dear Mr. Spiess. You are amazing! I've been doing arduino for quite some time now and failed miserably at installing Pi-Hole on an old BeagleBone Black that a friend gave me, but you gave me the motivation to dig deeper into debian and linux and the whole Raspberry Pi topic! Thank you very much for the much needed inspiration! Greetings from Austria!
I just bought two Pi4s to retire my Pi3s.... I agree on your argue ;-) Next Cloud sounds interesting. I am somehow missing IoBroker besides FHEM, OpenHAB and Home Assistant. Cheers from Bulgaria
So far you are the only mentioning IObroker in the comments. I did not hear a lot about it recently. So I do not know how active this project is and how much it is used. I hope everything is ok in Bulgaria. I still remember our last year's bicycle tour...
I do not know how many users which System has. I know someone who uses Fhem, i myself tried OpenHAB, was not totally happy, then i tried IoBroker and am really happy with it right now. If you look at the developement right now, there seem to be a lot of activity. But i do not know and do not judge. If i would not be happy with it i would probably have tried homa assistant, so i have no own experience with it, but it also seems to be a great system. So may everyone use what fits best for him. Here in Bulgaria everything is fine. I have so many fresh things to eat, including different melons, figs, pears and other delicious things i did not have in Germany. I had a reaaly long lasting summer with almost every day blue sky, and the hot temperatures here are much more tolerable due to the low humidity, and there ist mostly a slight breeze too. And as you can see, still a lot of work left for the next years... ua-cam.com/video/fck1ndIKOZg/v-deo.html Today i connected the newly built garage to the network, the garage doors were installed last week, and we had a big party at the weekend :-) Slowly progressing, but no need to hurry :-) And hopefully i will start to find the time to produce some videos... All togehter, i am just happy here. At the moment, home brewed Weißbier is available ;-) So all the best wishes to Switzerland and cheers from Bulgaria
Nice video! I thought you moved there for retirement ;-) It is very different to here. But if you have internet you have lots of possibilities. A lot of open space. But for sure a lot of work. Prost aus der Schweiz!
I use openHAB for years now and it works really great for me. Great integration and customization options. Version 3 will be much more user friendly and even allows you to set up nice dashboards with a lot of statistics, even on your phone.
Well done. Your first video about IOTStack was creating a "oh, look whats possible" in me. With this new one I understood the concept and can go further. Thanks a lot, Andreas.
I've been looking for a simpler alternative to Home Assistant since I really just use it as a clunky MQTT and node-red server. This is perfect! Looking forward to adding the database and grafana components as well! Thank you!
What a great video. I'm going to have to watch it again a couple of times, stopping and starting, to absorb the quantity of info you have packed in here!
Just simply amazing! The combination of cheap hardware and software thats available for free. Thank you for the tutorials and for those that have taken the time to develop these.
I'm so ancient. Trying to remember if the first CPU chip we got in for fixing in our 70s typesetters was the 8008 or the 8080; I think it was the 8008. Before that the CPU was composed of hand-wired plug-in TTL chips on 8 boards plugged into a backplane, and we troubleshot to chip level. Some "good old days"! And now I get to use a Pi to turn my boat into a watchdog pet that knows how to get around in the world and can talk to me privately from anywhere. Thanks for the help Andreas.
You find a 8085 project and wire wrapping on this channel if you want. But I do not miss the technology of the old days. I love the possibilities of today and the prices even more. 1GHz is like DC was in my youth. I built a satellite ground station to talk via a geostationary satellite for less than 500 dollars, a vector network analyzer for 3GHz for less than 100 dollars, and a lot of other gadgets. I am old, but still like this situation :-)
@@AndreasSpiess It is all quite amazing. I did like the challenge of discovering which chip had failed versus just changing cards to fix things, but I've not done that for decades. I've been learning the latest stuff vicariously through people like yourself for years but am finally in a position to start experimenting with it all for real. Very much looking forward to it. Thanks for the reply, appreciated.
Wow, this is a LOT of useful information. I am wanting to break free from ifttt and other outside servers for my automation needs and just starting to look for alternatives. The sample project you showed is exactly what I would like to start with. I was also looking for a sensor that measures light, now I have a reference to look into. Thank you so much.
Cool stuff. This setup is evolving nicely :) I'm eager to see how far you can get. In the tech world it is too easy to be stuck in a perpetual habit of installing and setting up. Keeping large polished projects current, constantly updated and fresh with newness is the mark of a true master. You are doing well
For this video I updated my productive Pi running one of the first IOTstacks to the newest one without any issues. Docker seems to pull a relatively new version every time you start it.
I love using the raspberry pi 4 for hosting webservers and home automation systems - if I need more power I just bike down to Akihabara and pickup a few more. It is especially nice that they work with PoE!
@@AndreasSpiess oh by the way I saw an article posted just the other day on enabling TRIM on external SSDs connected to the raspberry pi 4. It might be interesting to take a look into it if you haven't already: www.jeffgeerling.com/blog/2020/enabling-trim-on-external-ssd-on-raspberry-pi
I've been thinking about migrating my home automation from SmartThings over to something a little more flexible if I want to build my own sensors and devices, and this is just the video. Thank you!
Great video, as always. One tiny little point that has nothing to do with your great content. Just an English vocabulary tip. It’s not “vibrating” community. It’s “vibrant” community. Thanks for all your hard work!
Really happy you did this video. I just got a new Raspberry Pi 4B and it is going to be dedicated to home automation. Excellent job explaining how to do the setup. Just need to figure out which sensors I want to use. Thanks.
Hi Andreas, I planned to go on holliday but now I'm too excited to get IoTstack up and running. Perfect timing and perfect topic. Cheers from Switzerland
This video is great, covers the software side brilliantly. I would have appriciated more hardware overview/setup in relation to what has been set up on the software side. I will check out your older videos, just incase you have already covered this aspect.
Andreas my brother with that crazy Swiss accent... I'm so very glad 2020 is continuing to treat you well!! Just wanted to wish the best of wishes to you and your family well for the rest of the year!! Lets hope this insanity is mostly in our rear view mirror now...
Make sure that no-one tells our Swiss guru that he should have described the Discord community as "vibrant" rather than "vibrating" at about 10:00. Keep up the good work, I am sure that technical instructions sound more convincing when presented in a Swiss accent.
Just as a note: about 3 months ago Home Assistant was all renamed. Hass.io is now just called Home Assistant and the core version is now called Home Assistant Core. :) The SD Card was always the killer with Raspberry installations. The Raspberry 3 and 4 with SSD makes a huge difference. Obviously the 4 is better, but even USB 2 (450mbps speed) is better than an SD Card. I agree with all the points here. Unless you have an always on PC that runs VM's for your sensor stuff, a Raspberry Pi 4 is very cost effective and quite powerful. Thanks for the great review.
Great video Andreas. I've been working on concepts and prototypes for a few of my own IoT devices and yet had not really given a lot of thought to how to control these centrally, so discovering this video was very useful for me. I did think about buying a Pi4 for this purpose and still not happy about the lack of native boot to SSD (as well aware of the SD issues) , so (despite your excellent video on how to do this) have decided to wait until a Pi version is released that solves this issue out of the box. So in the meantime, as I already have a substantial Linux home server (that I have many VMs on for my day job), decided to install docker (this is new to me - looks fabulous) and install Graham's amazing IOTstack set-up. After a bit of tweaking with the docker config, have it mostly set up though going to have the databases stored elsewhere on the server so they get picked up with the database nightly backups for other applications running on it. Thanks for this and all your great stuff. Am working on my own version of a Google Nest at the moment as found the Nest too limiting for what I wanted to do. Also my own version of the Internet Radio that you covered in an earlier video.
The Raspberry Pi has now SSD boot in its standard distribution. So no big problem anymore. Just update the EEPROM of your boards. I assume the newer boards will come with this version in the EEPROM. But it will probably take a while. Good luck with your two other projects!
This is a very important video for me. Now it may start to make sense to drop my vps and host everything in-house. Only two things need to be sorted before. The first is easy and it's related on how to redirect my own domain to my dynamic home ip address, and the second one is currently on-going and it's related with the pi4 ups. It has been a long running since pi1 and the lousy unreliable sd cards. Andreas, thank you for your valuable knowledge share through this journey
thank you for this. i have been playing with arduinos and sensors for years, but never got into pi. now, i see a neat way to tie everything up in one package.
I have this stack in a production docker server in the company, so powerful to automate the network and also quickly deploy small developments. For example sensors for kitchen fridges
OK, so this is very good but I am struggling because this is new and the format, of the super script, has changed a bit plus, and this is the big one, Docker is very new to me, my first attempt but, I am having "fun!" I am learning a bit, realising that I don't know a lot. At the end I will hopefully reduce the number of physical raspberry Pi I have and have a better backup and update system in place. Please do not stop these videos, always a pleasure to watch and I am getting better, Thanks.
Great work to put all this together. I'm happy to learn that I have done all the steps until Grafana. It seems I'm going in the right direction. Thank You!
Good video. Been learning much from you over the years. I have been using Raspberry pi and containers to control my frame irrigation operations. Not only is the raspberry pi great at home automation but it is great for high end irrigation control of io devices like plc's or mqtt devices. I do not use the raspberry pi to make hardware measurements as there are cheap regular and arduino plcs to do this function. I was forced to have multiple raspberry pi's in the docker based control system. I was forced to developed a "kubernetes lite" to control the individual nodes running containers. If IotStack does not have this feature, then it will in the future. BTW, for 5 years I have been using Redis as my central db instead of MQTT. Redis allows my python programs to store data in the native form of python objects like dict, lists and sets. There is an Arduino library for Redis. ( I had to slightly extend it.)
Thank you... I've been wanting to buy a full spectrum light sensor for our plants in a sun room to simulate full sunlight from light spec. filtered out through windows.. I built IR, UVA, RGB into one panel so now I can integrate what you've done to figure out difference... great job
Thanks a lot, Andreas. Yet another awesome video, and just in time for me: I'm planning to reorganize my Raspberry Pi which is running Home Assistant to have it on Docker, and this video was very useful, specially the info about iotstack. Until today my plan was to install Docker manually and then Home Assistant, and imagine something for data backup. You gave all info in a single video! Just as a info, I run two Raspberry Pi for my IOT: one has a SSD and runs Home Assistant and have digital certificates to be reached from internet, and the other has Mosquitto, Node-RED, Influxdb and Grafana, and it's connected to a large HDD. I did like this in case I crash Home Assistant server, I would be able to use Mqtt and node-red directly to control my automation. In the other way, if I crash Mqtt server, I can point Home Assistant to its own Mqtt while I fix things, and I will just lose some logging data in Influxdb and Grafana. Again, thanks a lot!
That really sounds great! I would like to know more about how that works but I am just getting started and I'm sure it gets complex quickly. So you have a duplicate MQTT on your HA server that is dormant most of the time? Or is it different? Same with node-red?
I never had an issue with a Pi so far. Just with programs on the Pi. That is why I do not have a duplicate setup. It is also not so easy for me to change the MQTT broker because I use static IP addresses on the sensors... Maybe I do once a video with Kubernetes to create a redundant Pi...
@@RTmadnesstoo actually, not installed in the Home Assistant server but I can install, copy configuration (I have a backup) and get it running in minutes, maybe within one hour. My fear is related to some big crash either on Pi or disk that would incapacitate it for long term. So, having two separate hardwares seemed safer for me, but maybe it overkill.
@@RTmadnesstoo I forgot to mention Node-Red: it's not redundant, I have it only in one hardware, but in my case it only collect data from some sensors and I have some flows I can use to turn lights on/off, so it's basically something I can use in case of trouble with hass and the sensors reading are not critical.
@@AndreasSpiess you're right Andreas. I burned one pi zero, but it was fully my fault when I was starting with it. But I had some crashes with sd cards corrupted after power outages and I spend some time to redo everything with my family complaining about it ☺️. Then I started to organize backups, did this separation of hardware, and finally moved to ssd, basically protecting everything from my own bold tinkering. ☺️
@@AndreasSpiess Agree with tzoumaz! However, I am new to docker and container/volume management. Since HA is not in the "IOTstack" stack, it does not appear to be part of the backup solution provided in IOTstack. Or am I missing something? Should I just use Docker to backup my HA configuration and then offload it to the cloud (e.g. gDrive/DropBox) using a cron job? Thanks again for the awesome vids! Learning a lot from you Andreas!
One comment about that type of black aluminium case - if you depend on wifi rather than Ethernet for connectivity it helps a lot if you point the side with the wifi antenna directly towards your access point. It's the side opposite USB ports. The antenna is tiny-tiny and with the metal case around it it's not exactly omnidirectional.
Agree, I am running Docker with influx, grafana, fhem, and also Home Assistant and ioBroker for tests on one Rpi4. Works perfect Boot from SSD. 433Mhz and zigbee interface...
This is exactly what I've been looking for. Got a Pi4 8GB a few months ago... running pi-hole and shinobi, but want it to do more, but also want the flexibility to add and remove things cleanly as I try them out. Docker sounds like a perfect fit for this. Also something more centralized for home automation instead of a bunch of different apps on my phone sounds nice.
First, thanks Andreas for your very informative videos. Agree that Pi4 makes for an excellent home server.... and although I started with your original IOTstack video, I decide to deviate a bit from it along the way... so just commenting today to share my experiences on the subject in case they are of value. I have been running HomeAssistant on a dedicated Pi3 for years with excellent results... Not sure if you are familiar with HA, but one excellent thing about it is that it has great plugin ecosystem already built on docker... so if you run HA, you can add plugins for things like NoteRed, Influx, Grafana, Plex, Mosquito, Dorpbox backup and probably 100 more.. Surely almost all the components in IOT Stack and many more.. All plugins are tested, get regular updates, get automated backup etc.. all those services run as independent containers and you get access to them from within the HA UI, but also via the designated port (same as IOTstack) for general use. But on my pi 3 it was still a dedicated (HASSOS) server, and with no SSD. So seeing you original IOTstack video, I decided to try it out, to test if I could use a Pi4 for the server, and also as a general purpose Raspbian desktop... Sooo, to make the story short, I followed your IoTStack instructions to start my server.. but only installed Portainer (not sure why) and Home assistant... all the other server components I kept as plugins within HA... (Portainer could be too...cannot tell you why I installed it form IOTstack). It was a simple 5 minutes restore of a backup form my HomeAssistant install on the Pi3, and voilà... All containers were up and running on the Pi4. A month later, on top off all that I went on to manually install an Octoprint container to manage my new 3d printer. So now I have a Pi4 (4GB, still booting from card but running on SSD) running: - Home server based on Home assistant, with some 30-40 sensors, cameras, etc around the house - Full stack of required services including, mosquito, NoteRed, WireGuard VPN, Nginx, Influx,, Grafana, etc, all running as HA plugins - Octoprint (with 15+ plugins of its own) to manage my printer, including streaming video and other services. - All running on a full Raspbian that I can still use as my lab desktop for simple tasks like surfing the web, play music, check email and even youtube when needed. The pi4 needs a small fan (quickly overheats without it) but manages to stay below 60 degrees most of the time. This setup has been running for almost 8 months now I think.. No real issues so far (in fact HA has been much more stable with the SSD as data repository). And as a side, I get to experiment a bit with docker and dip my toes into Linux, which is a real side benefit... Happy camper!!. You are certainly correct: Rasppi4 with Docker is the perfect solution for a maker's home server. And the vibrant community (including your videos) provide a lot of help in making it happen. All the best.. keep it up.
Excellent video! I have flashed a smart TV Box with linux and installed node-red, openmediavault and nextcloud. node-red is great and has got a lot of drivers and libs. The GUI is shaped by the programmer. For low effort you rather use the standard dashboard components of node red. If you are willing to spend more time and effort, you may use sockts.io and create your gui as you like. I prefered a smart TV box, since it has got an EMMC flash with faster memory access as with SD cards . Most of smart tv boxes have got 2GB-4Gb of RAM and more. beside you get they in a case and with power supply and are at similar costs as the Pi4. In the moment I have got the H96 pro+ equipped with Amlogic S912 Octa-core. Having all the applications mentioned above and a comprehensive selfmad smart home application (curtians control, garage gate control, NVR, telegram, Zigbee devices, presenence detection, lights control, room T° H% and pressure sensors, doors and window sensors, power supervision) the smart tv box runs @5% average load@32° cpu temperature. I admit I would have spent less time for the whole development and configuration, if I had used the Pi4, but at the ende the effort paid off! Next project: upgared to Beelink GT-King Pro 4GB/64GB Amlogic S922X-H add heating control and AI
Thank you Andreas - a brilliant video. A lot of UA-cam videos have to be speeded up so as not to waste our time - yours is just the opposite - so much information that I would need to slow it down to set up such a system. I already have a 'Wireless Things' OpenPi (now unfortunately liquidated) which uses the original RPi compute module, and this streams low power wireless and some one wire temperature sensors readings to Initial State. If I wanted to extend the system, I would certainly consider what you have told us here.
You are welcome! The advantage of UA-cam is taht you can stop and rewind. At least that is what I sometimes have to do if i did not get it the first time ;-)
Great video, it proves to everyone that it's possible to have advanced home automation with "NO CLOUD" solutions. Maybe in the future big companies will provide us docker images, where we control outgoing ports and know which data is stored where ? Isn't it our data after all ?
AFAIK docker is well accepted also in the industry. Especially to deliver complex software stacks. Controlling ports is probably not on top of their list... But I am sure it can be done by having a small interface outside Docker which communicates with a protocol like MQTT.
This is an awesome video. I now run Pi3B as Homeserver. I already planned a change to Pi4. The pieces are already lying around. Not yet able to start the project because of lack of time(learning Flutter/Dart,MSFS2020...), but that will come in the coming months.
Flutter seems to be worth the effort ;-) Concerning migration: I migrated my home automation server from my old setup with SD card / SSD to the new and pure USB boot. The whole installation with the newest IOTstack project took a few minutes, and I transferred the directories using a memory stick in another few minutes (I am a Linux noob). Started the Pi and everything worked. I found this quite cool. Expected more issues.
I bought a Pi 3B+ recently for 3D printing but started to explore the other possibilities as well. I picked 3B+ model as I presumed it will be good enough for my needs but I don't know how will it perform for home automation task? Very well made video, really easy to follow, thank you!
Thank you for this project. I now have 3 iotstack setups running in my families homes on 3b+ using SanDisk sd cards. One thing I'd suggest - test your backups actually work! Had one sd card go bad when it got water on it.....
Bad luck :-( I thought SD cards are waterproof. I used the backup file to migrate data. So at least one direction worked. The restore currently is not scripted.
@@AndreasSpiess I used to to work in the IT field and through experience, thankfully not my own, I came to realize that a file isn't backed up unless you know that it can be successfully restored. Just having the backup process return no errors doesn't necessarily mean that it was backed up (depending on the backup mechanism) or that you will be able to restore anything (maybe you make a big archive file storing the important files but your drive doesn't have enough space to hold it in order together the files you want from it if you are doing something very simple for backups). I also learned, from something that I had to fix, when mounting drives or network shares onto the the root (/) directory in a UNIX-like OS ( such as Linux, Raspbian, Solaris, BSD, etc) then name the mount point something that comes alphabetically after dev. That way if someone comes along as the user root and runs the command "rm -rf" in the directory / the files in /dev should be removed first and the system won't know how to access the files in later directories. (Actually it will fail sometime as it's deleting files in /dev .) If the mount point is named something so that it comes before /dev then the files will be deleted.
Thanks Andreas another great informative video. I’ve been using OpenHAB on an RPi 3 for some time with almost great success. I get an occasional lock up which I cannot attribute so assume it is SD card corruption. I have an RPi4 all setup ready to go and will now add SSD.... as soon as I get that pesky DIN rail mounting sorted out!
Vielen Lieben Dank für das tolle und informative Video. Das hat mir einen guten input gegegen welche OpenSource Tools es gibt und werde mich mal mit dem ein oder anderen auseinander setzen. Weiter so! Viele Grüße in die Schweiz :)
Hands down the best and most comprehensive and usable instruction!
I am using exactly the same software setup except not on Docker and it took me weeks to get there, The maker community owes you big time Andreas! Thanks
Greeting from 🇨🇦 and hope to see you someday here!
It took the team also quite some time to get it to the current status. But now we can profit. I planned to come over to the Supercon in Pasadena. But it seems not to take place. Maybe next year...
Amazing, thanks Andreas! A video on NextCloud and how to use a big storage HDD on your Pi4 server would be very interesting!
There are also options to set primary storage to one of the many s3 compatible buckets like MinIO, wasabi, digital ocean spaces,...
So basically you can have a nextcloud instance with an infinite storage volume in the cloud.
Wasabi is at 6$/month for 1TB and free ingress/egress.
We run it here at office like this. I never have to worry about disk failures, backups of my nextcloud etc... Because all my data is already in a replicated cloud storage.
Nextcloud hosted locally on my Pi4 just provides me a local and fast web interface
Noted! And thank you.
Thank you Andreas, this was exactly what I needed to hear. You presented the red thread to start with and showed what more possibilities one have. Great work!
Glad it was helpful!
@@AndreasSpiess Hi Andreas, I was told to contact you via leaving a comment under your UA-cam. I want to know whether you are interested in SONOFF smart home products? Please let me know whether you are willing to test SONOFF? Thanks for your answer.
Hi, you may have a look at my easy install script for the Raspberry Pi.
With it you can install HomeAssistant, NodeRED, Nextcloud, Grafana, PiHole, IOBroker, FHEM, OpenHab etc. with one shot and also remove it again.
You find it on my channel ( The ei23 Open Source Smart Home Installation Script )
I didn’t had the intention to implement a home automation system but you really got me hooked up! Thanks for it!
HMHA - Home Made Home Automation - everything in our control, just the way it should be and another acronym to join the list.
Or HoMaHA. Sounds like Chinese. But is British! Just returned from an extended Bicycle tour with my "ghost". Because we also use e-bikes I thought about your videos during the journey.
@@AndreasSpiess Sounds good although I avoided some of the cruder options that came to mind. Just added a second 1kW hub drive - so now have both wheels powered now. Great torque but it's really heavy. I suppose a ghost is so light that it must achieve many kilometers on a single charge.
Vielen Dank Andreas! Ich (15) habe ewig lange versucht NextCloud auf dem Pi zu installieren und habe es nicht hinbekommen. Dank dir habe ich NextCloud und noch "ein paar" mehr Sachen😉. Vielen Dank!🤗👍 Ich verfolge deine Videos schon lange. Sie sind immer informativ, lustig und kein Fake. 👍😂
Danke für dein Feedback. Ich bin froh dass es jetzt funktioniert!
Hi Andreas, it is very astonishing how often you meed my needs with your topics! Thanks for your rock solid work, you bring professionalism in my hobby.
Thank you for your nice words!
Your constant effort to teach people is what i like most..
Your knowledge in this is like deep like well...
Thank you for your nice words!
How do you always know exactly what I've been looking for? No internet cloud, no service fees, total independence, and perfect hardware (that you've previously convinced me to purchase ;)! Rut-roe, now I need to change my underwear!
If that's what you want, you should also have a look at the Rhasspy-project.
@@hugocoolens Thank you for the pointer. I'll check it out. :-)
Would love to see a next cloud video, you always explain things so well 👍
Noted!
Hi Andreas, many thanks for this article.
Why not using a 64 bits OS for the RPi4 ? It seems it could be usable.
Sorry for my bad English.
@Hans: It is not official and creates only problems with incompatibilities. It also has no advantage for this application.
@@AndreasSpiess thanks would really appreciate it if you could produce a video. its a great software package if you deploy it properly 👍
@@AndreasSpiess If you do a video about NextCloud, could you please also cover the drive redundancy (e.g. OpenZFS) as well because safe data is the biggest reason to have a private cloud?
Andreas, you are simply superb !! One of my best technical mentor..
Fortunately I have a lot of help by knowledgeable people...
I'm 65 retired in usa,, Arduino for yrs,, but your way ahead of me,, Great videos !
I always will be about one year behind you ;-) Enjoy these tools! We live in a good time for electronics.
If I had this video 3-4 weeks ago I would had saved a lot of time :-) I have been working with a similar project for few months now (yes, I'm slow....). As a beginner I find this IOT thing to be nightmare to figure out. There are so many applications and solutions to figure out, it's a real challenge to figure out what all of these applications do and in which order to start. After a lot of searching I choose to start with Home Assistant on a Raspberry PI 2 (it's a little slow but it works), installed Node-Red, Mosquitto MQTT Broker, InfluxDB, and Grafana and also installed support for these applications in Node-Red included support for IFTTT. As a sensor I use a BME280 connected to an ESP32 and it was fairly easy to add MQTT code to send sensor data to MQTT broker, I send raw data and do not convert to JSON, I use a connected Nextian display to display this data and chose not to use ESP Home (ESP Home will give you the option to update ESP code over WIFI). When I figured out how to configure Node-Red it was fairly easy to get data from the ESP32 -> MQTT Broker -> InfluxDB -> Grafana. In Home Assistant everything is "boxed in" so it's easier to configure (maybe) but using docker will probably give you more options (maybe). I will need to get me an Raspberry PI 4 and try out this docker approach.
You came already a long way. So I assume you by now have enough know-how to do the right decisions. Or at least to continue experimenting till you have found it.
Thank you for this phenomenal walkthrough of using Raspberry Pi 4 as a Home Automation Server. This opened me up to build it myself rather than buy retail products that unfortunately are very limited or cost a lot.
The Raspberries are very good for such projects. And there is a lot of software available for them.
Great video Andreas, I follow your post all the time, really surprised there was no mention of Domoticz for home automation, been running this for years and it's a very good platform. Keep up the excellent work!
Maybe I am wrong, but I did not hear a lot of Domoticz recently. But maybe this is my mistake. Thanks for mentioning it!
@@AndreasSpiess It's still very popular and being worked on constantly, beta version gets updates every few days. Have you seen the rpitx project, I use this, well just the pocsag bit of it to send critical alerts to an old radio pager from my home automation, works well for local (a few hundred metres) range.
I also like domoticz because lots of functions can be implemented in one system.
There is a PR for domoticz: github.com/SensorsIot/IOTstack/pull/5
I have not tried it but it looks working.
Dave Wright I am using Domoticz myself, and for me it’s a very good platform. Get all I need in one package, though there is some programming needed inside Domoticz to make it work. The Domoticz forum has been helping me a lot.
Best regards
Ulf
Andreas, I love your videos and they have all been super helpful to help me learn programming. I am very grateful for your dedication to getting them so well produced and your attention to detail. I just wanted to say thanks, so much!
You're welcome! And welcome aboard the channel.
Did you just saw my browsing history? for the past few weeks I was searching opensource IoT stack and then you made video about it.
I am glad the content was helpful.
You may have a look at my channel.
I may have something for you too ;-)
@@ei23de subbed!
@@chawza8402 cool, thank you!
This is brilliant work!
A big thanks to you and the opensource community.
I was surprised to find out how easy it was to set things up and how efficiently the dockerized environments are using the resources of a "humble" pi.
Running 12 containers (including unifi & LOKI that I added myself) all running smoothly from an SSD.
Thanks again!
You are welcome! Indeed, I love this project, too.
Thanks for this great video and all the effort you've put in it!
You are welcome! Glad you enjoyed it.
Very nice! Wrapped up neatly in one package too. I do hope people change the default credentials though. That's how botnets are created.
Thank you. It is probably not too critical if you keep things behind your firewall.
@@AndreasSpiess A proper firewall, probably not. I'd worry about the people running the cheap plastic router.
Man, I love this channel!
Thank you!
From initially looking at Home Assistant...this has blown my mind! Definitely want to try using docker now! Thank you
You will enjoy it!
Brilliant guide, thank you very much for sharing your experience and knowledge.
Glad it was helpful!
This is wonderful. It is so practical to install software in Docker and keep data in a volume. I am sure glad for my front-row seat!
Glad it was helpful!
Great video as always.
I would like to see a video where a smartphone is used to view the data and enable operation.
I myself use Blynk for this.
Good idea for a future video. Thanks!
I'm really sorry for giving only one thumbs up. Very great guide! I'm using similar set up, but I prepared d.compose file manually. And with a good knowledge in Linux and docker it took me a while. Great job!
Thank you. I had a lot of help!
No need of such powerful hardware for home automation. I have mine in a Pi Zero W with just nodered and works fine for a 10usd device!
If you are happy it is ok for me. I do not like the Pi Zero because it always was very slow in my setups.
Dear Mr. Spiess. You are amazing!
I've been doing arduino for quite some time now and failed miserably at installing Pi-Hole on an old BeagleBone Black that a friend gave me, but you gave me the motivation to dig deeper into debian and linux and the whole Raspberry Pi topic!
Thank you very much for the much needed inspiration!
Greetings from Austria!
You are welcome! As a noob I only use Raspberries to avoid a lot of "ratholes"...
I just bought two Pi4s to retire my Pi3s.... I agree on your argue ;-)
Next Cloud sounds interesting.
I am somehow missing IoBroker besides FHEM, OpenHAB and Home Assistant.
Cheers from Bulgaria
So far you are the only mentioning IObroker in the comments. I did not hear a lot about it recently. So I do not know how active this project is and how much it is used.
I hope everything is ok in Bulgaria. I still remember our last year's bicycle tour...
I do not know how many users which System has. I know someone who uses Fhem, i myself tried OpenHAB, was not totally happy, then i tried IoBroker and am really happy with it right now. If you look at the developement right now, there seem to be a lot of activity. But i do not know and do not judge. If i would not be happy with it i would probably have tried homa assistant, so i have no own experience with it, but it also seems to be a great system. So may everyone use what fits best for him.
Here in Bulgaria everything is fine. I have so many fresh things to eat, including different melons, figs, pears and other delicious things i did not have in Germany. I had a reaaly long lasting summer with almost every day blue sky, and the hot temperatures here are much more tolerable due to the low humidity, and there ist mostly a slight breeze too.
And as you can see, still a lot of work left for the next years...
ua-cam.com/video/fck1ndIKOZg/v-deo.html
Today i connected the newly built garage to the network, the garage doors were installed last week, and we had a big party at the weekend :-)
Slowly progressing, but no need to hurry :-)
And hopefully i will start to find the time to produce some videos...
All togehter, i am just happy here.
At the moment, home brewed Weißbier is available ;-)
So all the best wishes to Switzerland and cheers from Bulgaria
Nice video! I thought you moved there for retirement ;-) It is very different to here. But if you have internet you have lots of possibilities. A lot of open space. But for sure a lot of work. Prost aus der Schweiz!
Great humour in your video sir! Enjoyed it a lot
I use openHAB for years now and it works really great for me. Great integration and customization options. Version 3 will be much more user friendly and even allows you to set up nice dashboards with a lot of statistics, even on your phone.
Thank you for sharing your experience!
Just needed exactly this guide. Thank you so much!!
Grüess us Zunzge
You are welcome! Ich fahre mindestens einmal pro Woche durch Zunzgen auf meiner Standardrute mit ten Velo ;-)
Well done. Your first video about IOTStack was creating a "oh, look whats possible" in me. With this new one I understood the concept and can go further. Thanks a lot, Andreas.
I hope you will have fun with the project!
May I ask why you use 32bit OS on the Pi4? (8:08)
I've been looking for a simpler alternative to Home Assistant since I really just use it as a clunky MQTT and node-red server. This is perfect! Looking forward to adding the database and grafana components as well! Thank you!
Glad I could help!
Raspberry Pi probably within 2 years: *releases Pi 5 that is 5x overall performance compared to its 4*
Lottery248 - St.0 - Velphord yes probably 😂😂
20 gb ram go brrr
What a great video. I'm going to have to watch it again a couple of times, stopping and starting, to absorb the quantity of info you have packed in here!
That is why I like UA-cam. I can go back ten times till I go what I needed...
Just simply amazing! The combination of cheap hardware and software thats available for free. Thank you for the tutorials and for those that have taken the time to develop these.
You are welcome! I also like the current time with all the goodies for us...
I'm so ancient. Trying to remember if the first CPU chip we got in for fixing in our 70s typesetters was the 8008 or the 8080; I think it was the 8008. Before that the CPU was composed of hand-wired plug-in TTL chips on 8 boards plugged into a backplane, and we troubleshot to chip level. Some "good old days"! And now I get to use a Pi to turn my boat into a watchdog pet that knows how to get around in the world and can talk to me privately from anywhere. Thanks for the help Andreas.
You find a 8085 project and wire wrapping on this channel if you want. But I do not miss the technology of the old days. I love the possibilities of today and the prices even more. 1GHz is like DC was in my youth. I built a satellite ground station to talk via a geostationary satellite for less than 500 dollars, a vector network analyzer for 3GHz for less than 100 dollars, and a lot of other gadgets. I am old, but still like this situation :-)
@@AndreasSpiess It is all quite amazing. I did like the challenge of discovering which chip had failed versus just changing cards to fix things, but I've not done that for decades. I've been learning the latest stuff vicariously through people like yourself for years but am finally in a position to start experimenting with it all for real. Very much looking forward to it. Thanks for the reply, appreciated.
Wow, this is a LOT of useful information. I am wanting to break free from ifttt and other outside servers for my automation needs and just starting to look for alternatives. The sample project you showed is exactly what I would like to start with. I was also looking for a sensor that measures light, now I have a reference to look into.
Thank you so much.
You are welcome!
Cool stuff. This setup is evolving nicely :) I'm eager to see how far you can get. In the tech world it is too easy to be stuck in a perpetual habit of installing and setting up. Keeping large polished projects current, constantly updated and fresh with newness is the mark of a true master. You are doing well
For this video I updated my productive Pi running one of the first IOTstacks to the newest one without any issues. Docker seems to pull a relatively new version every time you start it.
I love using the raspberry pi 4 for hosting webservers and home automation systems - if I need more power I just bike down to Akihabara and pickup a few more. It is especially nice that they work with PoE!
Thank you for sharing your experience!
@@AndreasSpiess oh by the way I saw an article posted just the other day on enabling TRIM on external SSDs connected to the raspberry pi 4. It might be interesting to take a look into it if you haven't already: www.jeffgeerling.com/blog/2020/enabling-trim-on-external-ssd-on-raspberry-pi
@meh301. Thanks for the link. I just checked. Trim is enabled for my small SSDs
Hi Andreas, great work! Thank you. Looking forward to harness the power of the RPi4! Love your channel, keep up the good work.
You are welcome! Enjoy your Pi4 projects!
I've been thinking about migrating my home automation from SmartThings over to something a little more flexible if I want to build my own sensors and devices, and this is just the video. Thank you!
You are welcome!
I would like to see a Next Cloud video. Thanks. Your videos are great as always. Very informative and well organized,
Noted. And thank you for your nice words.
Great video, as always.
One tiny little point that has nothing to do with your great content. Just an English vocabulary tip.
It’s not “vibrating” community. It’s “vibrant” community.
Thanks for all your hard work!
You are right. I should have corrected it.
Really happy you did this video. I just got a new Raspberry Pi 4B and it is going to be dedicated to home automation. Excellent job explaining how to do the setup. Just need to figure out which sensors I want to use. Thanks.
Hi Andreas,
I planned to go on holliday but now I'm too excited to get IoTstack up and running.
Perfect timing and perfect topic.
Cheers from Switzerland
You can take the Pi with you. That is what I usually do in my holidays...
This video is great, covers the software side brilliantly. I would have appriciated more hardware overview/setup in relation to what has been set up on the software side. I will check out your older videos, just incase you have already covered this aspect.
You should find them in the Raspberry or home automation playlist...
Andreas my brother with that crazy Swiss accent... I'm so very glad 2020 is continuing to treat you well!! Just wanted to wish the best of wishes to you and your family well for the rest of the year!! Lets hope this insanity is mostly in our rear view mirror now...
Thank you. Here things are quiet and we do not suffer a lot. A little more Zoom and Teams. And no holidays abroad.....
Make sure that no-one tells our Swiss guru that he should have described the Discord community as "vibrant" rather than "vibrating" at about 10:00.
Keep up the good work, I am sure that technical instructions sound more convincing when presented in a Swiss accent.
The script said vibrant ;-)
That’s it, Pi4 on order. Thanks Andreas 😁🏴
Great. I think you will like it. In addition it is British ;-)
Just as a note: about 3 months ago Home Assistant was all renamed. Hass.io is now just called Home Assistant and the core version is now called Home Assistant Core. :) The SD Card was always the killer with Raspberry installations. The Raspberry 3 and 4 with SSD makes a huge difference. Obviously the 4 is better, but even USB 2 (450mbps speed) is better than an SD Card. I agree with all the points here. Unless you have an always on PC that runs VM's for your sensor stuff, a Raspberry Pi 4 is very cost effective and quite powerful.
Thanks for the great review.
I liked the previous slogan "Powered by HASS". It was so lovely awkward.
Thanks for your videos and effort. The best channel for electronic geeks.
Wow, thanks!
Great video Andreas.
I've been working on concepts and prototypes for a few of my own IoT devices and yet had not really given a lot of thought to how to control these centrally, so discovering this video was very useful for me.
I did think about buying a Pi4 for this purpose and still not happy about the lack of native boot to SSD (as well aware of the SD issues) , so (despite your excellent video on how to do this) have decided to wait until a Pi version is released that solves this issue out of the box.
So in the meantime, as I already have a substantial Linux home server (that I have many VMs on for my day job), decided to install docker (this is new to me - looks fabulous) and install Graham's amazing IOTstack set-up. After a bit of tweaking with the docker config, have it mostly set up though going to have the databases stored elsewhere on the server so they get picked up with the database nightly backups for other applications running on it.
Thanks for this and all your great stuff.
Am working on my own version of a Google Nest at the moment as found the Nest too limiting for what I wanted to do. Also my own version of the Internet Radio that you covered in an earlier video.
The Raspberry Pi has now SSD boot in its standard distribution. So no big problem anymore. Just update the EEPROM of your boards. I assume the newer boards will come with this version in the EEPROM. But it will probably take a while.
Good luck with your two other projects!
Thank you Andreas, I have been looking for this information for some time. I will be giving this a try for sure. Love your channel.
Glad it was helpful! I hope you will succeed.
This is a very important video for me. Now it may start to make sense to drop my vps and host everything in-house. Only two things need to be sorted before. The first is easy and it's related on how to redirect my own domain to my dynamic home ip address, and the second one is currently on-going and it's related with the pi4 ups. It has been a long running since pi1 and the lousy unreliable sd cards. Andreas, thank you for your valuable knowledge share through this journey
We discussed the remote access in video #295 (duckDNS). And I said in the video, we try to create a UPS for the Raspberry (last video)
thank you for this. i have been playing with arduinos and sensors for years, but never got into pi. now, i see a neat way to tie everything up in one package.
The Pi and ESPs fit very well, I think.
Wow, thanks so much for detailed explanation! IOTStack opens truly endless possibilities.
Glad it was helpful!
Thank you for this rundown Andreas. I've been thinking of migrating my setup back to an RPI/SSD combination lately and your overview is perfect!
I think it is a good time now...
@@AndreasSpiess Ordering my Rpi4 soon. Does it run well with all those containers on the 2G version though?
It did not use all memory. But I did not install absolutely all containers because I did not need them. I installed around 10 of tehm. and HassIO
@@AndreasSpiess Do you see any issues with upgrading Portainer to V2. Will it break anything with the current setup of the script?
I have this stack in a production docker server in the company, so powerful to automate the network and also quickly deploy small developments. For example sensors for kitchen fridges
Glad you like the project!
OK, so this is very good but I am struggling because this is new and the format, of the super script, has changed a bit plus, and this is the big one, Docker is very new to me, my first attempt but, I am having "fun!"
I am learning a bit, realising that I don't know a lot.
At the end I will hopefully reduce the number of physical raspberry Pi I have and have a better backup and update system in place.
Please do not stop these videos, always a pleasure to watch and I am getting better, Thanks.
Thank you for your feedback! And have fun while learning.
Great work to put all this together. I'm happy to learn that I have done all the steps until Grafana. It seems I'm going in the right direction. Thank You!
You are welcome. I am sure you will get Grafana running...
Good video. Been learning much from you over the years.
I have been using Raspberry pi and containers to control my frame irrigation operations. Not only is the raspberry pi great at home automation but it is great for high end irrigation control of io devices like plc's or mqtt devices. I do not use the raspberry pi to make hardware measurements as there are cheap regular and arduino plcs to do this function.
I was forced to have multiple raspberry pi's in the docker based control system. I was forced to developed a "kubernetes lite" to control the individual nodes running containers. If IotStack does not have this feature, then it will in the future.
BTW, for 5 years I have been using Redis as my central db instead of MQTT. Redis allows my python programs to store data in the native form of python objects like dict, lists and sets. There is an Arduino library for Redis. ( I had to slightly extend it.)
Thank you... I've been wanting to buy a full spectrum light sensor for our plants in a sun room to simulate full sunlight from light spec. filtered out through windows.. I built IR, UVA, RGB into one panel so now I can integrate what you've done to figure out difference... great job
Indoors it is a little simpler, I think ;-)
Great video Andreas.. One of your top 5 for sure.
Thank you!
Been using this for a long time and it’s flawless, glad to see an updated video too.
Thank you for sharing your experience!
Very nice, thanks! Now remember to add an anemometer so that the awning will be retracted if there is too much wind.
You are right. I have one :-)
@@AndreasSpiess I kinda figured you did...
Good morning Herr Spiess, another great video!
Thank you!
Thanks a lot, Andreas. Yet another awesome video, and just in time for me: I'm planning to reorganize my Raspberry Pi which is running Home Assistant to have it on Docker, and this video was very useful, specially the info about iotstack. Until today my plan was to install Docker manually and then Home Assistant, and imagine something for data backup. You gave all info in a single video! Just as a info, I run two Raspberry Pi for my IOT: one has a SSD and runs Home Assistant and have digital certificates to be reached from internet, and the other has Mosquitto, Node-RED, Influxdb and Grafana, and it's connected to a large HDD. I did like this in case I crash Home Assistant server, I would be able to use Mqtt and node-red directly to control my automation. In the other way, if I crash Mqtt server, I can point Home Assistant to its own Mqtt while I fix things, and I will just lose some logging data in Influxdb and Grafana. Again, thanks a lot!
That really sounds great! I would like to know more about how that works but I am just getting started and I'm sure it gets complex quickly.
So you have a duplicate MQTT on your HA server that is dormant most of the time? Or is it different? Same with node-red?
I never had an issue with a Pi so far. Just with programs on the Pi. That is why I do not have a duplicate setup. It is also not so easy for me to change the MQTT broker because I use static IP addresses on the sensors...
Maybe I do once a video with Kubernetes to create a redundant Pi...
@@RTmadnesstoo actually, not installed in the Home Assistant server but I can install, copy configuration (I have a backup) and get it running in minutes, maybe within one hour. My fear is related to some big crash either on Pi or disk that would incapacitate it for long term. So, having two separate hardwares seemed safer for me, but maybe it overkill.
@@RTmadnesstoo I forgot to mention Node-Red: it's not redundant, I have it only in one hardware, but in my case it only collect data from some sensors and I have some flows I can use to turn lights on/off, so it's basically something I can use in case of trouble with hass and the sensors reading are not critical.
@@AndreasSpiess you're right Andreas. I burned one pi zero, but it was fully my fault when I was starting with it. But I had some crashes with sd cards corrupted after power outages and I spend some time to redo everything with my family complaining about it ☺️. Then I started to organize backups, did this separation of hardware, and finally moved to ssd, basically protecting everything from my own bold tinkering. ☺️
Thank you for this fine video. Now, I understand, how I can install Home Assistant in a Docker Container and separate the Data. A very good thing!
Glad it helped
@@AndreasSpiess Agree with tzoumaz!
However, I am new to docker and container/volume management. Since HA is not in the "IOTstack" stack, it does not appear to be part of the backup solution provided in IOTstack. Or am I missing something? Should I just use Docker to backup my HA configuration and then offload it to the cloud (e.g. gDrive/DropBox) using a cron job?
Thanks again for the awesome vids! Learning a lot from you Andreas!
One comment about that type of black aluminium case - if you depend on wifi rather than Ethernet for connectivity it helps a lot if you point the side with the wifi antenna directly towards your access point. It's the side opposite USB ports. The antenna is tiny-tiny and with the metal case around it it's not exactly omnidirectional.
You are right. My access point fortunately is quite close and so far I had no issues...
Exceptional. Fantastic update. Thank you very much.
Glad you enjoyed it!
Agree, I am running Docker with influx, grafana, fhem, and also Home Assistant and ioBroker for tests on one Rpi4. Works perfect
Boot from SSD. 433Mhz and zigbee interface...
Thank you for sharing your experience!
Cloud video yes!
Thanks again for taking the time to educate the kids today ✌️
You are welcome!
Very educative. Unfortunaly 99,999% of iot wannabe will never be able to implement such a marvel.
This channel anyway not for everybody ;-)
This is exactly what I've been looking for. Got a Pi4 8GB a few months ago... running pi-hole and shinobi, but want it to do more, but also want the flexibility to add and remove things cleanly as I try them out. Docker sounds like a perfect fit for this. Also something more centralized for home automation instead of a bunch of different apps on my phone sounds nice.
You are right, Docker is quite flexible for experimenting
First, thanks Andreas for your very informative videos.
Agree that Pi4 makes for an excellent home server.... and although I started with your original IOTstack video, I decide to deviate a bit from it along the way... so just commenting today to share my experiences on the subject in case they are of value.
I have been running HomeAssistant on a dedicated Pi3 for years with excellent results... Not sure if you are familiar with HA, but one excellent thing about it is that it has great plugin ecosystem already built on docker... so if you run HA, you can add plugins for things like NoteRed, Influx, Grafana, Plex, Mosquito, Dorpbox backup and probably 100 more.. Surely almost all the components in IOT Stack and many more.. All plugins are tested, get regular updates, get automated backup etc.. all those services run as independent containers and you get access to them from within the HA UI, but also via the designated port (same as IOTstack) for general use.
But on my pi 3 it was still a dedicated (HASSOS) server, and with no SSD. So seeing you original IOTstack video, I decided to try it out, to test if I could use a Pi4 for the server, and also as a general purpose Raspbian desktop...
Sooo, to make the story short, I followed your IoTStack instructions to start my server.. but only installed Portainer (not sure why) and Home assistant... all the other server components I kept as plugins within HA... (Portainer could be too...cannot tell you why I installed it form IOTstack). It was a simple 5 minutes restore of a backup form my HomeAssistant install on the Pi3, and voilà... All containers were up and running on the Pi4. A month later, on top off all that I went on to manually install an Octoprint container to manage my new 3d printer.
So now I have a Pi4 (4GB, still booting from card but running on SSD) running:
- Home server based on Home assistant, with some 30-40 sensors, cameras, etc around the house
- Full stack of required services including, mosquito, NoteRed, WireGuard VPN, Nginx, Influx,, Grafana, etc, all running as HA plugins
- Octoprint (with 15+ plugins of its own) to manage my printer, including streaming video and other services.
- All running on a full Raspbian that I can still use as my lab desktop for simple tasks like surfing the web, play music, check email and even youtube when needed.
The pi4 needs a small fan (quickly overheats without it) but manages to stay below 60 degrees most of the time. This setup has been running for almost 8 months now I think.. No real issues so far (in fact HA has been much more stable with the SSD as data repository). And as a side, I get to experiment a bit with docker and dip my toes into Linux, which is a real side benefit... Happy camper!!.
You are certainly correct: Rasppi4 with Docker is the perfect solution for a maker's home server. And the vibrant community (including your videos) provide a lot of help in making it happen.
All the best.. keep it up.
I agree with you: If you go HA you most probably do not need IOTstack because HA is the integration platform.
Excellent video!
I have flashed a smart TV Box with linux and installed node-red, openmediavault and nextcloud. node-red is great and has got a lot of drivers and libs. The GUI is shaped by the programmer. For low effort you rather use the standard dashboard components of node red. If you are willing to spend more time and effort, you may use sockts.io and create your gui as you like.
I prefered a smart TV box, since it has got an EMMC flash with faster memory access as with SD cards . Most of smart tv boxes have got 2GB-4Gb of RAM and more. beside you get they in a case and with power supply and are at similar costs as the Pi4.
In the moment I have got the H96 pro+ equipped with Amlogic S912 Octa-core. Having all the applications mentioned above and a comprehensive selfmad smart home application (curtians control, garage gate control, NVR, telegram, Zigbee devices, presenence detection, lights control, room T° H% and pressure sensors, doors and window sensors, power supervision) the smart tv box runs @5% average load@32° cpu temperature. I admit I would have spent less time for the whole development and configuration, if I had used the Pi4, but at the ende the effort paid off!
Next project: upgared to Beelink GT-King Pro 4GB/64GB Amlogic S922X-H add heating control and AI
These boxes seem to be "hidden treasures"!
Hi Andreas - I just love that accent! I wish I could speak a second language so fluently.
It is easier if your native language is spoken by less than 5 million people ;-)
@@AndreasSpiess I'll take your word on that and enjoy listening to more. Thank you.
Thank you Andreas - a brilliant video. A lot of UA-cam videos have to be speeded up so as not to waste our time - yours is just the opposite - so much information that I would need to slow it down to set up such a system. I already have a 'Wireless Things' OpenPi (now unfortunately liquidated) which uses the original RPi compute module, and this streams low power wireless and some one wire temperature sensors readings to Initial State. If I wanted to extend the system, I would certainly consider what you have told us here.
You are welcome! The advantage of UA-cam is taht you can stop and rewind. At least that is what I sometimes have to do if i did not get it the first time ;-)
Great video, it proves to everyone that it's possible to have advanced home automation with "NO CLOUD" solutions. Maybe in the future big companies will provide us docker images, where we control outgoing ports and know which data is stored where ? Isn't it our data after all ?
AFAIK docker is well accepted also in the industry. Especially to deliver complex software stacks.
Controlling ports is probably not on top of their list... But I am sure it can be done by having a small interface outside Docker which communicates with a protocol like MQTT.
This is an awesome video. I now run Pi3B as Homeserver. I already planned a change to Pi4. The pieces are already lying around. Not yet able to start the project because of lack of time(learning Flutter/Dart,MSFS2020...), but that will come in the coming months.
Flutter seems to be worth the effort ;-)
Concerning migration: I migrated my home automation server from my old setup with SD card / SSD to the new and pure USB boot. The whole installation with the newest IOTstack project took a few minutes, and I transferred the directories using a memory stick in another few minutes (I am a Linux noob). Started the Pi and everything worked. I found this quite cool. Expected more issues.
I bought a Pi 3B+ recently for 3D printing but started to explore the other possibilities as well. I picked 3B+ model as I presumed it will be good enough for my needs but I don't know how will it perform for home automation task?
Very well made video, really easy to follow, thank you!
It should work, just much slower. Check the swap space (1G instead of 100M)
This is great! I have no experience with IoT yet but I was thinking of starting this way. Now I know where to start!
For sure a good starting point... Maybe with my other videos about node-red etc.
All I can say is: AWESOME!!! thanks a lot. Exactly what I was looking for.
Glad it helped!
Really good video Andreas, thank you for all the wonderful ideas and information!
My pleasure!
Very very interesting and useful. Bless you for helping all of us home automation enthusiasts.
Happy to help!
Indeed an great episode which contains mouthful of very interesting information, and as usually presented in an excellent way by Andreas, thank you.
Glad you enjoyed it!
So much to unpack (pun intended) in this video...!
I hadn't even heard of portainer.
Portainer is great if you work with containers! A real help.
What a pleasurw to see and listen so good material and so good professional. Superb!!!!
Thank you for your nice words!
Thanks a lot with your video i discover Dozzle a very good completion for portainer !
Thank you for this project. I now have 3 iotstack setups running in my families homes on 3b+ using SanDisk sd cards. One thing I'd suggest - test your backups actually work! Had one sd card go bad when it got water on it.....
Bad luck :-( I thought SD cards are waterproof.
I used the backup file to migrate data. So at least one direction worked. The restore currently is not scripted.
@@AndreasSpiess
I used to to work in the IT field and through experience, thankfully not my own, I came to realize that a file isn't backed up unless you know that it can be successfully restored. Just having the backup process return no errors doesn't necessarily mean that it was backed up (depending on the backup mechanism) or that you will be able to restore anything (maybe you make a big archive file storing the important files but your drive doesn't have enough space to hold it in order together the files you want from it if you are doing something very simple for backups).
I also learned, from something that I had to fix, when mounting drives or network shares onto the the root (/) directory in a UNIX-like OS ( such as Linux, Raspbian, Solaris, BSD, etc) then name the mount point something that comes alphabetically after dev. That way if someone comes along as the user root and runs the command "rm -rf" in the directory / the files in /dev should be removed first and the system won't know how to access the files in later directories. (Actually it will fail sometime as it's deleting files in /dev .) If the mount point is named something so that it comes before /dev then the files will be deleted.
Thanks Andreas 👏🏻 inspiring and informative. Keep it up
Glad you enjoyed it!
Fantastic as always, if one day you stop shooting video we are going to miss you very much!
I still have a goal to reach. So (if "god" will) I should stay on your Sunday menu for the next time.
Bruh you taught a gen z Minecraft playing no life to make a home automation system, thank you I donated to your Patreon
Thank you for your support!
Thanks Andreas another great informative video. I’ve been using OpenHAB on an RPi 3 for some time with almost great success. I get an occasional lock up which I cannot attribute so assume it is SD card corruption. I have an RPi4 all setup ready to go and will now add SSD.... as soon as I get that pesky DIN rail mounting sorted out!
I assume you will like it. And the SSDs should last longer...
You are quite a Legend with Pi Boards and its setup 😍😍🌹🌹
😊 thanks
Very informative ( and organized ) , as always. good work
Vielen Lieben Dank für das tolle und informative Video. Das hat mir einen guten input gegegen welche OpenSource Tools es gibt und werde mich mal mit dem ein oder anderen auseinander setzen. Weiter so! Viele Grüße in die Schweiz :)
Ja, speziell für den Raspberry gibt es sehr viel. Deswegen wird er wahrscheinlich so geliebt...
Thank you Andreas, who knew a home could be so complex. This will occupy me for some time :-)
Indeed a never ending story. At least here...