It's getting more important for people to collectively start saving as much information as possible, in bulk, than ever before. I very recently just had a look at my UA-cam playlists and rediscovered one I made during Covid times called "important historical context" which would have been filled with videos of certain political developments. ALL of the videos in that playlist were removed from UA-cam. All of them. The scary thing is, while we now have the "easiest" way to access information, the ministry of truth also now has the easiest way to curate and re-write history.
It’s insane that I can not find a fraction of the documentaries that I used to watch on controversial topics anymore. I wish more people were aware that this type of thing is happening.
This video, like many others, created an overwhelming feeling along the lines of, "oh my gosh of course, he's right. I need to save at LEAST the survival information, then everything else in rank of importance". Something like that. It urges me to start prepping again. Which honestly is probably something like trying to create a safety to cope with the anxiety. But you know what, friends, I realized that even if SHTF as big and as hard as some of us prep for, I'm okay with probably dying. I mean I would give it my all, there certainly would be a lot of stress and pain. And in that scenario, most preppers would say going into it unprepared will likely spell demise. And they're probably right. But that's okay. I recently was blessed to be able to somehow manage to put money down and start paying mortgage on a house (escape the rent trap am I right?) and over several months of living @ the new crib I realized it really is a house of cards. Between the chaos in government, ambitions of larry fink and the 1%er's, natural disasters, changes in economy, being stretched thin financially, almost getting laid off at work, fire, flood, powerful HOA's (mine is pretty chill TG), family stresses etc etc, you quickly realize that literally anything and everything can take you down and lose you everything you've ever worked for. Life can wipe you out in more ways than you can imagine. We can certainly insure ourselves against common things and we do, but we can never prep for it all. Even if we had the most hunk of a bunker we could walk outside tomorrow, and tree branch falls on us and we get the speed nap. Make your home a home, that is, make it comfortable. But damn we've got to live our lives and not create suffering for ourselves by worrying about whether or not we have the head knowledge to find and make kindling in apocalyptic urban setting #2. ~an exaggeration that goes way beyond what this video even touches just to make a point written by a guy that will probably die someday. sorry to be so serious but hoping this posture helps someone like it helps me.
bro its such a mental hurdle to compile everything needed and back it up twice. but having a llm suite to answer questions post event would be too valuable.
dude, this is such a good idea!! you should expand on this. come up with a whole doomsday essentials pack - not just wiki, but also books, etc. key resources to survive and thrive
I kinda suspect that in a doomsday scenario, being able to reliably power on any of those devices would be quite a difficult problem. If it's a man made disaster, tech infrastructure and power delivery would be an immediate target. If it's a natural disaster, I could sorta see stuff working? Idk, solar power and a whole lot of low energy devices can help.
"Internet's most important resources: Arch Linux Documentation." What am I going to do with Arch Linux if the world's internet disappears lol. I think at that point there will be more important things to worry about. "Okay, all the cities are in shambles.. i'm starving.. I'm cold.. I've got it, let me grab my localized Arch Linux docs. At least I won't have a peasent operating system like Ubuntu."
You're not going to do anything with Arch Linux. That's not the point. The point of the arch docs is that they are the most concise and consistently useful set of Linux documentation yet made. *Critically*, the vast majority of the information in those docs is distro-agnostic. I don't use Arch Linux on any of my devices. Everything in my house runs something that's Debian-based. Even with that, having access to a good-quality set of mostly system-agnostic documentation is absolutely invaluable, so I've always got the arch docs bookmarked, and it's one of the first things I'd save if I were building one of these. I of course would also save the Debian documentation, and perhaps dump the AskUbuntu forums, in addition to Stackoverflow and Serverfault. That being said though, what the Arch Wiki has that those don't, is brevity. *That* is why I still use the Arch Wiki Constantly even though I haven't used Arch in years.
>decide to back up resources to be prepared when the world ends >don't download anything technical because "i'll have more important things to worry about than my computer" >computer breaks >can't fix it because i didn't download the relevant resources mfw
@@nibbletrinnal2289> be too stingy to download anything because “there are bigger issues” > have no technology that you can use > be in the stone age > mfw
in a worst case scenario; internet will still be operational. all of the core infrastructure is built deep underground. we also use satellites. to say that internet wouldn't exist anymore is a myth. go play "outriders" . humanity took "all of internet" with them; when they left earth.
@mahpell7173 Your pfp in junction with your comment makes it funnier than it would otherwise be because it looks like you're snickering at your own joke.
@@ihaveagoddamnplanarthur Alyx is a good optimised game actually, I've ran it on my 1050 ti, it was stable 30 fps, but there may be places where it will drop
@@stehouse I played Alex on 1650 Super and in some moments the FPS was really good, but in some moments, due to the low FPS, I started to feel sick, although I had never felt sick in VR before.
Also a good reason: protecting your children from the internet by just providing an offline version of wikipedia and so on so they can still research for school projects etc. And then adding whichever other sources they need manually later.
This defeats the entire purpose of a free internet. Never cherry pick what a child can see/ learn, a child should be able to figure out things themselves and become their own person. If anything, just block the truly bad sites that could be damaging.
@@Evenaardez "figure out things themselves" and the things theyre figuring out being gore, pedos, porn etc at like 8 years old... as someone who had unlimited internet access no thanks just make them and their friends a minecraft server!
Internet Archive and Project Gutenberg both have a ton, also PDFdrive is your friend, but you can download a lot of these things and store them on a solid state drive (or a few of them if you’re a hoarder) quite easily.
Local mapping data is such a godsend. Years ago we were crossing from argentina to chile through a small crossing in northern san juan, middle of the mountains aka no internet and no phobe signal, OSM was super useful for navigation :D
I have a Boox Palma and bought a 1 Tb micro SD card. I’ve got almost all of what Kiwix offers, my entire state maps downloaded, and numerous videos, documents, books, libraries, etc. All of this in an e-reader the size of a smartphone with a battery that can last weeks, if used sparingly. It’s a pretty cool setup.
Where do you prioritize/ find valuable documents to save etc. Maps of the area where you live makes sense, but then how to prioritize what comes next? Farming / survival skills?
@@shanoahmontano7077 that’s where the 1 TB micro SD comes into play. You don’t have to prioritize. It fits everything. Or at least everything I could think of. There’s a whole datahoarder subreddit that would scoff at it, but I’m content
That's because: Textures are pretty damn high-res nowadays, and there are several layers instead of just having a single texture (like back in 2002-ish). You've got diffuse textures, specular textures, normal maps (bump mapping), emissive textures, ambient occlusion maps, detail textures, reflection and refraction maps, subsurface scattering maps, metalness maps. So take the size of a single texture and 10x it to cover all the different types of extra textures needed for special effects. THAT is why games are 100+GB. Binaries (.dll and .exe files), audio, map data and others fade into naught compared to textures.
I mean famous Titanfall 's 35GB of uncompressed audio are thing. What else you want? Maybe remove gigabytes of unused resources and locations? Or beta test gameplay? Workers of multibillion corporation have much more important things to do, like triple check working on in game shop or implement new gatcha.
I already do this with a series of XHDD's. Toshiba and Seagate sell reliable hardware at a [mostly] decent price. Every time they knock the price down to 100 USD i grab one of the 4TB drives and fill it up. Between work software (IDE's mostly), movies, shows, music & games, archived websites and internet videos; ive got enough entertainment to out last the apocalypse!
Forgive my ignorant question, but I’m not too educated on all things tech: Would I be able to somehow download things from Kiwix and the maps stuff he showed on a mobile device? He talks about downloading and then launching the data, but if it’s all been downloaded onto a mobile device, do we still need to do all of that coding stuff he’s doing to access it?
Hmm.. only 109GB for Wikipedia? I'll add that to todo list for my server. That would have been helpful back in early 2000s when I had slow Internet and doing school work.. lol 😅
You'd better shield that NAS from magnetic pulse/solar flare events or it will be wiped/fried. You MUST GROUND YOUR SHIELD (screen or copper metal fabric) !!!
Hard drives are literally faraday cages by design. At most the PCB fuse would burn, which is easily replaced or bypassed. The data on the platter is safe.
Being a Venezuelan, I totally understand you and backup your actions. Thanks you very much for sharing your expertise with those of us who may need it in the future. (God forbid it though, because that would mean the SHTF).
Hi , sorry for the of topic. I would advise to turn down the fill ligh by about 2 stops. So there will be more volume. Used to work as second DP , or as a gaffer in cinema production for almost a decade . Best wishes
We speak the same language, but I have no idea what you just said! I wish I could understand all this tech stuff and actually apply it, since I want to try doing this mapping and internet downloading thing myself.
@WoefulMinion A few Blu ray disks is probably how I'd back it up rather than dedicated hard drive space, unless I'm actively using it (which is unlikely)
@@WoefulMinion Things change quickly eh - I remember buying a 16k ram upgrade for an apple ][ that cost a fortune. Now I'm ripping a single 4k UHD movie and it's 120GB.
I think that a GPT-4 trained model (a recent version of it got leaked, so it's widely available if you search) would be an excellent addition! Besides being trained into the larger context of today's Internet, it's "knowledge" is stored into the trained model, so theoretically you wouldn't need Wikipedia (although I REALLY recommend it).
Why not use both? (But seriously, is there any way to download all of wiki and world mapping AND also GPT-4 onto a single mobile device (with a solar powered battery or case)?
They need to make a Vault (or even multiple) for the internet like the Svalbard Global Seed Vault. The main purpose would be for re-uploading in the event of unforeseen events causing the internet to go offline, such as major Solar Storms if they are ever to occur!
As for viability: Estimates suggest that it contains hundreds of exabytes (1 exabyte = 1 billion gigabytes) of data. This includes everything from web pages, images, videos, documents, emails, social media posts, and more. Our largest yet known to the public is Microsoft’s Azure Data Center, which has 15 exabytes of storage. Microsoft also came up with extremely resilient storage disks that can withstand major damage of just about any kind, called Project Silica. These can already store 7 TB of data per 75mm * 75 mm * 2 mm Right now it would require about a billion of these disks to store it all But allegedly Microsoft is planning to apply this tech to their 15 exabyte Azure Data Center, it might be feasible after all!
The investigative reporter - Whitney Webb - highly recommended people doing this type of thing.She predicted (based on evidence she found) that there is a plan in place to take down the internet (and later do a "3.0 reboot of it ) to aid in forcing everyone on CBDCs and massive censorship / blocking access to certain information. Although, I think the option featured here is more sophisticated than what she had in mind for grabbing stuff off the internet.
Born and raised in Sunnyside, WA! Spent my life bouncing around the West but mostly WA and AZ. Thank goodness, projects like this mean that society will be much easier to restart if, God forbid, the worst case scenario does occur.
I was going to back green, but I'm concerned that the software will either have my data hit their server or they will somehow have access to the data. I wanted it for work but can't risk client data confidentiality.
This has been something I've been planning to do for a long time but wasn't quite sure how. I really wanted to build a sort of STC (Standard Template Construct) server for myself if basically everything went to shit. Thanks very much! I'll be setting this up ASAP! :)
I love where you’re going with this… for some of us.. Web 3.0 being decentralized… if you think about it… initially we all were decentralized before off the cloud. ☺️ I see that becoming a thing again. Loved the video.
Honestly if space travel ever becomes more mainstream each ship is going to need its own ‘internet’ that can be updated when a connection is available.
I think we’re close to the point where we could ask an AI to use Wikipedia to make an update to the last 2010 print version of the encyclopedia with updated information. One that would be printed out. You could even get it to make a 1 book summary or 5 book or what ever. Depending on how much you actually want to print or read. But training an AI on the old encyclopedia Britannica might require uploading multiple years so the AI can learn what type of information gets added or removed over the years. So the goal being that the AI would know to add important scientific advances or major political events. With the Wikipedia data the AI could cross reference those changes with the much larger Wikipedia data set. Obviously it would be copyright infringement unless Brittanica signed off on it or participated. I think the company still exist but is much smaller and just does online: But that would be a cool project. A simpler solution might be to just use Wikipedia to make an update book or books for any version of encyclopedia you own. So if you have the 2010 you would have a book that has the updated events since that edition came out. If you own a 1980 set you might need 3 update books for example.
Better idea. Wifi or Bluetooth compressed file data sharing that connects automatically to multiple people. Maybe 2 other devices or more. Theres a similar idea in bluetooth walkie talkies, but no one has been able to get it to work well
Remind me of the good old days when I coded our website such, that when a certain file was being downloaded, a box opened with “Downloading Internet”. And then the counter going from 0 towards millions of gigabytes. This was in the dial up era, and almost everybody cancelled the download.
Save everything you find important to your life. (Pictures, music, movies, research, books, etc) aside from what you like. You don’t have a prayer of storing the entire internet. Just focus on what you can’t live the rest of your life without. I personally have a few drives containing everything I love about the digital age. If the apocalypse comes, I’ll be set in terms of entertainment 😂
Every company should store there sites everyday on a hard drive and then have a second feed source like satellite land line and signal so it stays active no matter what happens
Next video get a list of github project to backup along side, for linux enthusiasts, hackers and anything useful that is on github that has to be there on an old hdd. I will be using 1 Tb old sshd for this, no nas or anything facy just putting something to work. Any tips and tricks to do with that are welcome follow :) #theendisnear
I really like this idea, especially since, and correct me if I'm wrong, more and more internet resources are now being locked behind paywalls and subscriptions
Out of curiosity. noticed you are using Edge on Linux ... is the hardware decoding working for you on the browser, vp9, h.264 and av1 or is it using CPU when watching videos, like on UA-cam?
People who pay for life insurance aren't "doomers". This isn't being a "doomer" either. It's sensible, because we take the internet for granted when it will be the first thing to go out even during a minor event.
Wikipedia does not pretend to be authoritative, but gives links to all the source documents which ARE, at least within the limits of current human knowledge. What would interest me is a means of downloading what actually changed in a target for localisation, so that it can be incrementally upgraded.
What problem did you use to open/read/use the maps? Been trying to access on my computer(not creating an entire server or anything) and im having issues.
i think you are forgetting that ssd while super fast has a huge flaw that doesnt allow for shtf scenarios, or simply just not being allow for not being powered off and on regulary. The term that comes to mind is " Volatile data". magnetic/ hdd storage has proven to be the most reliable time and time again... unlesss i missunderstood the ins and outs of hdd vs ssd drives
i've been doing this for years. currently i have 22.4 terabytes of prawn on my own personal server. when the world ends and money's worthless i'll be just fine selling scenes from "close encounters of the nude kind 2: we probe them" for food, gas to run my generator, and other supplies.
it would be very nice to the front end users if there was a an app of an offline browser that lists all the databases currently downloaded on your computer. I can sorta handle the set up process but constantly remembering what to type in to access the database makes head hurt
Do you have any recommendations for more time tested equipment? I’m not doing all that and putting it on a kickstarter product ESPECIALLY when they have that weird software lol.
Hey! I have a question. I have Jetson Nano running Xubuntu, that is running Portainer, a Docker Manager, could I have my Jetson Mount my TrueNAS Server for storage and run my own internet and hold the data on my truenas server, but have the Jetson Nano access it?
this isnt a terrible idea tbh. even just putting it on a few older harddrives you have. and a cheap nas nothing to fancy. good backup, and if u hit hard times it gives you the option of dropping it for a month or two.
I haven't completed the video yet so perhaps this is mentioned but honestly? I'd include an LLM in this. I mean, talk about an ultra-compressed way to have a lot of knowledge at your fingertips. Sure, models make shit up and hallucinate but if you know that and carry an LLM around in addition to all that's mentioned in the video, (so you can always verify information), I think you'll pretty much have all your bases covered. I know there's a lot of false hype surrounding LLM's, but if you consider them a tool and are aware of their downsides, I think they're a valuable and sane addition to a toolkit like this.
@@cringesh1t427 Portable 100+ W panels have been around for quite a while and can charge 300W battery banks. I have one that can charge my phone about 30 times before needing solar charging again. Combined with low power tablets and phones it’s actually quite feasible.
It's getting more important for people to collectively start saving as much information as possible, in bulk, than ever before. I very recently just had a look at my UA-cam playlists and rediscovered one I made during Covid times called "important historical context" which would have been filled with videos of certain political developments. ALL of the videos in that playlist were removed from UA-cam. All of them. The scary thing is, while we now have the "easiest" way to access information, the ministry of truth also now has the easiest way to curate and re-write history.
Very smart
The winners rewrite history.
I love that reference
It’s insane that I can not find a fraction of the documentaries that I used to watch on controversial topics anymore. I wish more people were aware that this type of thing is happening.
@@jayman94fly the losers can also rewrite history to pretend like they won does that make them the winners?
This video, like many others, created an overwhelming feeling along the lines of, "oh my gosh of course, he's right. I need to save at LEAST the survival information, then everything else in rank of importance". Something like that. It urges me to start prepping again. Which honestly is probably something like trying to create a safety to cope with the anxiety. But you know what, friends, I realized that even if SHTF as big and as hard as some of us prep for, I'm okay with probably dying. I mean I would give it my all, there certainly would be a lot of stress and pain. And in that scenario, most preppers would say going into it unprepared will likely spell demise. And they're probably right. But that's okay.
I recently was blessed to be able to somehow manage to put money down and start paying mortgage on a house (escape the rent trap am I right?) and over several months of living @ the new crib I realized it really is a house of cards. Between the chaos in government, ambitions of larry fink and the 1%er's, natural disasters, changes in economy, being stretched thin financially, almost getting laid off at work, fire, flood, powerful HOA's (mine is pretty chill TG), family stresses etc etc, you quickly realize that literally anything and everything can take you down and lose you everything you've ever worked for.
Life can wipe you out in more ways than you can imagine. We can certainly insure ourselves against common things and we do, but we can never prep for it all. Even if we had the most hunk of a bunker we could walk outside tomorrow, and tree branch falls on us and we get the speed nap. Make your home a home, that is, make it comfortable. But damn we've got to live our lives and not create suffering for ourselves by worrying about whether or not we have the head knowledge to find and make kindling in apocalyptic urban setting #2.
~an exaggeration that goes way beyond what this video even touches just to make a point written by a guy that will probably die someday.
sorry to be so serious but hoping this posture helps someone like it helps me.
Well said..
you know what, i appreciate the honesty
The first thing is make sure you have electricity to power your self-hosted internet if world, national or local disaster occurs.
I feel the same, except I have kids, so I have to keep them alive.
bro its such a mental hurdle to compile everything needed and back it up twice. but having a llm suite to answer questions post event would be too valuable.
Next project fitting the entire internet on a 1.5 TB sandisk mini SD card.
All human knowledge in my thumbnail
We would need hella compression for that since the internet is many zettabytes big
Only the most essential of the internet, like Wikipedia,dictionary, and world time software stuff like that , compress it so it fits.
sure. backup entire WWW onto a smart pregnancy test. what can possibly go wrong.
@teknastyk Don't be a dummy. I mean the essentials.
MOM?! WHERE DID YOU PUT MY INTERNET?!
Your sister took it
"I uh, put it away"
You don't need to get Internet, we have Internet at home
(internet at home = 56k dial up, or even better, an old timey tv arial on the roof)@@Honeybearsphone
I printed it, and then sold the gear
dude, this is such a good idea!! you should expand on this.
come up with a whole doomsday essentials pack - not just wiki, but also books, etc. key resources to survive and thrive
Would love to get my hands on a printed Encylcopaedia Britannica from say 1970 and a bunch of yearly updates.
The Next Step on Prepperism.
@@Storin_of_Kel But cyberdecks are mostly done for the challenge and the cyberpunk aesthetic. This has a more serious orientation to it.
I kinda suspect that in a doomsday scenario, being able to reliably power on any of those devices would be quite a difficult problem. If it's a man made disaster, tech infrastructure and power delivery would be an immediate target. If it's a natural disaster, I could sorta see stuff working? Idk, solar power and a whole lot of low energy devices can help.
City Prepping came at this from the doomsday prepping direction
ua-cam.com/video/N1aQX9HO8-4/v-deo.html
"Internet's most important resources: Arch Linux Documentation." What am I going to do with Arch Linux if the world's internet disappears lol. I think at that point there will be more important things to worry about. "Okay, all the cities are in shambles.. i'm starving.. I'm cold.. I've got it, let me grab my localized Arch Linux docs. At least I won't have a peasent operating system like Ubuntu."
You're not going to do anything with Arch Linux. That's not the point.
The point of the arch docs is that they are the most concise and consistently useful set of Linux documentation yet made.
*Critically*, the vast majority of the information in those docs is distro-agnostic.
I don't use Arch Linux on any of my devices. Everything in my house runs something that's Debian-based. Even with that, having access to a good-quality set of mostly system-agnostic documentation is absolutely invaluable, so I've always got the arch docs bookmarked, and it's one of the first things I'd save if I were building one of these.
I of course would also save the Debian documentation, and perhaps dump the AskUbuntu forums, in addition to Stackoverflow and Serverfault.
That being said though, what the Arch Wiki has that those don't, is brevity.
*That* is why I still use the Arch Wiki Constantly even though I haven't used Arch in years.
>decide to back up resources to be prepared when the world ends
>don't download anything technical because "i'll have more important things to worry about than my computer"
>computer breaks
>can't fix it because i didn't download the relevant resources
mfw
@@nibbletrinnal2289> be too stingy to download anything because “there are bigger issues”
> have no technology that you can use
> be in the stone age
> mfw
Kinda my thoughts too. Especially frustrating if needed to download additional packages in order to solve a problem
in a worst case scenario; internet will still be operational. all of the core infrastructure is built deep underground. we also use satellites. to say that internet wouldn't exist anymore is a myth. go play "outriders" . humanity took "all of internet" with them; when they left earth.
You forgot the most important piece of the internet!
Stack Overflow.
real
Just localize gpt 4 turbo bro.
@@mahpell7173 you can do that?
@mahpell7173 Your pfp in junction with your comment makes it funnier than it would otherwise be because it looks like you're snickering at your own joke.
Oh, nm. My mind went a complete different direction.
Literally what the guy in half life Alyx did
"You downloaded the Internet?!"
"Well, most of it anyway"
Still gotta play this game, hopefully i'll get a better gpu soon
@@ihaveagoddamnplanarthur Alyx is a good optimised game actually, I've ran it on my 1050 ti, it was stable 30 fps, but there may be places where it will drop
@@stehouse I played Alex on 1650 Super and in some moments the FPS was really good, but in some moments, due to the low FPS, I started to feel sick, although I had never felt sick in VR before.
@@ihaveagoddamnplanarthur Absolutely worth it.
Ah, the IT crowd moment :) Jane, this is the internet!
i immediately thought of that, lol.
The ELDERS of the INTERNET? The ELDERS of the INTERNET KNOW MY NAME?!
We are bunking off.....!!!!! 😂😂😂
Well…. If it’s ok with the Hawk
Jen not Jane.
Also a good reason: protecting your children from the internet by just providing an offline version of wikipedia and so on so they can still research for school projects etc. And then adding whichever other sources they need manually later.
This defeats the entire purpose of a free internet. Never cherry pick what a child can see/ learn, a child should be able to figure out things themselves and become their own person. If anything, just block the truly bad sites that could be damaging.
@@Evenaardez how is your suggestion different from what OP said?
@@OctavianAsixblocking specific types of sites rather than blocking the entire internet
@@Evenaardez As someone who had unfettered access to the internet as a child, no, you are wrong.
@@Evenaardez "figure out things themselves" and the things theyre figuring out being gore, pedos, porn etc at like 8 years old... as someone who had unlimited internet access no thanks just make them and their friends a minecraft server!
what about out of copyright books? project gutenberg type stuff? Store an entire library of stuff to read, that would be awesome
I've been doing a lot of archiving old books over the past six months- mainly on first and second hand accounts of the Civil War. Interesting stuff.
Internet Archive and Project Gutenberg both have a ton, also PDFdrive is your friend, but you can download a lot of these things and store them on a solid state drive (or a few of them if you’re a hoarder) quite easily.
@@Hypnotically_Caucasianactual hero
Or in copyright books, LibGen comes to mind :P
libgen? Annas archive? Hey @Hypnotically_Caucasian, just check there.
Local mapping data is such a godsend. Years ago we were crossing from argentina to chile through a small crossing in northern san juan, middle of the mountains aka no internet and no phobe signal, OSM was super useful for navigation :D
internet archive is another cool place to download stuff
Unfortunately being sued into oblivion by book publishers, so use it while you can
Very true
unfortunately they killed it with a new hacking attack
@@salim444 I said this 5 months ago
perfect application for my 6W TDP N100 Proxmox sever running on solar power
I have a Boox Palma and bought a 1 Tb micro SD card. I’ve got almost all of what Kiwix offers, my entire state maps downloaded, and numerous videos, documents, books, libraries, etc.
All of this in an e-reader the size of a smartphone with a battery that can last weeks, if used sparingly. It’s a pretty cool setup.
Sweet
Where do you prioritize/ find valuable documents to save etc. Maps of the area where you live makes sense, but then how to prioritize what comes next? Farming / survival skills?
@@shanoahmontano7077 that’s where the 1 TB micro SD comes into play. You don’t have to prioritize. It fits everything. Or at least everything I could think of. There’s a whole datahoarder subreddit that would scoff at it, but I’m content
great idea thanks
Just think, a AAA modern game is over 100 gigs and yet the entire Wikipedia is only 109GB!!!
thats because wikipedia is mostly text, and games are mostly binaries, textures, audio, amongst others.
That's because: Textures are pretty damn high-res nowadays, and there are several layers instead of just having a single texture (like back in 2002-ish).
You've got diffuse textures, specular textures, normal maps (bump mapping), emissive textures, ambient occlusion maps, detail textures, reflection and refraction maps, subsurface scattering maps, metalness maps. So take the size of a single texture and 10x it to cover all the different types of extra textures needed for special effects.
THAT is why games are 100+GB. Binaries (.dll and .exe files), audio, map data and others fade into naught compared to textures.
I mean famous Titanfall 's 35GB of uncompressed audio are thing.
What else you want? Maybe remove gigabytes of unused resources and locations? Or beta test gameplay?
Workers of multibillion corporation have much more important things to do, like triple check working on in game shop or implement new gatcha.
Trash takes up less space than I thought.
But 100gb are "maxi" with media, text only are far less
I already do this with a series of XHDD's. Toshiba and Seagate sell reliable hardware at a [mostly] decent price. Every time they knock the price down to 100 USD i grab one of the 4TB drives and fill it up. Between work software (IDE's mostly), movies, shows, music & games, archived websites and internet videos; ive got enough entertainment to out last the apocalypse!
Forgive my ignorant question, but I’m not too educated on all things tech:
Would I be able to somehow download things from Kiwix and the maps stuff he showed on a mobile device? He talks about downloading and then launching the data, but if it’s all been downloaded onto a mobile device, do we still need to do all of that coding stuff he’s doing to access it?
Hmm.. only 109GB for Wikipedia? I'll add that to todo list for my server. That would have been helpful back in early 2000s when I had slow Internet and doing school work.. lol 😅
But if you started downloading 109 GB back in 2000, you'd be finished just about.... now :P
That's just the text of the English Wikipedia, with images and the other languages it's like 1TB
@@ANT-jm4qxjust the text of English Wikipedia compressed is like 35gb
My man would have graduated before the download finished
@wrOngplan3t you wouldnt be finished, since youd be stuck with 2000's outdated info 😂
You'd better shield that NAS from magnetic pulse/solar flare events or it will be wiped/fried. You MUST GROUND YOUR SHIELD (screen or copper metal fabric) !!!
Hard drives are literally faraday cages by design. At most the PCB fuse would burn, which is easily replaced or bypassed. The data on the platter is safe.
That's not how solar flares interact with a NAS, but I can appreciate the sentiment.
Being a Venezuelan, I totally understand you and backup your actions. Thanks you very much for sharing your expertise with those of us who may need it in the future. (God forbid it though, because that would mean the SHTF).
Hi , sorry for the of topic. I would advise to turn down the fill ligh by about 2 stops. So there will be more volume. Used to work as second DP , or as a gaffer in cinema production for almost a decade .
Best wishes
I'll give it a try. 😎
@@TechHut how did it go?
We speak the same language, but I have no idea what you just said! I wish I could understand all this tech stuff and actually apply it, since I want to try doing this mapping and internet downloading thing myself.
Me: "Mom, can we have Internet?"
Mom: "We have Internet at home"
Internet at home:
Coming home after a long day at school to relax with some wikipedia articles.
are you trying to be funny?
It's a nice to know that wikipedia is small enough for anybody to make a backup of.
I had to laugh at 109GB being small. My first hard drive was 100K....
@WoefulMinion A few Blu ray disks is probably how I'd back it up rather than dedicated hard drive space, unless I'm actively using it (which is unlikely)
@@WoefulMinion Things change quickly eh - I remember buying a 16k ram upgrade for an apple ][ that cost a fortune. Now I'm ripping a single 4k UHD movie and it's 120GB.
@@patrickpaganini Upgrading my TRS Color Computer from 4K to 16K cost my parents as much as the computer.
I think that a GPT-4 trained model (a recent version of it got leaked, so it's widely available if you search) would be an excellent addition!
Besides being trained into the larger context of today's Internet, it's "knowledge" is stored into the trained model, so theoretically you wouldn't need Wikipedia (although I REALLY recommend it).
Why not use both? (But seriously, is there any way to download all of wiki and world mapping AND also GPT-4 onto a single mobile device (with a solar powered battery or case)?
This reminds me of that IT Crowd episode where they convince people the internet is in a black box.
Because it will be
They need to make a Vault (or even multiple) for the internet like the Svalbard Global Seed Vault.
The main purpose would be for re-uploading in the event of unforeseen events causing the internet to go offline, such as major Solar Storms if they are ever to occur!
As for viability:
Estimates suggest that it contains hundreds of exabytes (1 exabyte = 1 billion gigabytes) of data. This includes everything from web pages, images, videos, documents, emails, social media posts, and more.
Our largest yet known to the public is Microsoft’s Azure Data Center, which has 15 exabytes of storage.
Microsoft also came up with extremely resilient storage disks that can withstand major damage of just about any kind, called Project Silica.
These can already store 7 TB of data per 75mm * 75 mm * 2 mm
Right now it would require about a billion of these disks to store it all
But allegedly Microsoft is planning to apply this tech to their 15 exabyte Azure Data Center, it might be feasible after all!
So… these discs probably won’t be available for commercial or private use?
Tomorrow I will download the internet, and then cut the cable! Take that, ISP!
unfortunately the internet constantly updates...
also im in australia so it'll take about 8 hours to download wikipedia as it is
I think I want to integrate one of those ChatGPT OpenAI AIs and run the AI offline with this offline data set.
@@zonk1477 the AI would need crazy amounts of RAM and data to be usefull.
@@Dave-cx3dr llama2 lore
The investigative reporter - Whitney Webb - highly recommended people doing this type of thing.She predicted (based on evidence she found) that there is a plan in place to take down the internet (and later do a "3.0 reboot of it ) to aid in forcing everyone on CBDCs and massive censorship / blocking access to certain information. Although, I think the option featured here is more sophisticated than what she had in mind for grabbing stuff off the internet.
How long ago did she say this?
Born and raised in Sunnyside, WA! Spent my life bouncing around the West but mostly WA and AZ. Thank goodness, projects like this mean that society will be much easier to restart if, God forbid, the worst case scenario does occur.
What a neat concept! I'd heard of Kiwix before but didn't realize what you could do with it. Cool that you can load mapping data too.
Dude, I'm so proud of you. 198,000 subscribers? Crazy. Keep killing it dude. from Warpiggies, to techhut.
This is actually a great idea. Similar to having a library of information in your private collection.
For some reason I love watching videos about setting up servers and networks.
This is the best tech channel ive seen and im still subscribed
Thanks now my bunker is complete.
I was going to back green, but I'm concerned that the software will either have my data hit their server or they will somehow have access to the data. I wanted it for work but can't risk client data confidentiality.
This is the best! So glad I subscribed to this channel!
Not sure if I can afford my little bits of the internet.
This has been something I've been planning to do for a long time but wasn't quite sure how. I really wanted to build a sort of STC (Standard Template Construct) server for myself if basically everything went to shit. Thanks very much! I'll be setting this up ASAP! :)
Better put it in a faraday cage and keep it off direct contact with the net.
I love where you’re going with this… for some of us.. Web 3.0 being decentralized… if you think about it… initially we all were decentralized before off the cloud. ☺️ I see that becoming a thing again. Loved the video.
Love it, awsome knowledge and content. Thank you for the share.
Honestly if space travel ever becomes more mainstream each ship is going to need its own ‘internet’ that can be updated when a connection is available.
I think we’re close to the point where we could ask an AI to use Wikipedia to make an update to the last 2010 print version of the encyclopedia with updated information. One that would be printed out. You could even get it to make a 1 book summary or 5 book or what ever. Depending on how much you actually want to print or read. But training an AI on the old encyclopedia Britannica might require uploading multiple years so the AI can learn what type of information gets added or removed over the years. So the goal being that the AI would know to add important scientific advances or major political events. With the Wikipedia data the AI could cross reference those changes with the much larger Wikipedia data set. Obviously it would be copyright infringement unless Brittanica signed off on it or participated. I think the company still exist but is much smaller and just does online: But that would be a cool project.
A simpler solution might be to just use Wikipedia to make an update book or books for any version of encyclopedia you own. So if you have the 2010 you would have a book that has the updated events since that edition came out. If you own a 1980 set you might need 3 update books for example.
This is unironically the best present for Mother’s Day. Hell yeah
Better idea. Wifi or Bluetooth compressed file data sharing that connects automatically to multiple people. Maybe 2 other devices or more. Theres a similar idea in bluetooth walkie talkies, but no one has been able to get it to work well
This takes me back to the IT Crowd where they convince Jen that the internet is just a black box with a flashing LED on it.
Remind me of the good old days when I coded our website such, that when a certain file was being downloaded, a box opened with “Downloading Internet”.
And then the counter going from 0 towards millions of gigabytes.
This was in the dial up era, and almost everybody cancelled the download.
Save everything you find important to your life. (Pictures, music, movies, research, books, etc) aside from what you like. You don’t have a prayer of storing the entire internet. Just focus on what you can’t live the rest of your life without. I personally have a few drives containing everything I love about the digital age. If the apocalypse comes, I’ll be set in terms of entertainment 😂
Every company should store there sites everyday on a hard drive and then have a second feed source like satellite land line and signal so it stays active no matter what happens
I have self hosted many things, but not yet the Internet
Thanks again.
My idea of a nas is plugging an external drive into the CASA server
Time to archive the internet archive
I've been downloading my vidoes. and PDF's in my collection but this is next level!
Much simpler than hosting a tile server is to use cruiser (available on aur) and just have the files available for use offline.
Did you install Proxmox on the UGreen NAS?
Next video get a list of github project to backup along side, for linux enthusiasts, hackers and anything useful that is on github that has to be there on an old hdd. I will be using 1 Tb old sshd for this, no nas or anything facy just putting something to work. Any tips and tricks to do with that are welcome follow :) #theendisnear
I really like this idea, especially since, and correct me if I'm wrong, more and more internet resources are now being locked behind paywalls and subscriptions
Only just noticed this. Outstanding, mate. Thank you so much.
Out of curiosity. noticed you are using Edge on Linux ... is the hardware decoding working for you on the browser, vp9, h.264 and av1 or is it using CPU when watching videos, like on UA-cam?
Reminds me of the Brit comedy TV series 'The IT Crowd.' episode when they convince one staff the whole internet is in a little black box.
People who pay for life insurance aren't "doomers".
This isn't being a "doomer" either. It's sensible, because we take the internet for granted when it will be the first thing to go out even during a minor event.
Recent history has shown us the internet will be removed in times of turmoil.
Wikipedia is just a good start for research, but, it's not a credible source.
I just want to put my ISO Linux, games, and movies on my NAS.
Wikipedia does not pretend to be authoritative, but gives links to all the source documents which ARE, at least within the limits of current human knowledge.
What would interest me is a means of downloading what actually changed in a target for localisation, so that it can be incrementally upgraded.
What's your go-to for downloading satellite maps?
The absolute muscle memory of clicking the word trains.
For those wondering: the Windows noise at 7:52 is in the video and not coming from your computer.
The internets most important resources "what is mewing and how do you do it?" 🤨
Remember that scene from the IT Crowd where Roy ans Mos hand over Jane "the Internet"?
This right here is a member of the elders of the internet.
I have my Internet on a floppy disk since the 90's
I think it would be interesting if you could have this done with pdfs. Make a virtual library of sorts.
Remember the episode of the IT Crowd where they give Jen the small black box and call it the Internet... 😶🌫️
yep, live it lik its ur last
Wouldnt be better to use NFS for the storage?
What problem did you use to open/read/use the maps? Been trying to access on my computer(not creating an entire server or anything) and im having issues.
this reminds me of the guy that begged us to buy bitcoin in 2012
you look exactly what you sound like, and you look exactly like someone who would do this
i'm genuinely impressed
good video
I'm both offended and honored. Thank you 🙏
I think the biggest flaw to this end O' the world storage plan, is the fact that all the data is stored on a hard drive & not an SSD.
i think you are forgetting that ssd while super fast has a huge flaw that doesnt allow for shtf scenarios, or simply just not being allow for not being powered off and on regulary. The term that comes to mind is " Volatile data". magnetic/ hdd storage has proven to be the most reliable time and time again... unlesss i missunderstood the ins and outs of hdd vs ssd drives
Jen, this is THE INTERNET!!!
I am so happy the elders of the internet finally entrusted you with it, don't drop it
Love this 😮
so, it's limited to Kiwix right now? any other source platforms like that? or self-hosted scraping+compression maybe?
i've been doing this for years.
currently i have 22.4 terabytes of prawn on my own personal server.
when the world ends and money's worthless i'll be just fine selling scenes from "close encounters of the nude kind 2: we probe them" for food, gas to run my generator, and other supplies.
Jellyfin is another great option to put into this
Currently downloading youtube.
it would be very nice to the front end users if there was a an app of an offline browser that lists all the databases currently downloaded on your computer. I can sorta handle the set up process but constantly remembering what to type in to access the database makes head hurt
This , Jen , is the Internet.
Do you have any recommendations for more time tested equipment? I’m not doing all that and putting it on a kickstarter product ESPECIALLY when they have that weird software lol.
Hey! I have a question. I have Jetson Nano running Xubuntu, that is running Portainer, a Docker Manager, could I have my Jetson Mount my TrueNAS Server for storage and run my own internet and hold the data on my truenas server, but have the Jetson Nano access it?
Oh so very cool, this would be a very good VM for me to try thanks so much for a great video!!
The innernette
now available on a set of 12 compact discs
order now
I'd feel bad about putting my important internet stuff on spinning disks in case it makes the girls dizzy
"Do this if you dont trust your government." Well looks like WE ALL have a new weekend project lol!
plenty of times ive needed offline mapping because I was out of range of cellular or in a hole that wasn't covered by cell service.
is it necessary to go via VM & docker with Proxmox when there is also option for like lxc?
Curiously, today at work I needed to do something like this and I think the best option is wget with --mirror --convert-links and other flags
can you please explain why ?
what about having endless os as a liveboot flashdrive?
How do you keep the kiwix data updated?
I have a question will this help with console players not getting lagged switch on?
What's the usefulness of hosting some Linux distribution wiki without the repositories?
this isnt a terrible idea tbh. even just putting it on a few older harddrives you have. and a cheap nas nothing to fancy. good backup, and if u hit hard times it gives you the option of dropping it for a month or two.
Those drives aren’t solid state. Do they make SSD?
I haven't completed the video yet so perhaps this is mentioned but honestly? I'd include an LLM in this. I mean, talk about an ultra-compressed way to have a lot of knowledge at your fingertips. Sure, models make shit up and hallucinate but if you know that and carry an LLM around in addition to all that's mentioned in the video, (so you can always verify information), I think you'll pretty much have all your bases covered. I know there's a lot of false hype surrounding LLM's, but if you consider them a tool and are aware of their downsides, I think they're a valuable and sane addition to a toolkit like this.
I'm sure I just missed it but how exactly do I connect to my Homeserver during Doomsday in the middle of nowhere?
The NAS fits in a backpack. Connect it to a Wifi hotspot and you're good to go.
@@Reichstaubenminister and if we go in with the assumption our power goes down as there may be no actual management of such if the world went to shit?
Solar power and your own network infrastructure
@@cringesh1t427 Portable 100+ W panels have been around for quite a while and can charge 300W battery banks. I have one that can charge my phone about 30 times before needing solar charging again. Combined with low power tablets and phones it’s actually quite feasible.