How the internet became searchable

Поділитися
Вставка
  • Опубліковано 26 кві 2024
  • The curious story of how a college student wrote a shell script and ended up changing the Internet. We take a look at the anonymous FTP search engine called Archie, and find out how it disappeared just as quickly as it arrived.
    Want more content like this? Support our mission! Send us a Super Thanks and check out our Patreon + Discord community: / serialport
    Got some retro gear you want to donate? Get in touch with us at serialport.org.
    Our second channel: @TheParallelPort
    00:00 - Intro
    00:45 - Resource Discovery Problem
    02:27 - Mike Schwartz
    05:57 - The first search engine
    06:28 - Alan Emtage
    15:46 - The web emerges
    17:57 - Mission impossible
    18:37 - Outro
    #internet #technology #90s
    References and sources: docs.google.com/document/d/e/...
  • Наука та технологія

КОМЕНТАРІ • 92

  • @MarkyShaw
    @MarkyShaw Місяць тому +129

    Anybody miss the explorative nature of the old net? Nowadays it seems like the paradigm has shifted to having too much information. Most of which is delivered to us whether we like it or not. At least the algorithm knows I love content like this. Thanks for helping us remember where we came from.

    • @commentidelloziopera
      @commentidelloziopera Місяць тому +25

      it has shifted from explorative to exploitative

    • @jamescollier3
      @jamescollier3 Місяць тому +2

      yeah, The Machine

    • @kazwat
      @kazwat Місяць тому

      you should try using some distributed web tech! ipfs is a great protocol that needs applications and users

    • @jfbeam
      @jfbeam Місяць тому +8

      To me, the "information overload" is born out of spammers and the SEO industry. It's made it difficult to find the things you're actually looking for.

    • @ScottPlude
      @ScottPlude Місяць тому +15

      The "old net" was truly great. The "new internet" is either rotten due to corporate control or fake due to certain influences and AI bots. Nothing can be trusted, not even audio and video now. So sad.

  • @Thiesi
    @Thiesi Місяць тому +32

    Wait - what?! After setting up your own dial-up ISP on period-correct hardware, you are now setting up an _Archie_ server?! Oh boy does this UA-cam channel not disappoint and tickle me in all the right places!

    • @hthring
      @hthring 27 днів тому +1

      omg im pumped for this, i might even start my own anonymous ftp !

    • @Thiesi
      @Thiesi 27 днів тому

      @@hthring Be careful with that though - mine got constantly abused for distributing stuff I probably wouldn't want to be associated with me until I disabled anonymous _downloads_ (not uploads though).

    • @hthring
      @hthring 26 днів тому

      @@Thiesi wouldn't it make more sense to have anonymous downloads but not uploads?

    • @Thiesi
      @Thiesi 26 днів тому

      @@hthring No, because I want those evil evilists to waste their time and bandwidth. Admittedly, that's not that big of an issue anymore nowadays, but I've been running my FTP server for literally decades now.
      Also, maybe someone does upload something useful at some point. (Not that that has ever happened though.)

  • @imadcom2010
    @imadcom2010 Місяць тому +25

    Great channel, I have been working in technology for over 2 decades and every time I watch this channel I learn something new.

  • @compu85
    @compu85 Місяць тому +9

    The production quality of this presentation is fantastic! Looking forward to part two!

  • @pjbeardsley
    @pjbeardsley Місяць тому +6

    I remember Archie!!! As a college student in the early 90s and was fortunate enough to experience this transformation. Thank you for capturing this history, love the channel.

  • @bitegoatie
    @bitegoatie Місяць тому +13

    It's hard to believe no one kept up the technology for the extant FTP servers out there, just for the sake of doing it. People maintain all sorts of old tech as a hobby, as a curiosity. Given how important Archie was - and it was, as you say - that it has completely vanished is just atypical and, to overstate it just a bit, astounding.

    • @Invenciblemario
      @Invenciblemario 26 днів тому +1

      Lots of maintenance work including responding to dmca takedowns. Same as a normal search engine.

  • @iGrave
    @iGrave Місяць тому +11

    Ooh a cliffhanger! You tease :)
    Can't wait

  • @AWalYT
    @AWalYT Місяць тому +7

    I was super young (just barely in my teens) when I found out about Archie. Crazy to see it talked about here all these years later...It was definitely a tool of it's time...

  • @sh0ckwaveVR6
    @sh0ckwaveVR6 Місяць тому +5

    I'm from Quebec and I had no idea that the first Search engine was invented at McGill! Wow can't wait to see the next video! This is fascinating

  • @mx338
    @mx338 Місяць тому +11

    Amazing little documentary, can't wait for the next part.

  • @kevinstatz
    @kevinstatz 26 днів тому

    These videos are so good. I always learn something new. The Serial Port crew has serious talent in presenting content like this. Taking the extra step and tying in a project or working demo makes it even more engaging.
    I'm only 31 so my earliest memories of the internet and search engines are rooted in the mid 90s. Part of the fun for me is learning about technologies from before i was even alive that make the Internet as we know it today possible.

  • @greatquux
    @greatquux Місяць тому +3

    Nice, great interviews with people who were there, and looking forward to the server being up. Gonna join a Patreon level just for this!

  • @info-saturation
    @info-saturation Місяць тому +8

    This was utterly fascinating, thank you for making this

  • @boblister6174
    @boblister6174 Місяць тому +14

    Sadly this video makes me realize how long I've been on the net I remember using this. Good information for people that never had access in the early 90's.(legitimate or not)

  • @ImpiantoFacile
    @ImpiantoFacile Місяць тому +7

    Love all your videos. The production quality is amazing.

  • @ScottPlude
    @ScottPlude Місяць тому +3

    I really enjoyed this video. I just wish I had friends that also enjoyed content like this. I have family that lives with their faces glued to their iPhones and customers that pay me to know "nerd stuff" so they don't have to be bothered by anything technical.
    Thanks for making this video!

  • @danyay
    @danyay Місяць тому +8

    Face reveal video! Love this channel, great video. Keep it up!!

  • @bigMax1337
    @bigMax1337 26 днів тому

    I love how this basically becomes a how to on how to build up a parallel internet. I think there is something amazing about having your own infrastructure and independence for large companies.

  • @LB4FH
    @LB4FH Місяць тому +4

    Nice to see and hear this part of the internet history 👍🏻 Also, I love seeing the old internet map with the only non-US nodes being Norway and London

  • @ahbailglail
    @ahbailglail Місяць тому +2

    Amazing video! Awesome you got to interview Alan

  • @Zoeylindaringo
    @Zoeylindaringo Місяць тому +1

    Absolutely great video! I love this channel.

  • @astacc
    @astacc 28 днів тому

    Thanks for making all these great videos. Without this, I don't think I would ever even think of researching this much about early internet

  • @jj74qformerlyjailbreak3
    @jj74qformerlyjailbreak3 27 днів тому

    The Name of this Channel alone deserves a Subscription

  • @Seanbyford
    @Seanbyford 29 днів тому

    Randomly recommended this by UA-cam…and I’m glad it was! Great content - having lived through the era or nothing to now - and also being a massive nerd; this is wonderful to watch

  • @JamesBos
    @JamesBos 29 днів тому

    This was wonderful. Thank you! 😊

  • @NotStoopid0228
    @NotStoopid0228 Місяць тому +1

    Keep up the great work

  • @JUSTforwhitlisting
    @JUSTforwhitlisting Місяць тому +1

    As a Concordia graduate, interesting to see that search began at McGill

  • @Phillip3223
    @Phillip3223 Місяць тому +1

    The field of search engines is so much undervalued I feel. Thanks for creating this video, sharing some insights of the very start.
    As a fun note from my own experience: Hyperlinks are a double edged sword. They are the very building block a search engine may follow along, but there is so much noise. Or rather "DUST" (duplicate url same text)

    • @TheBardicDruid
      @TheBardicDruid Місяць тому

      "The field of search engines is so much undervalued" If you think that, just try using your own search engine and watch how quickly and viciously Google comes after you, after all, they own every search engine on the internet.

  • @patteahan8704
    @patteahan8704 Місяць тому +1

    Super cool. Can't wait for the follow up

  • @jonathanplevine
    @jonathanplevine 23 дні тому

    I used to work with Alan at Bunyip. Good times! At some point I was working on a prototype for a product that was basically the same idea as Amazon in its earliest form. Then some new VP came in and said: This is stupid, no one is ever going to _buy_ things on the internet. Shut it down.

  • @KaldekBoch
    @KaldekBoch Місяць тому +3

    I used Archie from Australia using a 1200 baud modem in the very early 1990s, but I was very young and had no idea what was really going on! I recall we dialled into Monash University, or perhaps Latrobe.
    Of course, we downloaded ASCII porn. 12 year olds gonna 12 year old I guess.

  • @capybara5494
    @capybara5494 Місяць тому +3

    Holy shit that was awesome i’m so pumped

  • @josephk6373
    @josephk6373 Місяць тому

    wow, so cool excellent content every time!

  • @ScottPlude
    @ScottPlude Місяць тому +1

    Thanks!

  • @audiocrush
    @audiocrush Місяць тому +1

    What a cliffhanger! :D

  • @TeslaTales59
    @TeslaTales59 Місяць тому +2

    How I remember those ftp searching days!
    One of the first GUIs was made by WRQ-
    Made it much easier? Does anyone remember that?

  • @Memerino-ly7yr
    @Memerino-ly7yr Місяць тому +1

    Positively awesome

  • @mikemaldanado6015
    @mikemaldanado6015 25 днів тому

    I used to use archie all the time but did not know the backstory, this was interesting. Thanks. btw my friends and i used to discover computers by each war dialing a subset of phone numbers every night. Surprisingly we discovered some interesting computers, some of them run by the govt. Most allowed anonymous ftp access back then....

  • @jfbeam
    @jfbeam Місяць тому +1

    This was true before the explosive growth of the internet as well. BBS's weren't advertised on interstate billboards. It was very much a matter of who you knew. (and what they're willing to share.) To a much lesser degree, that sort of thing still exists. (The media likes to call it "The Dark Web".)

  • @binarybear9711
    @binarybear9711 29 днів тому

    Oh boi,
    this technology journey is stunning for a young person like me (24yo). For me the Internet started to take place in my Life with Windows XP and 1k dialup...😅
    Todays I even feel "Special" when I can Talk about IDE, floppy disks and the time when you got to disconnect from the internet, because of mom wants to call somebody 😂

  • @protox07
    @protox07 17 днів тому

    I like your videos

  • @edwardbyard6540
    @edwardbyard6540 Місяць тому

    I miss the BBS and 90s internet days. I'm talking Usenet, CompuServe and maybe even Geocities era. No social media, no scams (well, maybe a bit of pump and dump stock fraud) but the internet today is a cess pit. It needs fixing, but how I do not know.

  • @evilborg
    @evilborg Місяць тому +2

    I remember archie.....

  • @andrewmuller3514
    @andrewmuller3514 Місяць тому

    🔥🔥

  • @NicholasAndre1
    @NicholasAndre1 28 днів тому

    Ok I’m gonna call this out: your film frame border you used is tmax 3200 which is a high speed black and white film, not a color one 😂
    Alright I’ve concluded my pedantry. Amazing video btw.

  • @mikehosken4328
    @mikehosken4328 Місяць тому

    Early 90’s internet was the best

  • @dcchillin4687
    @dcchillin4687 27 днів тому

    Where would the world be without Altavista?

  • @rweninger
    @rweninger Місяць тому

    I still love FTP Servers. They are beautiful simple. I hate complex HTTP Portals they use nowadays. Happy at least in the bubble I am, more and more FTP's (secure) reappear.

  • @Sauceyjames
    @Sauceyjames Місяць тому +1

    FTP is treated as a command prompt?? I was wondering why it was Impossible for me to download files 1995 and older on ftp websites.

    • @nickwallette6201
      @nickwallette6201 Місяць тому +3

      Not exactly. It's a command-based protocol, but the FTP client is responsible for translating user input to server commands. So, it CAN be CLI... but it doesn't have to be. It just depends on the client software you use. Obviously, in the days of text-mode interfaces, it was used primarily through a command-line client.
      FTP and SMTP (email) are very similar in this way. The commands and responses are designed to be parsable by both humans and computers, and both present a session that you use commands to interact with. However, pretty much nobody interacts directly with an email server, while it's (relatively) common to use FTP interactively.
      There's nothing preventing you from using a terminal app to connect to an email server and read your email interactively. Likewise, browsers and other software can navigate an FTP session and grab a file without any further input.

    • @sophya5796
      @sophya5796 29 днів тому

      Been ill since October and most days it just seems there's nothing to look forward to anymore. So grateful for this channel for trying to challenge that feeling 💔

  • @tsstsstsstsstsstss
    @tsstsstsstsstsstss Місяць тому +3

    Woohooo!

  • @Neuer_Alias_erstellen
    @Neuer_Alias_erstellen 27 днів тому

    cool

  • @user-pe4bv7vm2y
    @user-pe4bv7vm2y Місяць тому

    Anyone remember Gegereka?

  • @iOMNetwork
    @iOMNetwork 29 днів тому

    Hey, I have an index of all files from all anonymous FTP server. its a 21 GB large file. Let me know if you need it. Imo its not really worth the effort of running a service like archie. There is no benefit in it since you cant ensure availability. It would be easier to load all the files and provide them in a google drive with unlimited space. As far as I can see there is no interesting stuff anymore besides backup files, huge map archives. And then there are files that can put u in troubles due to copyright stuff like movies.

  • @mahtin
    @mahtin Місяць тому

    ls -lR … the results aren’t dated back to the 80’s 😄

  • @brago.gameplays
    @brago.gameplays Місяць тому

    Wellcone to the ftp saga

  • @hotrodhunk7389
    @hotrodhunk7389 Місяць тому +1

    Hash map

  • @dominick253
    @dominick253 Місяць тому +1

    Surf the web man!

  • @alphago9397
    @alphago9397 26 днів тому

    Of course .. it had to be one of the "un-intelligence agencies" ... lol

  • @cookiemikuchan
    @cookiemikuchan 26 днів тому

    silly title for the video considering search engines are now comprised of AI slideshows and advertisements instead of search results

  • @radicant7283
    @radicant7283 Місяць тому

    Not anymore it's not