How the internet became searchable

Рет қаралды 24,747

Күн бұрын

The curious story of how a college student wrote a shell script and ended up changing the Internet. We take a look at the anonymous FTP search engine called Archie, and find out how it disappeared just as quickly as it arrived.
Want more content like this? Support our mission! Send us a Super Thanks and check out our Patreon + Discord community: / serialport
Got some retro gear you want to donate? Get in touch with us at serialport.org.
Our second channel: ‪@TheParallelPort‬
00:00 - Intro
00:45 - Resource Discovery Problem
02:27 - Mike Schwartz
05:57 - The first search engine
06:28 - Alan Emtage
15:46 - The web emerges
17:57 - Mission impossible
18:37 - Outro
#internet #technology #90s
References and sources: docs.google.com/document/d/e/...

Пікірлер: 98

@MarkyShaw 2 ай бұрын

Anybody miss the explorative nature of the old net? Nowadays it seems like the paradigm has shifted to having too much information. Most of which is delivered to us whether we like it or not. At least the algorithm knows I love content like this. Thanks for helping us remember where we came from.

@tcscomment 2 ай бұрын

it has shifted from explorative to exploitative

@jamescollier3 2 ай бұрын

yeah, The Machine

@kazwat 2 ай бұрын

you should try using some distributed web tech! ipfs is a great protocol that needs applications and users

@jfbeam 2 ай бұрын

To me, the "information overload" is born out of spammers and the SEO industry. It's made it difficult to find the things you're actually looking for.

@ScottPlude 2 ай бұрын

The "old net" was truly great. The "new internet" is either rotten due to corporate control or fake due to certain influences and AI bots. Nothing can be trusted, not even audio and video now. So sad.

@Thiesi 2 ай бұрын

Wait - what?! After setting up your own dial-up ISP on period-correct hardware, you are now setting up an _Archie_ server?! Oh boy does this KZfaq channel not disappoint and tickle me in all the right places!

@hthring 2 ай бұрын

omg im pumped for this, i might even start my own anonymous ftp !

@Thiesi 2 ай бұрын

@@hthring Be careful with that though - mine got constantly abused for distributing stuff I probably wouldn't want to be associated with me until I disabled anonymous _downloads_ (not uploads though).

@hthring 2 ай бұрын

@@Thiesi wouldn't it make more sense to have anonymous downloads but not uploads?

@Thiesi 2 ай бұрын

@@hthring No, because I want those evil evilists to waste their time and bandwidth. Admittedly, that's not that big of an issue anymore nowadays, but I've been running my FTP server for literally decades now. Also, maybe someone does upload something useful at some point. (Not that that has ever happened though.)

@bitegoatie 2 ай бұрын

It's hard to believe no one kept up the technology for the extant FTP servers out there, just for the sake of doing it. People maintain all sorts of old tech as a hobby, as a curiosity. Given how important Archie was - and it was, as you say - that it has completely vanished is just atypical and, to overstate it just a bit, astounding.

@Invenciblemario 2 ай бұрын

Lots of maintenance work including responding to dmca takedowns. Same as a normal search engine.

@jonathanplevine 2 ай бұрын

I used to work with Alan at Bunyip. Good times! At some point I was working on a prototype for a product that was basically the same idea as Amazon in its earliest form. Then some new VP came in and said: This is stupid, no one is ever going to _buy_ things on the internet. Shut it down.

@imadcom2010 2 ай бұрын

Great channel, I have been working in technology for over 2 decades and every time I watch this channel I learn something new.

@AWalYT 2 ай бұрын

I was super young (just barely in my teens) when I found out about Archie. Crazy to see it talked about here all these years later...It was definitely a tool of it's time...

@ScottPlude 2 ай бұрын

I really enjoyed this video. I just wish I had friends that also enjoyed content like this. I have family that lives with their faces glued to their iPhones and customers that pay me to know "nerd stuff" so they don't have to be bothered by anything technical. Thanks for making this video!

@iGrave 2 ай бұрын

Ooh a cliffhanger! You tease :) Can't wait

@mx338 2 ай бұрын

Amazing little documentary, can't wait for the next part.

@DJSubAir 2 ай бұрын

Me too :)

@binarybear9711 2 ай бұрын

Oh boi, this technology journey is stunning for a young person like me (24yo). For me the Internet started to take place in my Life with Windows XP and 1k dialup...😅 Todays I even feel "Special" when I can Talk about IDE, floppy disks and the time when you got to disconnect from the internet, because of mom wants to call somebody 😂

@kevinstatz 2 ай бұрын

These videos are so good. I always learn something new. The Serial Port crew has serious talent in presenting content like this. Taking the extra step and tying in a project or working demo makes it even more engaging. I'm only 31 so my earliest memories of the internet and search engines are rooted in the mid 90s. Part of the fun for me is learning about technologies from before i was even alive that make the Internet as we know it today possible.

@sh0ckwaveVR6 2 ай бұрын

I'm from Quebec and I had no idea that the first Search engine was invented at McGill! Wow can't wait to see the next video! This is fascinating

@danyay 2 ай бұрын

Face reveal video! Love this channel, great video. Keep it up!!

@compu85 2 ай бұрын

The production quality of this presentation is fantastic! Looking forward to part two!

@KaldekBoch 2 ай бұрын

I used Archie from Australia using a 1200 baud modem in the very early 1990s, but I was very young and had no idea what was really going on! I recall we dialled into Monash University, or perhaps Latrobe. Of course, we downloaded ASCII porn. 12 year olds gonna 12 year old I guess.

@boblister6174 2 ай бұрын

Sadly this video makes me realize how long I've been on the net I remember using this. Good information for people that never had access in the early 90's.(legitimate or not)

@pjbeardsley 2 ай бұрын

I remember Archie!!! As a college student in the early 90s and was fortunate enough to experience this transformation. Thank you for capturing this history, love the channel.

@greatquux 2 ай бұрын

Nice, great interviews with people who were there, and looking forward to the server being up. Gonna join a Patreon level just for this!

@info-saturation 2 ай бұрын

This was utterly fascinating, thank you for making this

@jj74qformerlyjailbreak3 2 ай бұрын

The Name of this Channel alone deserves a Subscription

@LB4FH 2 ай бұрын

Nice to see and hear this part of the internet history 👍🏻 Also, I love seeing the old internet map with the only non-US nodes being Norway and London

@ImpiantoFacile 2 ай бұрын

Love all your videos. The production quality is amazing.

@bigMax1337 2 ай бұрын

I love how this basically becomes a how to on how to build up a parallel internet. I think there is something amazing about having your own infrastructure and independence for large companies.

@capybara5494 2 ай бұрын

Holy shit that was awesome i’m so pumped

@ahbailglail 2 ай бұрын

Amazing video! Awesome you got to interview Alan

@Leftylove22 2 ай бұрын

Absolutely great video! I love this channel.

@BigMacIIx Ай бұрын

I''m feeling so old now remembering connecting on the RISQ network with a 1200baud modem for searching warez with Archie.

@astacc 2 ай бұрын

Thanks for making all these great videos. Without this, I don't think I would ever even think of researching this much about early internet

@Seanbyford 2 ай бұрын

Randomly recommended this by KZfaq…and I’m glad it was! Great content - having lived through the era or nothing to now - and also being a massive nerd; this is wonderful to watch

@JamesBos 2 ай бұрын

This was wonderful. Thank you! 😊

@easteregg8699 Ай бұрын

is just want to put out here, how much i love your content. all of this is just amazing !

@patteahan8704 2 ай бұрын

Super cool. Can't wait for the follow up

@Phillip3223 2 ай бұрын

The field of search engines is so much undervalued I feel. Thanks for creating this video, sharing some insights of the very start. As a fun note from my own experience: Hyperlinks are a double edged sword. They are the very building block a search engine may follow along, but there is so much noise. Or rather "DUST" (duplicate url same text)

@TheBardicDruid 2 ай бұрын

"The field of search engines is so much undervalued" If you think that, just try using your own search engine and watch how quickly and viciously Google comes after you, after all, they own every search engine on the internet.

@NotStoopid0228 2 ай бұрын

Keep up the great work

@JUSTforwhitlisting 2 ай бұрын

As a Concordia graduate, interesting to see that search began at McGill

@ScottPlude 2 ай бұрын

Thanks!

@josephk6373 2 ай бұрын

wow, so cool excellent content every time!

@audiocrush 2 ай бұрын

What a cliffhanger! :D

@jfbeam 2 ай бұрын

This was true before the explosive growth of the internet as well. BBS's weren't advertised on interstate billboards. It was very much a matter of who you knew. (and what they're willing to share.) To a much lesser degree, that sort of thing still exists. (The media likes to call it "The Dark Web".)

@Memerino-ly7yr 2 ай бұрын

Positively awesome

@mikemaldanado6015 2 ай бұрын

I used to use archie all the time but did not know the backstory, this was interesting. Thanks. btw my friends and i used to discover computers by each war dialing a subset of phone numbers every night. Surprisingly we discovered some interesting computers, some of them run by the govt. Most allowed anonymous ftp access back then....

@bluesquare23 2 ай бұрын

ZnRwLmJsdWVzcXVhcmUyMy5zaA==

@edwardbyard6540 2 ай бұрын

I miss the BBS and 90s internet days. I'm talking Usenet, CompuServe and maybe even Geocities era. No social media, no scams (well, maybe a bit of pump and dump stock fraud) but the internet today is a cess pit. It needs fixing, but how I do not know.

@lesfreresdelaquote1176 Ай бұрын

Tant de souvenirs. So many memories

@TeslaTales59 2 ай бұрын

How I remember those ftp searching days! One of the first GUIs was made by WRQ- Made it much easier? Does anyone remember that?

@protox07 2 ай бұрын

I like your videos

@evilborg 2 ай бұрын

I remember archie.....

@andrewmuller3514 2 ай бұрын

🔥🔥

@NicholasAndre1 2 ай бұрын

Ok I’m gonna call this out: your film frame border you used is tmax 3200 which is a high speed black and white film, not a color one 😂 Alright I’ve concluded my pedantry. Amazing video btw.

@dcchillin4687 2 ай бұрын

Where would the world be without Altavista?

@tsstsstsstsstsstss 2 ай бұрын

Woohooo!

@mikehosken4328 2 ай бұрын

Early 90’s internet was the best

@Neuer_Alias_erstellen 2 ай бұрын

cool

@iOMNetwork 2 ай бұрын

Hey, I have an index of all files from all anonymous FTP server. its a 21 GB large file. Let me know if you need it. Imo its not really worth the effort of running a service like archie. There is no benefit in it since you cant ensure availability. It would be easier to load all the files and provide them in a google drive with unlimited space. As far as I can see there is no interesting stuff anymore besides backup files, huge map archives. And then there are files that can put u in troubles due to copyright stuff like movies.

@Sauceyjames 2 ай бұрын

FTP is treated as a command prompt?? I was wondering why it was Impossible for me to download files 1995 and older on ftp websites.

@nickwallette6201 2 ай бұрын

Not exactly. It's a command-based protocol, but the FTP client is responsible for translating user input to server commands. So, it CAN be CLI... but it doesn't have to be. It just depends on the client software you use. Obviously, in the days of text-mode interfaces, it was used primarily through a command-line client. FTP and SMTP (email) are very similar in this way. The commands and responses are designed to be parsable by both humans and computers, and both present a session that you use commands to interact with. However, pretty much nobody interacts directly with an email server, while it's (relatively) common to use FTP interactively. There's nothing preventing you from using a terminal app to connect to an email server and read your email interactively. Likewise, browsers and other software can navigate an FTP session and grab a file without any further input.

@sophya5796 2 ай бұрын

Been ill since October and most days it just seems there's nothing to look forward to anymore. So grateful for this channel for trying to challenge that feeling 💔

@user-pe4bv7vm2y 2 ай бұрын

Anyone remember Gegereka?

@rweninger 2 ай бұрын

I still love FTP Servers. They are beautiful simple. I hate complex HTTP Portals they use nowadays. Happy at least in the bubble I am, more and more FTP's (secure) reappear.

@hotrodhunk7389 2 ай бұрын

Hash map

@mahtin 2 ай бұрын

ls -lR … the results aren’t dated back to the 80’s 😄

@virt1one Ай бұрын

haha... @5:37 "you had thousands of hosts, hosting hundreds of GIGABYTES of data." no. Hundreds of MEGAbytes of data. Cool your jets, we're still saving files on 140kb 5.25" floppies about this time.