SQLite was created in the year 2000 by D. Richard Hipp, initially designed as a lightweight database solution for a U.S. Navy project while working at General Dynamics.
@@windows99its absence is egregious given its impact and ubiquity is the takeaway, if you have to ask though the point is probably lost on you. still a good vid, just some obligatory nerd rage
What?!? I usually love you work but how can you make a video about the history of databases without one mention of dBase or Ashton-Tate? This was too huge a milestone to just skip over entirely. Clipper and xBase were also major moments but skipping over dBase makes this video truly incomplete.
While technically not a database, Index Sequential Access (ISAM). is appropriate for many applications. IBM and Digital Equipment Corporation both had ISAM. DEC did an excellent job of seamlessly integrating it in their file systems. ISAM could be accessed sequentially, or by one or more of the indices. DEC also had a unique query/report writing application (Datatrieve) that could be used interactively or programmatically. It could even do "joins" between flat files, ISAM file and true databases !
Larry ripped off his database from the the company he was working at, with a bunch of coworkers, that got a government contract to develop it. And then he sold sold sold, over promised, and under delivered, which at one time put him really in a bind because a lot of big corporations had bought into his Oracle software pipe dream next version, and he had to deliver.... because they had already spent the money from selling the vaporware.
I moved from SQL on the mainframe to Btrieve on DOS in the 1980s. That was painful after having experienced the power of SQL. From there to Oracle and Teradata. Who remembers Informix?
The first database for computers were punchcards and you had sorting machines and counting machines with replaceable wired board for each type calculation.
There is little agreement on the definition of "database", but in principle you may be right. The term today implies a lot of other stuff like multiuser-access, security, recovery, transactions (e.g. either an invoice is payed and the money is drawn from your account - or the entirety is not done. You will not experience an invoice not paid but you lost the money).
0:52 Yes, we can all agree Excel is not a database. Cells may store static and dynamic data as well as formulas. In a database, only static values and structure are saved, formulas are executed by doing queries on the db, not directly storing them as values.
Whilst this is largely true - and I don't mean to be overly pedantic here - but that's not "technically" completely accurate. For example, some databases such as SQL Server, can have 'Computed Columns'.
I feel like it's a way to get fish brain people to click! If it works, it works! There's enough people out there that suffering from one form or another of TikTardation. So as long as they click and learn, a little bit of history is better than learning nothing! But I bold claim it is! lol
You are correct. Besides Sybase, there was Gupta SQL Database and I was their partner. Oracle was too complex to manage, while Sybase and Gupta where something you could just install any Windows computer (or Novell server). When Microsoft tool over Sybase instead Gupta, they just closed their business down because "nobody can't compete with Microsoft". Some guys being involved with Gupta went to write MySql as free open source project.
The direct commercial successor to System R at IBM was SQL/DS, released in 1981 for IBM DOS/VSE and IBM VM/CMS. DB2 on MVS came later, but it eventually replaced SQL/DS in IBM's database line-up.
Hey, Jesse! I'm a fan, and I know you have a horse in the race on this one ✌️ But yes-I agree. I should have mentioned Mongo (and probably SQLite) in the video.
In the 1960s, Massachusetts General Hospital had a need to record and access medical data, which was very variable in size, and developed a programming language that incorporated a database. They called this MUMPS, developed in 1966, and still widely used today in medical systems. This flexible non-relational database is about the same age as IDS.
The sheer amount of people out there that think OLAPs can be used for transactional processing is mind-blowing.... I've had folks try and use Snowflake like it was SQL Server and wonder why it doesn't work.. 😂
You seem to have forgotten VSAM (Virtual Storage Access Method) with its different ways of reading in data sets, for example KSDS (Key-Sequenced Data Set), ESDS (Entry-Sequenced Data Set), RRDS (Relative Record Data Set) and LDS (Linear Data Set). OK - VSAM is perhaps more of a file management solution than a formal database...
So, no, my former employer, NASA had nothing to do with the early development of databases. While they were a consumer of IMS systems, the early history actually starts with airline reservation and the SABRE system.
Immutable databases were not mentioned, but they are great for expanding one's understanding of data storage principles. These are e.g. Datomic and XTDB. And there are also interesting related and largely unknown topics like temporality and bitemporality.
You mention Microsoft SQL server before PostgreSQL yet SQL Server came from Sybase which came from an early version of Postgres (maybe Ingress?) . Some parts still look very similar, such as the way you setup partitioned datasets.
I like the narrative, but for viewers who "weren't there", the times the screenshots arise from vary widely. They don't present the technology of the era. Some do. Many don't. That would have made this a brilliant video.
Your depiction of IMS 3:03 is not correct. IMS does not have a class-like structure (or it would rarely be used for that - everything is possible). It would look more like the network at 3:48, except that shipment and product would belong to another database, but that might well be used as secondary entries to the customer database. In IMS-terminology (I think) customer could be a database, also customer would be a root segment. Under that was a set of order segments and under each order-segment would be a number of orderline-segments. Thus searching for orders containing a certain product would "take some time". Thus another database could give that link or the customer could be viewed in another way. The point is that it is not flexible for new unexpected usage. ADABAS could also have been interesting. The company behind claims it was the first commercially available database system. It works on inverted lists and its use of null-fields in an index is pretty interesting (and not suitable for any short video). But all in all, good job!
@awesome-coding class is over.. it started with some basic histroy (so video was helpful), and then db internals(how sql is parsed), and layers of schema design
Excel not a real database? Correct. I think you meant Access. That is actually ok for small apps and the VBA coding and forms is nifty for quick apps, just don't use bound data, impossible to trace values (i never found a way unless, i used recordsets. The Access attempt at a CURSOR
Wait. You totally skipped over the part where young Larry Ellison worked at Ampex Corporation, where he developed a database project for the CIA codenamed “Oracle” before founding Oracle.
You are right - I skipped over quite a few details to keep the video under 10 minutes. It's funny that he worked on a CIA project, stole the Oracle name, and then convinced CIA to become a client. Kind of suspicious if you ask me :))
Of course Excel isn't a real database, it's just a spreadsheet editing program. The database is CSV files. The best way to store data is as "plain" text. ;)
@@stevefan8283 I actually found out about him a couple of months back when somebody else compared me to him in the comments. I think he is from Venesuela and I'm from Romania. So we both have weird accents, and come from poor socialist countries where you need to develop some humor to make living here more bearable :))
@awesome-coding I'd suggest turning it off if it's a UA-cam feature because any viewer who has their UA-cam set to French will default to that awful track. It's my first time seeing this, by the way, no other video I've ever watched on UA-cam has had that before.
@@Sims_it :)) this is crazy. Now I understand why I started to get comments in French all of a sudden. UA-cam mentioned they'll add video dubbing, but I thought it is disabled by default. I want it disabled for certain. Thanks for mentioning it!
Why Excel is not a database ? If it can store structured data and macro, query it and optionally apply processes on it, that's a database. When you think about it, even GIT is a "database" (with rollback, commit, merge-diff), if you are masochistic enough, you can do anything with this cursed software, even run DOOM (Excel not Oracle ^^)
Great work!! There should also be a note or separate video on the immensely successful Life DBs as the most used data structure on Earth is the gene. Most used db is likely the Chromosome and there are several Life DNA/RNA DBMSs that run all life on Earth. 🙂
I started with punched cards and made a living of databases. I can tell that this video is a bunch of cherry-picked information not representing what really happened.
Thanks for the feedback! I agree this is far from being complete. If you have the time, I'd love to pick your brain about your career for a potential more in depth database video.
I think this vid presented a very narrow cross section of relational databases. You ignorantly left out Object Oriented DB's like Gemstone, Versant, and DB40, (NASA, Boeing , and, American airlines used Gemstone and Versant) as well as the details of graph DB's how/why they evolved and who were the early adopters etc.. Summary: Very narrow minded vid.
@kevincitron2335 No worries at all :) I understand what you mean. I was trying to keep the video under 10 minutes and move through the topics quickly to keep it interesting and hold people’s attention. That’s why I left out some important details. I’ll try to do a better job in the future.
Jesus guys, there's a million DBs. Don't get butt hurt if your precious one doesn't get mentioned.
what about sqlite
SQLite was created in the year 2000 by D. Richard Hipp, initially designed as a lightweight database solution for a U.S. Navy project while working at General Dynamics.
Damn - you are right. I should have definitely include this in the video 🤦♂️
What about it?
@@windows99it's the most widely distributed db in the world - it's likely on your phone and you don't know it
@@windows99its absence is egregious given its impact and ubiquity is the takeaway, if you have to ask though the point is probably lost on you.
still a good vid, just some obligatory nerd rage
What?!? I usually love you work but how can you make a video about the history of databases without one mention of dBase or Ashton-Tate? This was too huge a milestone to just skip over entirely. Clipper and xBase were also major moments but skipping over dBase makes this video truly incomplete.
Thank you for the feedback! I really appreciate it. I'll do my best to do better next time.
While technically not a database, Index Sequential Access (ISAM). is appropriate for many applications. IBM and Digital Equipment Corporation both had ISAM. DEC did an excellent job of seamlessly integrating it in their file systems. ISAM could be accessed sequentially, or by one or more of the indices. DEC also had a unique query/report writing application (Datatrieve) that could be used interactively or programmatically. It could even do "joins" between flat files, ISAM file and true databases !
One Rich American Called Larry Ellison ☠
🗿🗿
Israeli*
LMAO, love it. I need that on a shirt yesterday.
Aura
Ellison was far from rich when he cofounded SDL, later renamed Oracle.
You forget to mention dBase. dBase and partuculary dBaseIII was used a lot in the days of DOS.
Larry ripped off his database from the the company he was working at, with a bunch of coworkers, that got a government contract to develop it. And then he sold sold sold, over promised, and under delivered, which at one time put him really in a bind because a lot of big corporations had bought into his Oracle software pipe dream next version, and he had to deliver.... because they had already spent the money from selling the vaporware.
I moved from SQL on the mainframe to Btrieve on DOS in the 1980s. That was painful after having experienced the power of SQL.
From there to Oracle and Teradata.
Who remembers Informix?
5:28 was the best part
😅
surely 4:43 was the best part
The first database for computers were punchcards and you had sorting machines and counting machines with replaceable wired board for each type calculation.
There is little agreement on the definition of "database", but in principle you may be right. The term today implies a lot of other stuff like multiuser-access, security, recovery, transactions (e.g. either an invoice is payed and the money is drawn from your account - or the entirety is not done. You will not experience an invoice not paid but you lost the money).
0:52 Yes, we can all agree Excel is not a database. Cells may store static and dynamic data as well as formulas. In a database, only static values and structure are saved, formulas are executed by doing queries on the db, not directly storing them as values.
Whilst this is largely true - and I don't mean to be overly pedantic here - but that's not "technically" completely accurate. For example, some databases such as SQL Server, can have 'Computed Columns'.
“History of” anything in under 10 minutes is a bold claim!
Fair :D
I feel like it's a way to get fish brain people to click! If it works, it works! There's enough people out there that suffering from one form or another of TikTardation. So as long as they click and learn, a little bit of history is better than learning nothing! But I bold claim it is! lol
I think that the first versions of MS SQL Server were licensed versions of Sybase SQL Server.
You are correct. Besides Sybase, there was Gupta SQL Database and I was their partner. Oracle was too complex to manage, while Sybase and Gupta where something you could just install any Windows computer (or Novell server). When Microsoft tool over Sybase instead Gupta, they just closed their business down because "nobody can't compete with Microsoft". Some guys being involved with Gupta went to write MySql as free open source project.
You forgot vector databases.
And SurrealDB also deserves an honourable mention
For certain I could have mentioned more tech, but I wanted to keep the video as short as possible. I might create an extended version though.
@@awesome-coding Oh ok got it
The direct commercial successor to System R at IBM was SQL/DS, released in 1981 for IBM DOS/VSE and IBM VM/CMS. DB2 on MVS came later, but it eventually replaced SQL/DS in IBM's database line-up.
You should've known that making a video about the history of databases would spark attack of the nerds in the comments section.
😂 To be fair, this is the main criteria when choosing a new video topic - what's the subject which will disappoint my audience the most.
Great history lesson! Just missing one of the most modern general purpose databases - MongoDB
Hey, Jesse! I'm a fan, and I know you have a horse in the race on this one ✌️
But yes-I agree. I should have mentioned Mongo (and probably SQLite) in the video.
@@awesome-coding and a vectordb :D
In the 1960s, Massachusetts General Hospital had a need to record and access medical data, which was very variable in size, and developed a programming language that incorporated a database. They called this MUMPS, developed in 1966, and still widely used today in medical systems. This flexible non-relational database is about the same age as IDS.
@@southvillechris definitely remember MUMPS. Small demand for even 30 years ago and very propietary
No mention for Analytical (OLAP) Databases. A database war is going on between Databricks and Snowflake
The sheer amount of people out there that think OLAPs can be used for transactional processing is mind-blowing.... I've had folks try and use Snowflake like it was SQL Server and wonder why it doesn't work.. 😂
I appreciate your hard work 🙏
Thank you!
Amazing video!!!
Thank you!
I'm planning to explore more tech history videos in the future but this one performs terribly :))
@awesome-coding I loved the meaning of the acronym oracle LOL
Not mantioning SQLite in adv history video is wild
You seem to have forgotten VSAM (Virtual Storage Access Method) with its different ways of reading in data sets, for example KSDS (Key-Sequenced Data Set), ESDS (Entry-Sequenced Data Set), RRDS (Relative Record Data Set) and LDS (Linear Data Set). OK - VSAM is perhaps more of a file management solution than a formal database...
So, no, my former employer, NASA had nothing to do with the early development of databases. While they were a consumer of IMS systems, the early history actually starts with airline reservation and the SABRE system.
Thanks for your sharing
Quite interesting! Thank you
Glad you enjoyed it!
Immutable databases were not mentioned, but they are great for expanding one's understanding of data storage principles. These are e.g. Datomic and XTDB. And there are also interesting related and largely unknown topics like temporality and bitemporality.
Great video
Thank you!
How come CJ Date has not been mentioned in SQL Language discussions. I Still refer to his work.
well done!
I can remember when this was all fields
You mention Microsoft SQL server before PostgreSQL yet SQL Server came from Sybase which came from an early version of Postgres (maybe Ingress?) . Some parts still look very similar, such as the way you setup partitioned datasets.
Where's does mongodb fall in this?
In the 2010 era when No sql DBs gain traction due to the need to handle unstructured data.
Can you make video on nobsql db scylladb
scylladb is improved version of cassandra written in C++
Will do my best. Thanks for the suggestion!
@@codingprojects4002 and what the rust rewrite is called?? There gotta be a rust rewrite, i am sure of that
@@vaisakh_km it's written in C++ till date
I like the narrative, but for viewers who "weren't there", the times the screenshots arise from vary widely. They don't present the technology of the era. Some do. Many don't. That would have made this a brilliant video.
Your depiction of IMS 3:03 is not correct. IMS does not have a class-like structure (or it would rarely be used for that - everything is possible). It would look more like the network at 3:48, except that shipment and product would belong to another database, but that might well be used as secondary entries to the customer database. In IMS-terminology (I think) customer could be a database, also customer would be a root segment. Under that was a set of order segments and under each order-segment would be a number of orderline-segments. Thus searching for orders containing a certain product would "take some time". Thus another database could give that link or the customer could be viewed in another way. The point is that it is not flexible for new unexpected usage.
ADABAS could also have been interesting. The company behind claims it was the first commercially available database system. It works on inverted lists and its use of null-fields in an index is pretty interesting (and not suitable for any short video).
But all in all, good job!
Thanks for the feedback and the clarification!
PICK OPERATING SYSTEM 1965 multivalue db un OS qui etait une DB du kernel et multi user
Tomorrow my uni's DBMS Semistor going to start,
and this video wouldn't have came a better time
Glad to hear!
@awesome-coding class is over.. it started with some basic histroy (so video was helpful),
and then db internals(how sql is parsed), and layers of schema design
Excel not a real database? Correct. I think you meant Access. That is actually ok for small apps and the VBA coding and forms is nifty for quick apps, just don't use bound data, impossible to trace values (i never found a way unless, i used recordsets. The Access attempt at a CURSOR
Wait. You totally skipped over the part where young Larry Ellison worked at Ampex Corporation, where he developed a database project for the CIA codenamed “Oracle” before founding Oracle.
You are right - I skipped over quite a few details to keep the video under 10 minutes.
It's funny that he worked on a CIA project, stole the Oracle name, and then convinced CIA to become a client. Kind of suspicious if you ask me :))
I think he skipped over it because it's Canon, everyone already knows it!
Outstanding content.
Thank you! I appreciate the kind words!
Probably quantum mechanics databases is going to be the next DB technology
DBASE?
Of course Excel isn't a real database, it's just a spreadsheet editing program. The database is CSV files. The best way to store data is as "plain" text. ;)
Good 👍
ayy yooo LowSpecGamer is that you?
I wish, but I'm not :)
@@awesome-codingHow do your vocal and writing style is so much like him
@@stevefan8283 I actually found out about him a couple of months back when somebody else compared me to him in the comments. I think he is from Venesuela and I'm from Romania. So we both have weird accents, and come from poor socialist countries where you need to develop some humor to make living here more bearable :))
graph??
Intéressant mais la voix robot au débit variable rend l’ensemble inaudible.
Please stop calling me a robot :)
@ 🤣
I'm honestly more butthurt about the atrocious AI French track than I am with the fact that not every DB is mentionned...
What french track?!
@awesome-coding The video has an option to switch the audio to French. It's obviously auto-generated and it's truly awful.
@awesome-coding I'd suggest turning it off if it's a UA-cam feature because any viewer who has their UA-cam set to French will default to that awful track. It's my first time seeing this, by the way, no other video I've ever watched on UA-cam has had that before.
@@Sims_it :)) this is crazy. Now I understand why I started to get comments in French all of a sudden. UA-cam mentioned they'll add video dubbing, but I thought it is disabled by default. I want it disabled for certain. Thanks for mentioning it!
Why Excel is not a database ? If it can store structured data and macro, query it and optionally apply processes on it, that's a database.
When you think about it, even GIT is a "database" (with rollback, commit, merge-diff), if you are masochistic enough, you can do anything with this cursed software, even run DOOM (Excel not Oracle ^^)
Can't argue with you. Very well said - I designate you the Excel Advocate of this community
You can even run SQL queries on Excel spreadsheets.
A video about Databases and not even a single mention of Mongo DB💀
😅
DBASE 1980 FoxPro 1984 clipper 1985 et ms visual foxpro 1989 Vous les oubliez elles etaient fantastique
Great work!! There should also be a note or separate video on the immensely successful Life DBs as the most used data structure on Earth is the gene. Most used db is likely the Chromosome and there are several Life DNA/RNA DBMSs that run all life on Earth. 🙂
That would be an interesting topic for certain :D
MongoDB?
wtf is wrong with speed of speech almost at fast forward then slowly dropping to real slow and repeat in waves ? Poor encoding ?
So apparently I have a very " annoying uptalk" tone when I present things, and that's be doing my best to read the script without uptalk 🤦♂️😅
5:30
One
Rich
American
Called
Larry
Ellison
Who the f made this lol
😂😅
XD didn't noticed.. cool
En français, Les variations de vitesse du commentaire de cette vidéo sont insupportables.
One rich american called... 😆
😅 he knew back then he'll be one rich MF
I started with punched cards and made a living of databases. I can tell that this video is a bunch of cherry-picked information not representing what really happened.
Thanks for the feedback! I agree this is far from being complete. If you have the time, I'd love to pick your brain about your career for a potential more in depth database video.
I think this vid presented a very narrow cross section of relational databases.
You ignorantly left out Object Oriented DB's like Gemstone, Versant, and DB40, (NASA, Boeing , and, American airlines used Gemstone and Versant) as well as the details of graph DB's how/why they evolved and who were the early adopters etc..
Summary:
Very narrow minded vid.
Thank you for the feedback!
Sorry Dude. I probably should have used "conveniently" instead of "ignorantly". But completely left out Object Oriented Db technology.
@kevincitron2335 No worries at all :) I understand what you mean. I was trying to keep the video under 10 minutes and move through the topics quickly to keep it interesting and hold people’s attention. That’s why I left out some important details. I’ll try to do a better job in the future.
dBASE
Gibberish
1:00 In general, Microsoft products don’t count as real software.
Tell that to the company I work for please.
This video has to be renewed, we are already transitioning to transformer based vector stores, high dimensional attention retrieval
Don't forget the GOAT (SQLite)
Most annoying tonal voice.
I’m sorry
Gay.
Thanks!
Oh my god, monotone would be better