What we learned from 5 million books
Вставка
- Опубліковано 27 сер 2024
- www.ted.com Have you played with Google Labs' NGram Viewer? It's an addicting tool that lets you search for words and ideas in a database of 5 million books from across centuries. Erez Lieberman Aiden and Jean-Baptiste Michel show us how it works, and a few of the surprising things we can learn from 500 billion words.
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes. Featured speakers have included Al Gore on climate change, Philippe Starck on design, Jill Bolte Taylor on observing her own stroke, Nicholas Negroponte on One Laptop per Child, Jane Goodall on chimpanzees, Bill Gates on malaria and mosquitoes, Pattie Maes on the "Sixth Sense" wearable tech, and "Lost" producer JJ Abrams on the allure of mystery. TED stands for Technology, Entertainment, Design, and TEDTalks cover these topics as well as science, business, development and the arts. Closed captions and translated subtitles in a variety of languages are now available on TED.com, at www.ted.com/tra....
they're both really good at making their data entertaining. One of my favorite talks recently
That was an image from Dresden Codak, not XKCD. But fewer people know about that one because it updates like, once a year.
Just an accreditation note: the comic panel used in the presentation was not from XKCD. It was taken from a web-comic called Dresden Codak ( the comic used was from May 2nd, 2008).
I remember this from watching the Tedx talks. Its pretty awesome that the director version is so good at picking out the awesome lectures from the all right ones.
Relativity vs Quantum Mechanics, 1500 - 2008
First Appearance:
Relativity: 1503 Polyhedron: Volume 9, Issues 13-18
Quantum Mechanics: 1567 J.C.S. Faraday II: Volume 74, Part 3
Subject, Date, Results - vs - Subject, Date, Results
Relativity, 1500-1800, 174 - Quantum Mechanics, 1500-1800, 9
Relativity, 1801-1900, 29,200 - Quantum Mechanics, 1801-1900, 80
Relativity, 1901-1950, 251,000 - Quantum Mechanics, 1901-1950, 32,900
Relativity, 1951-2008, 1,080,000 - Quantum Mechanics, 1951-2008, 1,020,000
it's personal conversation > video > textbook
nothing beats audio + video + feedback so far ;-)
Random correction: Although the "stand back I'm going to try science" quote is from XKCD, the image is from an equally awesome comic called "Dresden Codak". And on the image it says "I will do science to it". Very different types of comics, but if you like one you'll probably like the other.
That was a great reference to Hitch Hikers Guide To The Galaxy! Too bad no one got it
and this is how you save the world. Bring knowledge to people, not to companies
That webcomic in reference is actually Dresden Codak, but xkcd is just as cool.
I thought this talk was going to be about some profound truths they learned from 5 million books. Instead, they charted how many "A"s people used in the word "argh". Great job.
@dayati : the role of censorship in the arts and communication was highly relevant information. Also the evolution of language (Thrived/Throve, Beft/Best). The Beft/Best thing of course was less about language (that was always meant to be an "S") as much as what I believe was standardization of letters, arguably as part of public education?
The real trick is not to have all information but to be able to prioritize it, to search for what you want, when you want it.
You want to learn calculus? A search engine with a tool like this could help you find the right teacher that uses words you understand to explain concepts to you in your vocabulary. You put the right words into a good search engine and you get the results you want. A perfect tool to find the perfect information for the perfect result. That is what Google strives to be.
I love that Google tool. Been playing with it for at least an hour.
One of the interesting results I found was that words 'kind, give, love, charity, forgive, pure' have been dropping in popularity for the last 2 centuries, but suddenly around year 2000 start becoming more popular again. And the words 'need, want use' do the exact opposite. Maby there still is hope in humanity. :P
Culturomics: you first heard it here in 2011 ladies and gentlemen! What a fantastic creation!
Look at all these subtitle languages! Amazing
@dayati Well, September 19th was "International Talk Like A Pirate Day", seemed kind of fitting to me.
Imp has few meanings. One of the meaning of 'imp' is 'creature' that looks like 'little devil'. Another meaning is 'to give feather'. I think sagar mean it in 'poetical' word and I 'think' he means something like this: Imagination gives you more 'things' than knowledge.
I love this bit of Google Labs, but I still feel, from playing with it for the last hour, that it has some bugs. Their are many "books" called "Catalog" that exist from 1500 (the farthest back you can set the time counter) up to 1800 that say they contain references but will not show the pdfs they seem to represent. There are also, what appear to be journals and magazines that are dated from 1500 - 1700 that have printed, color, pictures that look like they are less than 60 years old.
Loved the talk. Very informative and very entertaining. Those two together can't fail.
@LowestofheDead The webcomic XKCD had a comic featuring the line "Stand back, I'm going to try science"
I'm afraid of what happens when they digitize everything and the server crashes
00:15 start of talk
I really wish EVERY BIT of information was publicly available TO EVERY HUMAN on Earth. I know there is a lot of potential for problems in that sort of a scenario, but there is even more potential for productivity. Consider how much trust would be shared. Without secrets there would be no confusion. Everything could be figured out, every action explained, we could UNDERSTAND EVERYTHING humanly possible.
This talk was awesome! Informative but also very entertaining.
loving the ngram was on it for an hour before i noticed how much time went past
one of the more interesting TED talks in a while.
@McArrowni I love DC wish it was more frequent....
@113Doctor How about checking the phrase 'lights in the sky" or "lights in the air."
How much is A Video worth in comparison with Words.
Because I'm too lazy to read textbooks, I love watching Video Lectures.
So... Trevor Moore is a statistician now...
Seriously though, awesome talk.
It's kind of creature...but I guess it has different meaning as in: "gives you more"
The English subs link goes to the mp4 file.
Lightly shaky talkers, but a very important talk.
@LowestofheDead You are wrong, just search for it. It's on a t-shirt even.
This talk was high on the awesome axis
I think they were kind of CUT? They were like rushed at the end?!
This is mindblowingly amazing. Holy damn.
I think that aaargh-thing might have something to do with Monty Python's Holy Grail, actually :)
@D5932 Why wouldn't it be? T and t are 2 different codes
If you say Big Apple or big apple they clearly mean different things. Any High School English text will explain the rules of capitalization.
With a good text book and teachers like these guys I might have been able to get through statistics.
Check facts on Marc Chagall. Look him up in only ONE BOOK.
Except for the fact that they're both smart and worked together, these presenters seem to be diametrically opposed.
@damarh As a mathematician I find this very interesting.
Do you know Google has DISTORTED the books depending on which ones they decide need to "have alternate explanation/interpretation?"
YOU HAVE TO BREATHE HARDER! YOU'RE NOT TRYING HARD ENOUGH!
I typed (war, peace) into it. Pretty interesting. There was way more talk always about war. And you can see World War 1 and World War 2 spike like crazy. The U.S. Civil War spiked, but not as much.
"Flying cars" was most mentioned in the early 1800s? Am I reading NGram Viewer correctly?
Is there a way to include web pages words as well as books?
In wireless communication, a picture is actualy worth a thousand words, in terms of data capacity of a radiowave. :P
Try putting 'genesis' and 'evolution' together on nGram.
Good to see evolution winning...
Amazing what new researches people can make today.
Thank you Google, i hope i can work with you one day!
God-damn... The guys at google never cease to amaze!
So many books and so little time, so now I am using audibledotcom, and making video and journaling .,
So much knowledge In so many books, by so many smart people of history. People just waste their time by doing useless things in their life, rather then reading something that will change their life. Successful people know the key to success and that's knowledge. And that's why I decided to write a book to motivate people to read: ,,Investing in books: How reading can make you money". It's about thinking about books in revolutionary way - as an investment which will make you money in long run.
Go read a book, genious!
@richardmann184 comment downvoted
Obviously you don't understand the power of this tool. It is a library of 5 million books now, and in the future it may have over 100 million books, that is the number of books printed from every civilization in on Earth throughout recorded history. If it reaches that goal this will be the most useful tool on Earth for the education of every human from now until the end of time. The 1 Million Books Project met it's goal in 2007, now they have 15M, tomorrow 100M.
.... that crowd laughs at everything .....
We are starting to worry about the past less because the future of humanity is so uncertain.
That was not only enjoyable but also interesting.
Especially the graph on Marc Chagall; I have to do a presentation and work on censorship in Nazi Germany. Explaining what they did is easy, but showing sources is much more difficult (since a lot of them were censored haha) but this is such a fantastic graph to show it. What coincidental luck.
Awesome! Brilliant! Can't stop playing with the Books Ngram Viewer
That's not xkcd, that's Dresden Codak!
And it's 'I will do science to it!"
The guy on the right is channeling Sheldon from the Big Bang Theory.
So how does 2012 fit in this chart?????????????
What's imp ?
@AndrewDBarker Left Turn by Tim Groseclose or Slander by Ann Coulter
@D5932 There are 286 results on the word Internet from 1500 - 1711
McKinney's consolidated laws of New York annotated: Book 27
AND
Constitution of the United States annotated
Both mention the word Internet in 1501... so IT says...
Guy on the right is pretty cool, even if his voice keeps breaking :P
Wow the crowd is way too enthusiastic! Great talk though
0:15 Here we go.
If i wanted to understand about a planet and there was existing biolgical organisms i would set them to work telling me everything there is to know rather than do the work myself. And here we have it, everything you need to know about earth, it's inhabitants, cultures and memes all in digital format. Thanks planet earth.
@egokick thankyou... i just wanted to let you know: good luck and we're counting on you
Half the information on here is a red herring, to the fact the whole presentation is predicated on flawed input.
Copyright must be abolished.
Am I the only one who finds intro/outro audio volumes normal ?
They make this so insanely funny. Ngrams are great. They tell us so much about ourselves.
Wow, Michael Shanks sure reads a lot.
@dayati I too was hoping for something a little more profound... they could have afforded to be a little bit less the comedians and concentrated on demonstrating the potential of this resource.
@86kinky86 comment downvoted
Are you kidding? You have no idea the power of this tool. Try it out for yourself for an hour and just imagine the possibilities of this thing for thinktanks, marketing groups, scientists, historians... the uses of this tool are phenomenal when you just consider that you can zoom in to a year and a subject and read a book on anything, from anytime, that is put in Google Books, this is a seriously powerful research tool.
What I've learned from books, and particularly from religious books, is: Don't believe everything you read in books!
I want a t-shirt with Anrrgh on it. (Only the n has gotta be superscripted like it's supposed to be) I simply must have one made!
"Stand back I'm going to try science" is on an xkcd t-shirt
As soon as I saw that guy I thought "oh no, this guy probably likes XKCD". THEN HE HAD TO GO AND REFERENCE IT
I GOT SO MAD
3:28 Blatant misrepresentation of facts...
"I will do science to it" is from Dresden Codak, not XKCD!
What do you mean? I don't get it!
@rayoc New people are inundated by present day entertainment media, and the past only grows larger.
This only tracks books for now, we had newspaper to read instead, then magazines, then radio to listen to, television to watch, now we have websites, email and social networking
Books are becoming less and less popular as a method of recording and sharing information.
Radio, television, console games, etc. they don't record our activity the way writing a book or creating a website do, in text.
YOu had that much amount of data, and this is what you did with it???
I mean cool, but really?
Now this is awesome, as in awe inspiring.
Totally going to try that thing out now.
I wonder if they have suggestions like in normal searches for thing people search a lot about, or statistics over what people query the engine about the most. I bet there are a lot of people amusing themselves looking at historical populatity of fetishes and other wierd stuff.
geez, can't people wait 15 seconds to the beginning of the talking? what a rush! O_O
19 mathematicians saw this presentation and where not impressed.
@AndrewDBarker Such analysis has already been done, there are several books on media bias that cite how often certain words or phrases appear in or are mentioned in news publications. Try finding the words "very liberal" in the New York Times. Much less than the phrase "very conservative".
Brilliant talk!
0:15. Really TED, do we have to keep doing this?
knowledge to the people
@paradoXeI On my headphones... it is too loud.
@preptimenow people like this really piss me off, I just need to say
What do you think it is that preptimenow doesn't understand about this tool?
Was it the word books that turned him off, or the number 5 million?
You are using the internet right now, you are THINKING in ENGLISH how you are going to respond to this. This tool gives us the power to search THE RECORDED HISTORY OF THE WORLD for information. Every book in history could be a part of this tool, and EVERYONE can LEARN EVERYTHING!
@petravanessa definitely*
06.35 LOL hes rapping.....
You have done really some great stuff!!!!
Illuminating and inspiring!
If on a winter's night a traveler.....anyone?
It is a fun talk and sparks my stat bone, but limited practical use I suppose.