AI YouTube Comments - Computerphile
Вставка
- Опубліковано 6 вер 2024
- Generating UA-cam comments with a neural network trained on UA-cam comments. What could possibly go wrong? Dr Mike Pound replied to our comment...
EXTRA BITS: • EXTRA BITS: More AI Ge...
Neural Networks & Deep Learning: • Neural Networks
Andrej Karpathy Blog post mentioned by Mike: bit.ly/C_Blog_RNN
Code that Mike used to create this: bit.ly/C_RNN_Code
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscom...
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharan.com
12:11 I'm in the video! :O This is amazing! The robots love me!
Also... this might be a sign that I need more to do with my life besides comment on UA-cam videos...
+IceMetalPunk hey, thanks for the comments! >Sean
Hi IceMetalPunk. ☺️
Well, ask him for the code. That way, you'll never have to comment again!
The code is in the description.
Anyway, excitement about my five minutes of robot fame aside, I did want to comment something related to the actual subject of this video :)
My favorite method of generating plausible text is a simple multilayer Markov chain. Way back in my freshman year at uni, one of my assignments was to create a three-layer Markov chain trained on excerpts from the Wizard of Oz to generate a new page from the book. It was interesting. But then, we were allowed to train our Markov chain's dictionary on *any corpus* we wanted, so I chose the US Constitution. Needless to say, seeing brand-new laws come into existence at the (metaphorical) hands of a computer was extremely amusing.
I love you, baby.
Nice try computer. Your phony back story isn't fooling anyone. Well done on the improvements though. Your comments are getting better.
IceMetalPunk I am a knight and what I say to all this is Nee!
Just nee, nee, nee!
+IceMetalPunk
A little late, but if you have any excerpts, please post them?
After this video i will never be able to trust computerphile comments ever again.
Developing an AI based on UA-cam's comment section might not be the brightest idea in the world. The "I" in AI stands for intelligence.
Maybe he was developing Artificial Idiocy
I always preferred Artificial Incompetence.
Artificial ignorance.
Artificial imitation
Space doubt wins....
"I was able to want to be able to be happy."
me too... me toooo...
Same
That's an important first step.
It has reached consciousness!
watcherFox they became self aware! 😱
First UA-cam Comment
Mike is the best speaker IMO
Computerphile reply
1:25 Don't right?
do you support online learning from websites like "Free code amp" and 'Solo learn" 'Code academy".
gosh! I am soo noob
Great video!
IceMetalPunk comments on my videos too :-D Deffo real person!
xisumavoid xisuma here wow
Cool to see you here
Hey Xisuma. Love your vids. good channel you watch here
didnt expect to see you here :D
xisumavoid Oh, hey xisuma
Train it on computerphile transcripts, then act out the output!
Yes! I second this entirely!!
"This video was written by an AI."
even better, train it on classic literature, read its essays at a TED Talk
Does it write "first"-comments?
Ebumbaya ' first
Probably.
Yes, but excessively so and at inappropriate times.
@@Treddian So... like normal youtube comments then.
In one of the screens you can see a comment which says "One!", which is kinda the same
I find your own difference.
This relayed having two first.
We all find your own difference on this blessed day.
Hmm, profound words; they art spilling from thine mouth.
I just wanted to let you know that I was just wondering if you were able to get the kids to school.
Using comments as input on university computers? Would be a shame if someone would '); DROP TABLE Students;--
Hey! Leave Bobby out of this! :D
I wonder what lil Bobby has gotten himself into this time
The output is nonsense, but it looks quite similar to badly translated Chinglish found in the manuals for cheap eBay electronics :)
I am impressed with the way this isn't just randomly sticking words together, it's actually making the words themselves, letter by letter - without even really knowing what a "word" even is.
I dunno why, but I really love this guy. He's very good at explaining things and he's funny. Thanks Mike!
Agreed!
I think it's his passion for explaining and kinda learning at the same time.
"I was able to want to be able to be happy" The network is trying to tell us something.
It would be interesting to create a neural network that would predict comment likes/dislikes based on the content of the comment.
@@dejfcold that's an over simplification
I predict your comment will receive 76 likes before it is forgotten.
@@abstractapproach634 I don't think it's gonna make it :(
@@samuelthecamel Prob 42 likes
@IceMetalPunk Please drop a hello
Hello! :D
You're internet famous now!
At least within the Computerphile-watching community, and for the next week or two. But I'll take that! :D
IceMetalPunk yey!
That's amazing! how many comments have you posted lol!
"I find your own difference." It sounds so deep and profound!
Now all we need to do in translate it into Latin, "Differentiae tuae invenio."
That's one solid tattoo right there! Or it should be Chinese, if someone would like the chime in on that one?! :D
Amazing stuff! And ironically, the fact that it outputs typos every now and then makes the comments much more realistic.
12:12 So did IceMetalPunk ever appear? Did the happy reunion ever happen? I so want to know!
I did appear! :D
IceMetalPunk is a UA-camr gamer who makes Minecraft let’s plays. This dude exists!
I only know them as a UA-cam viewer whose viewing habits often overlap with mine.
Well, I used to... I haven't had much time lately :( Having two jobs can really hinder a social (media) life XD
Isn't trying to generate an AI trained on UA-cam comments a bit counterproductive?
Depending on the channel, it might indeed become an Artificial Stupidity. However, as this AI is trained on Computerphile comments it's probably above average.
Daan Wilmer tru nuff, it was a joke tho.
No, because even it the bot replicates natural stupidity, you've proved that you have an algorithm than can replicate human behaviour accurately.
This was done by a UA-camr called CaryKH, he applies neural networks to various tasks.
Yea i love the stuff he does - like the language-recognision :)
I was about to mention. I wonder what difference there is between their methods, if any
Charles Thatisall There might be, if there is I'm voting for an epic NN battle.
Watching this 5 years later now that we have ChatGPT and such...
and where he said that a Chatbot from this is "theoretically" possible and here we are
I realize this is more powerful in a general sense, but to just generate text (what I know of as) a markov chain seems... easier. They're fun and extremely easy to get started with if nothing else, and I feel like playing with the generator order gives a sense of how (non)random language is.
A recurrent neural network looks like a "recursive" markov chain to me.
Yeah, definitely. This isn't the best use of a recurrent neural network, but it does sort of help for demonstration purposes. But I love me some Markov chains! I always wanted to use Markov chains to generate songs based on a given artist's corpus of song lyrics, but the one time I tried to make one, I did it very crudely and naively and ended up accidentally DOS'ing a lyrics site... so I stopped XD I should get back to that one day, but do it more intelligently this time... if I ever have any free time for that anymore.
@@superdau A RNN is kinda like a Markov chain but using thousands of different states instead of one. Also each state is modulated by math/weighted connections instead of probability. It's much harder to generate with quality of RNN if the Markov Chain is working character by character.
how many times does 'Hitler' pops up in those generated comments
Too often #Godwin’s law
first!'); DROP TABLE comments;--
Hello, little Bobby Tables :D
IceMetalPunk That should teach you to sanitize your inputs.
Clever, except that the machine learning server is probably quite remote from the administrative servers
Yea because a Doctor of computer science would use SQL HAHAHAHA... Not.
I guess the network would output a lot of "first" as comments and a lot of "first" related replies
I just discovered Numberphile and Computerphile recently and appreciate everything you guys are doing here. The content is definitely top notch. I'm lovin' it.
IceMetalPunk is a chat bot helping to train a chatbot to become a chatbot.
:) Looks it is. If you're interested in AI, you can check out my introductory book "How to Create Machine Superintelligence" available for FRЕЕ in amazon kindle store till 6th October.
In this book, I go over the following:
- intelligence as a form of information processing
- basics of classical computing
- basics of quantum computing
- some basics of machine learning and artificial neural networks
- and also share some thoughts on building general AI and dealing with the control problem
I won't read it because if you're rationalising what intelligence is you're misrepresenting what intelligence is
10:23 Neural network literally saying: "I don't think before doing"
Mike Pound, you created a NN that can lie.
Where's IceMetalPunk? Someone let them know.
Well, aside from the many comments my videos are now getting to let me know about this, I'm also subscribed to Computerphile. Hence why I leave enough comments for the AI to notice me, senpai :D So I saw it! :D
Carykh
+IceMetalPunk .. we are waiting!
Wait no longer! :D
Hey Computerphile, I love your comment at 13:43, where you asked the question "How do you watch if you basically have one hardware?".
Great video, quite fun to read through those generated comments to find some that almost make sense.
Hi Max. If you're interested in AI, you can check out my introductory book "How to Create Machine Superintelligence" available for FRЕЕ in amazon kindle store till 6th October.
In this book, I go over the following:
- intelligence as a form of information processing
- basics of classical computing
- basics of quantum computing
- some basics of machine learning and artificial neural networks
- and also share some thoughts on building general AI and dealing with the control problem
Bots commenting on bots..
what would happen if you tried using this as a generator for a generative adversarial network and then make the classifier as real vs generated? is it too random to get to realistic comments?
He is so good at explaining this stuff
Mike's the best at Computerphile videos
"I said yesterday I walked to the park 2 days ago."
"I have no ideas so I use a neural network"
why are you so mean?
Because there is better AI. I am not mean, just angry for not being heard.
IceMetalPunk: You've been targeted for termination.
D: NO, I welcome my robot overlords! I'm honored they picked me and I will work with them however they see fit! Don't kill me!
10:24 "I was able to want to be able to be happy."
So how is this different what Markov chain does? Because to me this video sounded lot like only difference between Markov chain and neural network would be how it is made under the hood.
Yeah, this demonstration would work better (or at least be easier) with a Markov chain. But recurrent neural networks allow machines to learn more than just sequences, which Markov chains can't do.
I was No pretty puzzling the code gaming so they would have found out the livelutoo tred s+so the larger stop information. I don't think before doing "is when it can predict it as computing and A/P?" R it wasn't a high-fact a bit stamp idea
One more comment for your neural network :) I admire your work and your ambition.
Thanks, great vid. Also, would be great to hear from you about spiking neural networks. There isn't much free and quality information about spiking nets.
13:45 "How do you watch if you basically have one hardware" #Deep #EveryHumanIsOneHardware #RobotsWillEnslaveUsAll
Immediatly came to see IceMetalPunk's comment.
I commented a few comments just now... actually, I'm sure my habit of commenting multiple times throughout the course of watching a video helped the AI notice me xD
Loren ipsum 2.0
Seriously though, this is an interesting way of producing random text which at the same time is not entire gibberish. I could use this as is, now!
We welcome our new AI overlord! 👑
Is this a reupload? I feel like I remember this, down to the IceMetalPunk guy, but it could just be déjà vu
You probably just have seen my comments before... I comment way too much... hence why the AI noticed me XD
What if there was another input into the network for some kind of "concept" the network is having, and you train it with sentences tagged with their concepts? Then, when generating sentences, you could theoretically generate them from concepts rather than thin air.
I dont think thats needed, the hidden units in the LSTM are responsible for remembering and generating the "concepts" and coordinating text outputs.
I imagine it would be possible to layer this with some sort of pre-processing? For example, I imagine it would be possible to parse the sentences into word objects pretty easily first, and then run the same kind of a network against words rather than letters?
I don't see how this is different from building a probability tree on sequential words. I'm thinking of a hash map filled up by scanning the words in order, like this:
{
"the": ["house", "river"],
"house": ["is", "has", "is" ]
}
Pick a starting word at random, and pick the next words at random from the corresponding array in the hash map. More probable words appear more times in the array, hence has a higher probability to be chosen. I don't see the point in training a neural network for something that is just plain statistics.
I think going below word level is like SHA1: You can't get it back. In this case, the semantics of the language itself. you could have a word level neural net run in parallel. that'd be neat.
Extremely cool demonstration! I find neural networks so fascinating.
please keep on making videos. it really really really helps.
I am currently working on something very similar with reading books and writing small sub stories. I am happy I am not the only one getting the number loop problem
Great video!
Those over the sholder shots have quite a large desync between audio and video
Cool :) I also did this a while ago when I learned about Andrew Karpathy's blog, to generate song lyrics with using a certain music style as input.
"I was able to want to be able to be happy". A perfectly normal UA-cam comment.
Anders Rochester must be so embarrassed for the "thonk" at 8:40
I love you, Mike Pound
Wow its better than mine the chatbot my team made only could successfully achieve contextual awareness. we used LSTMs (a type of node for RNNs)
The craziest thing is - that most actual comments look like that to me.
Mike is one super enthusiastic computer scientist! Go Mike!
Please provide full references for scientific papers when used on the show. People like me might want to read it for ourselves.
"I find your own difference" is amazingly deep!
"I find your own difference." -Hessil200, 2017
If you would always choose the most likely character, what would be the average comment on Computerphile videos?
Online discourse will slowly become a Turing test.
How do I know you're not a bot?
Has there been much work on giving such systems initial information from which to build off of? For example, one might give the system a dictionary of English words, acronyms, etc (possibly letting the system expand it to some extent) with a list of the potential (or probable) types of word (nouns, verbs, adverbs, adjectives, etc.) and even, perhaps verb tenses. Besides going letter-to-letter and word-to-word, it could start building models of overall sentence structures.
This would significantly increase the complexity of the system and prescribing rules, rather than letting the system learn rules, might limit it in certain ways and would require more work initially.
surprised it didn't say "WE LOVE YOU MIKE" all the time
Gentlemen, our work here is done. Computerphile will now thrive on its own.
Bzzz So from now on, all the comments will be written by either ladies or bots?
It's matching his idea professional, and probably about it. After creators and governments is made about them.
It would be cool if you train this network on the whole(or part of) the wikipedia archive.
GPT-2:
Encryption is meant to be able to manages to the description, at the human it's design. Either. He bayed not select to the way.
Gratz IceMetalPunk You win the comments...! xD
Extremely belated thank you!
This video was spectacular.
- A real person
can it write an essay for me??
Given enough examples of essays, enough computer power, and enough time, you could train a neural network to do so. But that's not happening before your deadline, so you should probably get back to work. :D
bowie brewster an essay written by the average YouTub commenter.
Two years later, and we have GPT-3, so now I can officially say: yes, yes it can write an essay for you.
Could anyone shed light on how he managed to download all the UA-cam comments?
You can download the source code from websites in some programming languages and then develop an algorithm to extract specific content like comments from it.
I assume that instead of "downloading the comments", what was done is creating a program that "downloads the entire webpage, and extracts the comments, for multiple (or maybe even all) computerphile videos".
I meant the same. Excuse me for my english if you could not understand it.
Luke Overwien I never said otherwise, I just wanted to say it more clearly than you did.
Not all the comments, he said, just the Computerphile ones. And I'd assume he used some UA-cam API to extract the comments. Such API exists, it gives you comment text and it's metadata in JSON.
Nice to see you using Lua for this! Just recently began learning the language
I'm glad I have contributed to the advancement of automatic Internet trolling.
He's working with the phone customisation.
Giths transistor a benefit of cracking something reciever, not match obviously available?
what about using iconic authors from the past to get reasonable conversations or responses for the present time or maybe for commentary towards the future?
Great video. Phone and so, crunching (with the jump).
I don't understand why language works in this linear way, but say image processing where you don't have fixed image sizes/resolutions does not.
Here! aspart of the DOG 'POUND' fandom for computer science knowledge smackdowns!!!
I think there was a horribly expensive experiment where stocks were either bought or sold based on a neural network trying to decipher the mood of the language used related to the stock.
+ComputerPhile Are Markov chains related to the ideas in this video?
@Computerphile
Suggestion: Does it makes sense to use service like "Grammarly" to auto-correct sentences before we feed them to make this idea more sensible?.
Since RNNs are ideal for predicting the next thing in a long sequence, it's really fun to train them on audio (predicting the next position of the waveform based on the audio leading up to now). It's much slower than dealing with text, though. In case anyone's curious, I've made a couple of videos showing results of that (using torch-rnn, the same software Mike uses here).
I bought a dinosaur from a vending machine, but I was unable to transport it home on my unicycle.
Train it to write a computerfile video (using CC subtitles maybe)
I recently texted my partner "Give yourself 5 minutes to clear the car, it may be frosty" and my phone suggested "relationship" as the next word. Hmmm?
Did you ever see Pacvalham in something the AI generated, something similar, or did I not comment enough?
Nice one. Looks like me using keyboard suggestions to generate test text when developing an app ^^
Hello. If you're interested in AI, you can check out my introductory book "How to Create Machine Superintelligence" available for FRЕЕ in amazon kindle store till 6th October.
In this book, I go over the following:
- intelligence as a form of information processing
- basics of classical computing
- basics of quantum computing
- some basics of machine learning and artificial neural networks
- and also share some thoughts on building general AI and dealing with the control problem
There are several different ways that predictive text systems can be built, but it seems the most common way is actually a trie-based Markov chain system, not a neural network. The result is basically the same in the case of predicting text, though :)
How far we have come
Why Lua and nor other languages? Make a video about that!
It bears an eerie resemblance to fluent aphasia.
On 9ne side you could put the result from an encryption cypher. On the other you put the input for a hashing algorithm. Havkerbot