Would you be interested in conducting a workshop on How ChatGPT works, Please let me know as quickly as you can and I will share my email id so that we may discuss further
My lawd Ajay this is absolutely amazing! Just binged watched this at the gym. Your ability to distill something so hardcore into such a simple explanation is nuts. Bravo homie!
Loved the video, it really helped me. I had a problem with understanding how the jump from language modeling to other tasks works. You saying that it's a finetuning step helped
Great video! Where did you get the numbers indicating how many samples it takes a human to learn those specific tasks? I'm wondering because it surprises me how low they are considering it takes humans years to learn how to form their first sentence.
It's absolutely astounding how transformers learn to reason. It's ChatGPT's ability to reason that sets it (and others like it) apart from anything done previously in Machine Learning and Artificial Intelligence. We are truly living in the dawning of the age of artificial intelligence.
But why is GPT better than for example BLOOM? Isn’t the architecture almost the same? So what makes the difference? (And here with GPT I mean gpt3, what makes GPT3 so good in comparison to others, even GPT2)
After having ChatGPT talk to ALICE and other chatbots, I am convinced that ChatGPT is just another chatbot and not as revolutionary as people are claiming. I say this because it's very limited in its ability respond and falls back on repeating statements. Also after talking to it directly, I found it to be very simplistic in it' ability to converse. I'm sure the coding and underlying technology is very impressive but what it's doing isn't much better than a nearly 30-year-old chatbot and thus unimpressive from the standpoint of what it's supposed to be. I know someone is going to be very offended by what I just said and all I can say is, go tell it to the chatbot.
I feel like at its core it has just memorised the entire knowledge of the internet so whenever you ask it to perform a novel task it just fails badly. Nevertheless it is still mind bogglingly complex under the hood thats for sure.
Is it that the GPT models can tokenize the text into the character-level for the lowest level? I was impressed by how it generated those very rare words which that BERT can't.
It tokenizes text into “Byte pair encodings” which are subwords (like “-ing”). I believe this is done to balance the inference time offered by word tokenization and small vocabulary size offered by character tokenization.
@@CodeEmporium But when I asked the GPT-3 or chatGPT about some biomedical questions (the keywords of answers are already within the question), they can generate the words like "L-CCG-I" or "PNU156804", which, in my opinion, can't be processed or generated in subword-level.
Bro your videos are really good. But I am not able to get an order to watch things. This is the 5th Or 6th video on gpt from your channel. Can you make an ordered playlist for all yours video for deep learning? That will be very helpful for people who want to consume your content
Hey Shivam. Thanks! If you check the description of this video, you’ll see the main playlists now. There are playlists for my ChatGPT videos and another playlist for Transformers. Hope this helps :)
So by watching a movie on you tube, that has GPT, we’re inadvertently teaching GPT to learn and be better? I think I’m out on that, I’m not going to make AI’s advancement easier by engaging with it. I want NOTHING to do with AI! I may be the minority but I’m okay wth that. Thanks for the video.
If you think I deserve it, please consider liking the video and subscribing for more content like this :)
Would you be interested in conducting a workshop on How ChatGPT works, Please let me know as quickly as you can and I will share my email id so that we may discuss further
We can talk about this by emailing therealcodeemporium@gmail.com
This channel is so underrated. The way he explains complex subjects is remarkable.
Thanks so much for the kind words :)
You deserve it. ❤
My lawd Ajay this is absolutely amazing! Just binged watched this at the gym. Your ability to distill something so hardcore into such a simple explanation is nuts. Bravo homie!
Thanks a ton Nick. Can’t wait for your course on this!
@@CodeEmporium at the moment it’s a minute and 45 seconds of me making language puns.
The crossover I never expected. 🙌
Loved the video, it really helped me. I had a problem with understanding how the jump from language modeling to other tasks works. You saying that it's a finetuning step helped
Wow, this video was so informative and well-explained. I appreciated the clear and concise way the subject was covered. Great job!!!!!!
Thanks for the super kind words! More like this to come :)
Great video! Where did you get the numbers indicating how many samples it takes a human to learn those specific tasks? I'm wondering because it surprises me how low they are considering it takes humans years to learn how to form their first sentence.
It's absolutely astounding how transformers learn to reason. It's ChatGPT's ability to reason that sets it (and others like it) apart from anything done previously in Machine Learning and Artificial Intelligence. We are truly living in the dawning of the age of artificial intelligence.
Really nice video, can I simply use pre-training GPT or BERT after fine-tuning for video captioning, which one is better for this task?
Very well explained
But why is GPT better than for example BLOOM? Isn’t the architecture almost the same? So what makes the difference? (And here with GPT I mean gpt3, what makes GPT3 so good in comparison to others, even GPT2)
Bloom not possible to sign up.:)
@@MBAFuturis what do you mean by that?
Amazing Explanation
Thanks so much for watching !
nice thx! like the explanation of self-supervised in particular! wasn't aware of that
Thank you for watching !
After having ChatGPT talk to ALICE and other chatbots, I am convinced that ChatGPT is just another chatbot and not as revolutionary as people are claiming. I say this because it's very limited in its ability respond and falls back on repeating statements. Also after talking to it directly, I found it to be very simplistic in it' ability to converse. I'm sure the coding and underlying technology is very impressive but what it's doing isn't much better than a nearly 30-year-old chatbot and thus unimpressive from the standpoint of what it's supposed to be.
I know someone is going to be very offended by what I just said and all I can say is, go tell it to the chatbot.
I feel like at its core it has just memorised the entire knowledge of the internet so whenever you ask it to perform a novel task it just fails badly. Nevertheless it is still mind bogglingly complex under the hood thats for sure.
Is it that the GPT models can tokenize the text into the character-level for the lowest level? I was impressed by how it generated those very rare words which that BERT can't.
It tokenizes text into “Byte pair encodings” which are subwords (like “-ing”). I believe this is done to balance the inference time offered by word tokenization and small vocabulary size offered by character tokenization.
@@CodeEmporium But when I asked the GPT-3 or chatGPT about some biomedical questions (the keywords of answers are already within the question), they can generate the words like "L-CCG-I" or "PNU156804", which, in my opinion, can't be processed or generated in subword-level.
Great work!
Thanks a ton :)
Thank you so much !!!👍👏
5:36
What is meta learning
Where does llama fall in all these? Is it GPT based, BERT based or is different altogether?
It's only know I understood why you were talking about workable memory lol, a working memory you work on...
Hi bro you make crazy content. I really like your content.
I am from Pakistan
🔥🔥🔥
These videos are content free. Its press science.
Bro your videos are really good.
But I am not able to get an order to watch things. This is the 5th Or 6th video on gpt from your channel.
Can you make an ordered playlist for all yours video for deep learning? That will be very helpful for people who want to consume your content
Hey Shivam. Thanks! If you check the description of this video, you’ll see the main playlists now. There are playlists for my ChatGPT videos and another playlist for Transformers. Hope this helps :)
i dont understand the generative part of gpt . no body talked about it
Hopefully I can help :)
So by watching a movie on you tube, that has GPT, we’re inadvertently teaching GPT to learn and be better? I think I’m out on that, I’m not going to make AI’s advancement easier by engaging with it. I want NOTHING to do with AI! I may be the minority but I’m okay wth that. Thanks for the video.