What is Word2Vec? A Simple Explanation | Deep Learning Tutorial 41 (Tensorflow, Keras & Python)

Поділитися
Вставка
  • Опубліковано 20 чер 2024
  • A very simple explanation of word2vec. This video gives an intuitive understanding of how word2vec algorithm works and how it can generate accurate word embeddings for words such that you can do math with words (a famous example is king - man + woman = queen)
    Part 2 (Coding): • Word2Vec Part 2 | Impl...
    Deep learning playlist: • Deep Learning With Ten...
    Machine learning playlist : ua-cam.com/users/playlist?list...
    Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
    🔖Hashtags🔖
    #word2vecexplained #word2vec #nlpword2vec #nlpword2vectutorial #word2vecdeeplearning #word2vecpython #wordembeddings #wordembedding #pythonword2vec #deeplearning #word2vec #deeplearningtensorflow #deeplearningWord2Vec
    🌎 Website: codebasics.io/?...
    🎥 Codebasics Hindi channel: / @codebasicshindi
    #️⃣ Social Media #️⃣
    🔗 Discord: / discord
    📸 Dhaval's Personal Instagram: / dhavalsays
    📸 Instagram: / codebasicshub
    🔊 Facebook: / codebasicshub
    📱 Twitter: / codebasicshub
    📝 Linkedin (Personal): / dhavalsays
    📝 Linkedin (Codebasics): / codebasics
    ❗❗ DISCLAIMER: All opinions expressed in this video are of my own and not that of my employers'.

КОМЕНТАРІ • 117

  • @codebasics
    @codebasics  2 роки тому +2

    Do you want to learn technology from me? Check codebasics.io/ for my affordable video courses.

  • @mehmetbakideniz
    @mehmetbakideniz 7 місяців тому +8

    I started searching wordtovec videos after failing to understand it by following NG's lessons. That is the single video that can actually tell that the word embeddings are 'the side effects' of the training process and this is how it finally clicked for me. Thank you very much!

  • @gayathrigirishnair7405
    @gayathrigirishnair7405 2 роки тому +3

    This is the video that finally helped me grasp this concept. Thank You!

  • @sunilgundrai6464
    @sunilgundrai6464 Рік тому +17

    As part of my NLP dissertation, I was looking for some real time use cases with some clear explanation. I found this a super useful and thank you for great demonstration with so many examples which are easy to understand. You rock with your teaching skills!!

    • @girmayohannis4659
      @girmayohannis4659 2 місяці тому

      nice to meet you here, in which university are you studying for your PhD?Thanks

  • @raom2127
    @raom2127 2 роки тому +2

    Presenting complex understand matter in an simplified way Dhaval Sir we you are an patience,consistent, simplified ,organised way of subject presentation expert.Basics-Theroy-Coding-Pratice..with..Great Explaination.

  • @sanjeebkumargouda1471
    @sanjeebkumargouda1471 3 роки тому +24

    Great explanation .. 🙌🙌🙌 After watching many videos on this topic finally my understanding is cristal clear. You are doing awesome job sir.

    • @codebasics
      @codebasics  3 роки тому +6

      I appreciate you leaving a comment of appreciation

  • @dhirajkumarsahu999
    @dhirajkumarsahu999 2 роки тому +1

    Great Visual way of teaching! Thank you so much Sir ❤️

  • @ahmedgamberli2250
    @ahmedgamberli2250 Рік тому +2

    I like how you love your homeland and use it in all examples. Greetings and Love from Azerbaijan.

  • @PremKumar136
    @PremKumar136 Рік тому

    Awesome explanation. Crystal Clear.

  • @shubhamwaingade4144
    @shubhamwaingade4144 2 роки тому

    Awesome explanation of the concept!

  • @Sunilgayakawad
    @Sunilgayakawad Рік тому

    Crystal clear explanation!! Thanks you so much sir

  • @list10001
    @list10001 2 роки тому

    Thank you! The explanation was very clear.

  • @mimansamaheshwari4664
    @mimansamaheshwari4664 Рік тому

    One of the best videos on word2vec

  • @assafbotzer7952
    @assafbotzer7952 6 місяців тому +2

    So clear, so eloquent, and so concise. Your contents are gift to this world. Thank you for using your intelligence, diligence and teaching skills to make a positive mark.

  • @notknown9307
    @notknown9307 3 роки тому +2

    Excited 😄

  • @javierlopezcampoy5951
    @javierlopezcampoy5951 Рік тому

    Great explanation! Thank you very much

  • @ledinhanhtan
    @ledinhanhtan 4 місяці тому +1

    Mind blowing 🤯🤯 Thank you!

  • @minruili4789
    @minruili4789 2 роки тому

    Fantastic explanation!

  • @kimdaeeun6683
    @kimdaeeun6683 Рік тому

    Easy explanation!! Tks much👍👍

  • @BARaaz04
    @BARaaz04 2 роки тому

    Very good explanation. Thanks.

  • @namansethi1767
    @namansethi1767 3 роки тому +1

    Thank you Sir for this playlist

  • @manikant1990
    @manikant1990 2 роки тому

    superbly explained !!

  • @prasannan-robots
    @prasannan-robots 3 роки тому

    Thanks for this awesome tutorial waiting for coding part :)

  • @moni1122331
    @moni1122331 2 роки тому +2

    great teacher, great explanation, great presentation, great context

  • @PavanTripathi-rj7bd
    @PavanTripathi-rj7bd 9 місяців тому

    Great explanation!

  • @kanisrini01
    @kanisrini01 10 днів тому

    Amazing Video 👏🌟. Thank you so much for the great explanation

  • @shivav7379
    @shivav7379 Рік тому

    A Very good explaination - really very helpful

  • @vgreddysaragada
    @vgreddysaragada 10 місяців тому

    Super explanation ..Thank you so much

  • @vinaykumardaivajna5260
    @vinaykumardaivajna5260 Рік тому

    Great explanation as always

  • @darshangangurde7855
    @darshangangurde7855 3 роки тому

    thanks a lot...holly great..pls complete the playlist asap

  • @tagoreji2143
    @tagoreji2143 2 роки тому

    Good Explanation Sir.Thank you

  • @yonahcitron226
    @yonahcitron226 Рік тому +1

    incredible content. this guy is one of the best on youtube

    • @codebasics
      @codebasics  Рік тому +2

      I appreciate you leaving a comment of appreciation

  • @robertcormia7970
    @robertcormia7970 4 місяці тому

    This was a useful introduction, I don't have the math chops to understand it, but it was useful to hear some of these definitions.

  • @ashokkonatham8857
    @ashokkonatham8857 3 роки тому +1

    Wow, very very clear . Thank you 🙏

  • @pradeept328
    @pradeept328 5 місяців тому

    Great explanation

  • @vikaspatildod
    @vikaspatildod Рік тому

    Beautiful video

  • @madhu1987ful
    @madhu1987ful 2 роки тому

    Awesome man...loved it...can you pls upload some code walk through of this concept -- some gud projects

  • @phil97n
    @phil97n 5 місяців тому

    Awesome thank you

  • @sumit121285
    @sumit121285 2 роки тому

    you are the real teacher.....what should i say for you ???? thank you sir...thank you so much.........

  • @thurakyawnyein6113
    @thurakyawnyein6113 Місяць тому

    superb..

  • @thamizharasim5970
    @thamizharasim5970 2 роки тому

    Thanks a lot 😌

  • @vishaldas6346
    @vishaldas6346 3 роки тому +4

    Also what would be your next topic in deep learning, is it sequence to sequence models?

  • @trendyjewellery1987
    @trendyjewellery1987 Місяць тому

    Superb

  • @lohitsalavadhi6912
    @lohitsalavadhi6912 2 роки тому

    Great explained finally

  • @jongcheulkim7284
    @jongcheulkim7284 2 роки тому

    Thank you.

  • @debatradas9268
    @debatradas9268 2 роки тому

    thank you so much

  • @notknown9307
    @notknown9307 3 роки тому +1

    thanx we are learning a lot from you

    • @codebasics
      @codebasics  3 роки тому +1

      Glad it was helpful!

    • @notknown9307
      @notknown9307 3 роки тому +1

      @@codebasics waiting for your next upload
      you are doing your work very well👍👍

  • @anpowersoftpowersoft
    @anpowersoftpowersoft 19 днів тому

    Amazing

  • @lisali6205
    @lisali6205 2 роки тому

    you are the best

  • @bii710
    @bii710 2 роки тому

    That was a great explanation. Thanks. I have this one question in my mind. If all words in documents are unique then how word2vec will find vector for the last 2 words? Considering cbow

  • @vitocorleone1991
    @vitocorleone1991 2 роки тому

    Brilliant

  • @yasaswinigollapally7603
    @yasaswinigollapally7603 Рік тому +1

    Sir your video is awesome 🙌,i have one doubt ,what is the main difference between skip gram and bag of words model?

  • @taufiqulhaque4987
    @taufiqulhaque4987 3 роки тому +1

    would you please create a playlist on NLP?

  • @ashwinivalmiki7636
    @ashwinivalmiki7636 3 роки тому +5

    Hello sir,
    Please make a video on GRE and IELTS preparation , this will be more useful and helpful to students like me planning to study Masters Abroad as your videos are clear, we get motivated .
    Thank you.

  • @ShahabShokouhi
    @ShahabShokouhi 4 місяці тому

    I was watching Andrew Ng's course on sequence models and his lecture on word2vec is just a bullshit. Thanks god I found your video, amazing explanation.

  • @vishaldas6346
    @vishaldas6346 3 роки тому +3

    I think Dhaval, there is no non-linear activation function between the input layer and hidden layer. Correct me if I am wrong.

  • @neerajashish7042
    @neerajashish7042 3 роки тому +1

    Approximately how many videos are going to come in this series except the existing videos, by the way thanks a lot sir, the only playlist on youtube which was way more knowledgeable for machine learning and deep learning..

    • @codebasics
      @codebasics  3 роки тому +1

      There will be atleast 5 to 10 videos coming up and then I will start the project series

  • @arjunbali2079
    @arjunbali2079 2 роки тому

    Thanks sir

  • @anonymous-or9pw
    @anonymous-or9pw 5 місяців тому

    He played it really well when he marked male = -1

  • @rahulsoni412
    @rahulsoni412 3 роки тому

    Thanks a lot for explaining this using a neural network diagram :)

    • @codebasics
      @codebasics  3 роки тому

      🙂👍

    • @rahulsoni412
      @rahulsoni412 3 роки тому

      @@codebasics can you explain how the number of weights are calculated in word embedding, I mean the number of total weights. I was getting confused while calculating the number of weights.

  • @akshansh_00
    @akshansh_00 Місяць тому

    bam! life saver

  • @prasanth123cet
    @prasanth123cet 2 роки тому

    Will be get nearly identical word vectors for CBOW and skim gram methods for a particular word say 'king'?

  • @abir95571
    @abir95571 2 роки тому +11

    There's a subtle mistake in your CBOW explanation at 8:34 . In CBOW the target is always the central word based on context i.e the surrounding word . That means for a substring "Emperor ordered his" and window size of 3 the target is "ordered" and features are "Emperor , this"

  • @josephvanname3377
    @josephvanname3377 Рік тому

    The king-man+woman=queen equation tells me that we are not embedding words into a vector space but into an affine space which is like a vector space but where we do not have a notion of a zero vector. Perhaps we can obtain a zero vector simply by taking the weighted average over all words or by doing some regularization during training so that we naturally get a zero vector. What will the zero vector mean anyways?

  • @kmnm9463
    @kmnm9463 3 роки тому +1

    Hi Dhaval,
    Great video on W2V, The link for the coding part of implementing Word2Vec in Python, please?

    • @codebasics
      @codebasics  3 роки тому

      Yes that video is coming up soon. I have not yet uploaded it

  • @djelloulbouchiha-cunaamaal7848

    We need a course about NLP Transformers..

  • @user-ns8rn8fu3z
    @user-ns8rn8fu3z 10 місяців тому

    is there standart real list for every onject given here. For example for cats, tails 0.2?

  • @bibhupadhy4155
    @bibhupadhy4155 Рік тому

    Great Explanation :) Crisp and to the point , Better than Hrithik Roshan Super Hero Movie's Explanation :P :P

  • @uwaisahamedimad556
    @uwaisahamedimad556 Рік тому

    Hi, it is a wonderful explanation for word2vec I've ever seen.I have a question,I have my own corpus and I have built multiple wor2vec models, How to evaluate these models and how am I gonna choose the best one???

    • @codebasics
      @codebasics  Рік тому +1

      One approach is to take a classification or some other NLP problem in your domain and build NLP classification model using your embeddings. You can then check the performance of those models to evaluate how effective embeddings are

    • @uwaisahamedimad556
      @uwaisahamedimad556 Рік тому

      @@codebasics thanks a lot for the reply. based on your answer it seems like there is no standard or at least a well-established evaluation method for the performance of word embeddings.

  • @sebinsaji9573
    @sebinsaji9573 3 роки тому

    Can you say about cyber security scopes skills

  • @SoftRelaxingAndCalmMusicNature
    @SoftRelaxingAndCalmMusicNature 9 місяців тому

    Well done. This is one of the best course on word2vec so far. I do have a master degree in AI and event that I did not work professionaly in the field your cour brough a lot of souvenirs haaa.. During my master 15 years ago I introduced an archaich method for resolving question/answering based on linkgramar, wordnet, verbnet and semnet. At the end of my syntactical analysis I also discovered that by just using world context it was possible to comme up with a vector representation of named entities.. The innovation is here is the use of neural network to give a value to the world. This is just brilliant. In my thesis I was already showing that language is just a code representing a subjective version of one universe and that human and animal comunicate using theirs own code.

  • @ibrahemnasser2744
    @ibrahemnasser2744 2 роки тому +1

    What a mathematician would do when he/she hear you say "a vector is nothing but a set of numbers"

  • @ChaitraC9191
    @ChaitraC9191 2 роки тому +2

    Hello
    I have doubt in this explanation, aren't all the weights gonna be same when our neural network is trained ?
    what I mean is once we train a network W(T)X is what triggers a output node so how do we have different weights for every output word

  • @lemoniall6553
    @lemoniall6553 Рік тому

    Is word2vec using dimensional reduction too?

  • @imanqoly
    @imanqoly 8 місяців тому

    The more you dig deeper into a thing, the greater the tutor gets

  • @wp1300
    @wp1300 6 місяців тому

    7:20 Meaning of word can be inferred by surrounding words

  • @anandakhan4160
    @anandakhan4160 Рік тому

    sir, how do u unzip the json file using git bash , is not clear to me. help me plz. thanks.

  • @amanbajaj7591
    @amanbajaj7591 Рік тому

    wheere is neural network link?

  • @umerfarooque6373
    @umerfarooque6373 3 місяці тому

    How to evaluate a word2vector model

  • @wenzhang5879
    @wenzhang5879 Рік тому

    I think you mean 'side products' rather than 'side effect'?

  • @shivangiawasthi9388
    @shivangiawasthi9388 7 місяців тому

    found a better explanation here - ua-cam.com/video/JmebaapAcKk/v-deo.html

  • @houchj0372
    @houchj0372 2 роки тому

    doesn't CBOW mean Contextual Bag of Words?

    • @codebasics
      @codebasics  2 роки тому

      Continuous Bag Of Words: analyticsindiamag.com/the-continuous-bag-of-words-cbow-model-in-nlp-hands-on-implementation-with-codes/

    • @houchj0372
      @houchj0372 2 роки тому

      @@codebasics you are correct, thank you. By the way, this video is excellent.

  • @RePuLseHQKing
    @RePuLseHQKing 2 роки тому

    3:35 paygap lmao

    • @santoshsaklani5019
      @santoshsaklani5019 2 роки тому

      Kindly make video on vulnerability prediction using wordtovec

  • @Cooldude5786
    @Cooldude5786 11 місяців тому

    The statement "King - man + woman = Queen" is well-known in machine learning. However, when we examine the characteristics of a king, they often include being super rich, having authority, and possibly not having a tail. Yet, there is a contradiction: a lion is also referred to as a king, and it does have a tail. How can a computer differentiate between a human king and an animal king? Doesn't this introduce bias since the training corpus typically associates "king" with humans rather than animals? Just because something appears less frequently or is absent from the corpus doesn't mean it lacks value or significance.

  • @amitmishra5474
    @amitmishra5474 10 місяців тому

    Lion King has tail 😅

  • @johnnysaikia2439
    @johnnysaikia2439 6 місяців тому

    King of the jungle has tail though

  • @PavanKumar-bk1sz
    @PavanKumar-bk1sz 3 роки тому

    Can I get an admission in bsc data science after 12th commerce in St Xavier's College Mumbai ???? and I've mathmatics in optional subject ??? please please please please please please please please please tell me I've been requesting you for 6 months 🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏

  • @humanardaki7911
    @humanardaki7911 Рік тому

    working?

  • @mubashiraqeel9332
    @mubashiraqeel9332 4 місяці тому

    the thing is your all videos are connected to previous I am unable to watch a whole video you always made me pause and watch a previous video that's really a problem first i was watching the text classification video you said go watch bert first then in that video you said go watch word2vec then you said go watch part 1 first then now in this video you said go watch neural network now tell do you really want me to watch a whole video because i am just opening a new tab repitively.

  • @mmenjic
    @mmenjic 2 роки тому

    3:56 why horse and woman are same gender for start ?????
    then king minus men is gender -2 adding a woman or horse to that you get gender -1 which is men or king !?????

  • @pawansinha8442
    @pawansinha8442 Рік тому

    but in case of king of jungle that is lion, he has a tail,😃 just saying...