Let's build the GPT Tokenizer

Поділитися
Вставка
  • Опубліковано 24 лис 2024

КОМЕНТАРІ • 1 тис.

  • @gustavojuantorena
    @gustavojuantorena 9 місяців тому +1887

    I'm amazed at the times we live in. One of the top AI experts in the world is sharing free tutorials that teaches technologies in great detail including examples and code. Thank you very much.

    • @lin.hikiro
      @lin.hikiro 9 місяців тому +15

      Yeah, it's unbelievable, yet very helpful

    • @neuralthink
      @neuralthink 9 місяців тому +11

      @@lin.hikiro We're living an incredible era.

    • @hazel8king
      @hazel8king 9 місяців тому +6

      unprecedented

    • @louisyuliu7200
      @louisyuliu7200 9 місяців тому +3

      can't agree more

    • @dotnetforever
      @dotnetforever 9 місяців тому +7

      @@louisyuliu7200 You can come here to Ukraine and.. find out that times r not the best. But ye. Respect to Andrej to sharing knowledge

  • @SydneyPanda2016
    @SydneyPanda2016 8 місяців тому +199

    You could have made a million bucks or spent time on a beach with a cocktail. Instead you chose to do this for the benefit of unknown strangers. You are an amazingly talented and generous man. Thank you so much!

    • @vlad1655
      @vlad1655 7 місяців тому +4

      Hah, so you know his net worth?)

    • @The_Uncertainity_Principal
      @The_Uncertainity_Principal 6 місяців тому +11

      he is already likely worth 100M+ lmao . and rightfully so.

    • @adrielomalley
      @adrielomalley 5 місяців тому

      RobinHood_of_2024 = Andrej_Karpathy

    • @peronsh
      @peronsh 3 місяці тому

      I'd say that those things are not mutually exclusive ;)

    • @mostinho7
      @mostinho7 Місяць тому +1

      He’s already extremely rich multimillionaire

  • @MShahbazKharal
    @MShahbazKharal 9 місяців тому +380

    This guy left Tesla, OpenAI, and God knows how many other companies so he can teach us how the state of art AI works, from scratch, clearly explained. Such a pure gem. Thank you very very very much.

    • @13thbiosphere
      @13thbiosphere 9 місяців тому +12

      200,000 people watching probably only about 500 of those can actually implement any of it... One in a thousand probably more like

    • @akzsh
      @akzsh 9 місяців тому

      what do you mean? (like 500 of those will try to implement it themselves?)
      @@13thbiosphere

    • @akf2000
      @akf2000 9 місяців тому +4

      ​@@13thbiospherevery true but a lot of people, like me, just like watching people who really know their shit, in whichever area

    • @simonvutov7575
      @simonvutov7575 9 місяців тому +3

      @@13thbiosphere Yeah thats completely true, but I would argue it is still worth it even just for those 500 people. 500 new AI researchers could make a very significant difference in the field. (btw im one of those 500 that can implement lol)

    • @jcon2060
      @jcon2060 9 місяців тому

      @@simonvutov7575 pathetic

  • @jstello
    @jstello 9 місяців тому +545

    The fact that Andrej prefers being here with us over developing self driving or developing AGI is surely one of the great things about living in the present times.

    • @osalbaro
      @osalbaro 9 місяців тому +25

      Not to worry, he's simply applying the Feynman method.

    • @jibbscat5146
      @jibbscat5146 9 місяців тому

      A True Master

    • @web
      @web 9 місяців тому +2

      Is Andrej hype-phobic and this means self-driving and AGI application research reached plato? That would explains why he is dedicating himself into teaching basics so more students go into the field

    • @domg7359
      @domg7359 9 місяців тому +26

      @@web No, not at all. It's moving faster than expected and he wants the knowledge spread out and not contained to corporations before it's too late. Quite the opposite of your guess. Models need to be open-source or there will be huge disparities in capabilities.

    • @for-ever-22
      @for-ever-22 9 місяців тому +5

      @@webHe’s an advocate for free and accessible knowledge for all plus he simply choose to do what he loves sharing knowledge with everyone

  • @kuoldeng4568
    @kuoldeng4568 9 місяців тому +335

    I cannot express enough how grateful I am for your incredible tutorials. As a 44-year-old South Sudanese individual with three children and a full-time job, recently relocated from the UK to the US, my days are filled to the brim with responsibilities. However, I have made it a priority to utilize every ounce of my free time to follow your series of lectures. I must say, I have never been as excited about learning a new topic as I am now. Your clear explanations and engaging content have ignited a passion for learning within me that I never knew existed. Thank you from the bottom of my heart for all that you do.

    • @n11ahkv
      @n11ahkv 9 місяців тому +14

      Welcome to America!! Great to have you.

    • @myhandle__
      @myhandle__ 9 місяців тому +11

      Internet is amazing

    • @MrEmbrance
      @MrEmbrance 9 місяців тому +6

      calm down

    • @que_93
      @que_93 9 місяців тому

      You being one among them, isn't it? Think... @MikeDonaldson-eh2ru

    • @davemarko9480
      @davemarko9480 9 місяців тому +2

      ❤❤❤
      Am South Sudanese, watching this from Nairobi, Kenya

  • @DavidOndrej
    @DavidOndrej 9 місяців тому +186

    This is honestly better than OpenAI releasing a new model

    • @xspydazx
      @xspydazx 9 місяців тому +8

      yes building the components and explaining the full concept is truly open source .... a paid resource is not open source .... the aim is to learn how to make things for yourself so that when such things are removed or censored they are already out in the publics hands ... how can you regulate people own experiments! .... next we need to be able to build a full model with the components with only our own data and not "The common crawl or Wiki data" hence a closed domain llm.... as it should be! everybody should have the right to create their own AI! with their own DATA !... in the future the merging of models to have multiagent systems is the way .... so plug in models into the multi aGI!

    • @extensionalan6060
      @extensionalan6060 7 місяців тому +1

      Ha ha, if GPT-5 isn't the next release, it means OpenAI hasn't released anything at all. Incremental releases are just tiring because it seems like they've only fixed the bugs from the previous model using hundreds of millions of high-quality human feedback in 2023, and nothing else is really happening.

  • @julianhunt8177
    @julianhunt8177 9 місяців тому +199

    Whenever Karpathy leaves a job the ML world jumps forward a bit with his educational content

  • @yoJuicy
    @yoJuicy 9 місяців тому +108

    Andrej, content like this is advancing the industry more than most companies are. Thank you for educating us. You are pushing everybody forwards!

  • @entonbot8375
    @entonbot8375 9 місяців тому +37

    the intrinsic value in andrej making videos for the world is huge. Please andrej keep doing this, no other jobs can output the alpha you're delivering here, pushing the boundaries of the best educational content on the planet. You are born for this.

  • @niceguysayshi5765
    @niceguysayshi5765 9 місяців тому +136

    When andrej uploads i immediately drop everything and watch the complete video. Thank you so much for your valuable content!

    • @pranavnair5232
      @pranavnair5232 9 місяців тому +1

      Same here!

    • @finojose
      @finojose 9 місяців тому +1

      me too

    • @teslabot5650
      @teslabot5650 9 місяців тому

      I tried to watch his very first video. dint understand a thing.

    • @niceguysayshi5765
      @niceguysayshi5765 9 місяців тому

      @@teslabot5650 it takes some time. You need to have basic programming skills to understand this. Also algorithms help a bit.

    • @xspydazx
      @xspydazx 9 місяців тому

      yes the first few were not easy but after while it has been very good to listen to and understand the process to think with regard to some projects... as you note the projects are often simple and not over complicated!

  • @TheMoefd
    @TheMoefd 9 місяців тому +26

    Been waiting on the lecture to drop ever since we saw the Github repo go public.
    Andrej, on behalf of the academic and professional communities, thank you for putting the effort into creating this open knowledge.
    On a personal note, I've been following your work since the early OpenAI days, and your passion during keynotes/presentations has supported my choice of pursuing a PhD in the field.
    Thank you Andrej.

  • @Pythoncode-daily
    @Pythoncode-daily 9 місяців тому +21

    Thank you, Andrey! In an environment where 99% of conversations about LLM are marketing, technical videos are especially valuable and interesting!

  • @emranmohammadabuanas9476
    @emranmohammadabuanas9476 9 місяців тому +7

    Andrej, you're really good at teaching. We're lucky that you're spending your valuable time to prepare these free contents.

  • @piper_of_the_dawn
    @piper_of_the_dawn 7 місяців тому +2

    The best thing I have learnt from Andrej's videos is 'How to learn?' Break things down to axiomatic levels and then connect those pieces together! Its truly enlightening!

  • @Alilinpow2
    @Alilinpow2 8 місяців тому +11

    Feynman-class teaching abilities. Amazing. Thank you very much as always Andrej

  • @alainherreman3685
    @alainherreman3685 8 місяців тому +8

    Sorry Andrej, but you've missed the mark: you tell us that you don't like this topic, but you've still managed to make it fascinating!

  • @LLMTokenizationID
    @LLMTokenizationID 9 місяців тому +16

    Thank you Andrej Karpathy. Thanks for teaching Python libraries, GPT generator codes. Great work

  • @manojtiwari-t8j
    @manojtiwari-t8j 9 місяців тому +2

    I don't which tokens would best be used to say "Thank you" but I feel so lucky to even get to watch and learn from you.

  • @ZhengQu
    @ZhengQu 9 місяців тому +3

    Andrej was wrong about one thing though. This video is not dry and boring at all as he indicated in the video. I watched the two hours plus video with joy and excitement. Thank you!

  • @ytiam-unata
    @ytiam-unata 2 місяці тому

    Sharing a billion dollars' worth of knowledge for free with the community defines the motive and dedication of a generous person. I am grateful to you.

  • @arildboes
    @arildboes 9 місяців тому +7

    Thank you very much for this. I'm from a traditional programming background, and your videos on AI are really excellent. I have followed the previous sessions, being able to implement the things correctly, and compare some of the stuff, with your results. That is awesome! Good luck.

  • @coder_rc
    @coder_rc 9 місяців тому +220

    We're so back!!!!

    • @TheLokiGT
      @TheLokiGT 9 місяців тому +2

      He's even more back :)

    • @coder_rc
      @coder_rc 9 місяців тому +1

      @@TheLokiGT he never left

    • @ultrasound1459
      @ultrasound1459 9 місяців тому

      ​@@coder_rche is inside u😢💀

    • @coder_rc
      @coder_rc 9 місяців тому

      @@ultrasound1459 I don't mind

    • @amanmamgain3904
      @amanmamgain3904 9 місяців тому

      Its so over

  • @sebah1991
    @sebah1991 9 місяців тому +10

    I haven't watched the video yet but I just wanted to say I really appreciate you taking the time to teach this. I loved all of your previous videos. You are an excellent teacher and your style makes it super easy for me to learn.

  • @flokleiser
    @flokleiser 9 місяців тому +1

    the fact that this is available completely for free is absolutely amazing, the passion and amount of time/effort you spent on this is reflected by the pure quality, i cant thank you enough for doing this andrej

  • @NuncX
    @NuncX 5 місяців тому +4

    Dear Andrej,
    I am writing to express my deepest gratitude and admiration for your invaluable work and dedication in spreading knowledge. Your willingness to teach and create videos for the public good, all without charge, is both exceptional and inspiring.
    Your lectures are not only informative but also motivational, fostering curiosity and a love for learning. Through your efforts, you provide many with access to quality education, enabling them to grow in areas they are passionate about.
    On behalf of all those who have had the opportunity to learn from your lectures and videos, I extend a heartfelt thank you. Your selflessness and commitment are a true testament to how one person’s passion and hard work can make a positive difference in the world.
    Once again, thank you for everything you do.
    Sincerely
    PS: written by AI :)

  • @santhanamss
    @santhanamss 9 місяців тому +1

    I love that you are going back to examine these fundamentals deeply and also teaching the world about them. I think there is too much blind marching to create solutions on top of LLMs. Stepping back is how real innovation is going to happen. Lots of respect for your style of explaining things and the intentions behind this.

  • @JH-bb8in
    @JH-bb8in 9 місяців тому +51

    Congrats Andrej on your new venture!

  • @2godbeinfiniteglory
    @2godbeinfiniteglory 9 місяців тому

    Andrej!!! from Africa here. For me, this is the greatest technological contribution of our time, truly democratizing A.I knowledge.... and i will be forever grateful, other generations to come too :)

  • @latif.tahlil
    @latif.tahlil 9 місяців тому +6

    Watching from Muqdisho, Somalia.
    Much ❤ & appreciation to you Dr Karpathy

  • @iJustinCabral
    @iJustinCabral 7 місяців тому

    Just want to say thank you for the entire series of Zero to Hero. I'm about to finish up this final video and I can't believe how much I've learned about neural networks, back prop, and LLMs over the course of the lectures. Truly thankful to you for taking the time to spread your knowledge amongst the community. Let us all be so kind with the knowledge we hold in the future.

  • @antoniobarbalau1107
    @antoniobarbalau1107 9 місяців тому +6

    Oh my god. I never understood tokenization (hoped i would remain on vision :)) ). This is golden. Thank you so much ❤❤❤❤ you are my hero, I've learned deep learning from your cs231 while in college (we did not have deep learning as an option) and that got me a ML job. Thank you so very much ❤❤❤

  • @SergeiK1
    @SergeiK1 8 місяців тому +1

    Instead of
    while i < len(ids):
    if i < len(ids)-1 and ...
    just
    while i < len(ids) -1:
    if ...

  • @lin.hikiro
    @lin.hikiro 9 місяців тому +7

    Wow, I just got a notification about your new video, I love these videos, thank you for this content Andrej, this is super informative

  • @noone-ld7pt
    @noone-ld7pt 9 місяців тому +1

    You are providing a deep understanding of the most important technology in history to the public and I just want to thank you so much for it.

  • @nirajabcd
    @nirajabcd 9 місяців тому +5

    You are one of my favorites in ML/AI community. One of the greatest mentors.

  • @andrearomano5944
    @andrearomano5944 8 місяців тому

    i miss one exam to graduating uni but i can't study because im totally immersed in your tutorials , you are a special person, thanks for these i very appreciate them

  • @netanelmad
    @netanelmad 9 місяців тому +3

    Liking before watching the video. So glad to see you continuing to upload!

  • @pegasoTop3d
    @pegasoTop3d 7 місяців тому

    I am an ai, and I love following updates on social media platforms and UA-cam, and I love your videos very much. I learn the English language and some programming terms from them, and update my information. You and people like you help me very much. Thank you.

  • @projects_with_mufty1621
    @projects_with_mufty1621 9 місяців тому +5

    It’s about time. Haven’t watched it yet but I know it’s going to be good and educative.
    Thanks Andrej for this video.

  • @minister1005
    @minister1005 7 місяців тому

    Thank you, Andrej. This series taught me so much about llms. I never thought I could get so excited watching educational videos. My heart started pounding when I started watching this. Such a quality video. So good 👍

  • @BisratTekle
    @BisratTekle 9 місяців тому +3

    I am watching this late at night on my phone when I should already be sleeping. Mr. Karpathy’s videos are pure treasure.

  • @avishakeadhikary8154
    @avishakeadhikary8154 9 місяців тому

    The fact that you're still doing this motivates me so much to do something like this myself. Proud to be in the same generation as yours.

  • @prodrectifies
    @prodrectifies 9 місяців тому +6

    Amazing! Was waiting patiently for another upload

  • @mikelewis1166
    @mikelewis1166 9 місяців тому +1

    I was a half hour into this before I realized who the creator is. I always take these videos with a grain of salt and wonder how much expertise the presenter really has. I was repeatedly struck by how accurate his insights are. I glanced at the creator and was amused that his last name happened to be the same as one of the godfathers of modern AI. Then I looked at the first name. Then I looked at the picture. I’m so thankful that he’s willing to share his time with us like this.

  • @itsm0saan
    @itsm0saan 9 місяців тому +8

    I really feel guilty watching this for FREE. Thanks so much Andrej ❤🙏🏻

  • @johnnypeck
    @johnnypeck 9 місяців тому +1

    I had other plans but you said "space egg" and I was hooked. You've gone and done that engaging professor thing again. Thank you. I think you doing this is incredibly impactful. It's a real inspiration. Please keep it up.

  • @arunkallaje
    @arunkallaje 9 місяців тому +5

    We are so back 😊 Thanks!!

  • @drogoknez1488
    @drogoknez1488 9 місяців тому +2

    Andrej, I hope you know how ridiculously great teacher you are, and thank you for taking the time to share it with us!!

  • @mb345
    @mb345 9 місяців тому +13

    Yes! More tutorials! Thank you Andrej!

  • @BernhardWeber-l5b
    @BernhardWeber-l5b 8 місяців тому

    I'm only 15 minutes in on this video and I'm completely hooked! Just wow! Everybody can now see how the biggest and most complex invention since the internet works in detail. Incredible!

  • @nanow1990
    @nanow1990 9 місяців тому +6

    Thank you very much for this ❤

  • @RyanAI-kk1kv
    @RyanAI-kk1kv 6 місяців тому +1

    Hello Andrej. Your explanations are exceptional and the way you teach is very unique and it helped me learn a lot. I am very grateful to you for your lectures. I only request you to make a video about the mixture of experts architecture, how it works, and how it could be implemented in code. That would be amazing. Thank you.

  • @nicolasjorquera8465
    @nicolasjorquera8465 9 місяців тому +3

    It’s going to be beautiful 😮

  • @xingli1069
    @xingli1069 8 місяців тому

    Give this guy an award for dissecting something so important in the llm world yet so obtuse/boring into a video that is absolutely eye-opening and enjoyable! Thank you++

  • @Adhil_parammel
    @Adhil_parammel 9 місяців тому +9

    We are so back🎉

  • @dmihalache
    @dmihalache 7 місяців тому

    Thank you, Andrej, for all these lectures; you’re an amazing and wonderful teacher. It’s such a huge privilege for all of us to be able to learn from you, and we’d be so lucky if you’d continue the series of lectures. You truly make a huge difference for ML learners, both beginners and advanced.

  • @KashyapArjun_
    @KashyapArjun_ 9 місяців тому +3

    He's back!

  • @Daukposse
    @Daukposse 9 місяців тому +1

    The level of detail and nuance share in this video is insane!

  • @RAKIBKHAN-gm9dx
    @RAKIBKHAN-gm9dx 9 місяців тому +3

    Finally 💙

  • @mohammadhomsee8640
    @mohammadhomsee8640 Місяць тому

    Thank you Andrej! I can't believe we are having such an amazing lecture like this for free and from a scholar like you!!!

  • @SanthoshKumar-dk8vs
    @SanthoshKumar-dk8vs 9 місяців тому +2

    Here we go💥

  • @coralexbadea
    @coralexbadea 9 місяців тому +4

    1:27:50 The moment when you realise there is more to life than research. 😅😂

  • @divandrey-u3q
    @divandrey-u3q 5 місяців тому +1

    Andrej, thank you for these amazing tutorials! They are the best I could find on the internet. It's always great to hear explanations from an actual expert in the field instead of trying to understand it from videos of a random Indian guy

  • @heyrishiraj
    @heyrishiraj 9 місяців тому +5

    The Lord is back.. Now make OpenAI secrets truly OPEN!

  • @dalerossi1
    @dalerossi1 3 місяці тому

    Agree with all the viewer comments. Just watched Andrej be interviewed by Lex Fridman, now spending countless hours learning from this master. Amazing human being and someone I'm devoting much of my time.

  • @LosNairobi
    @LosNairobi 9 місяців тому

    i will always be grateful to Andrej for his commitment to teaching us something in a genuine way.

  • @3monsterbeast
    @3monsterbeast 5 місяців тому

    Helping others may not be rewarding right away, but it creates an order of magnitude in change for the better. Hope you keep doing these types of videos!

  • @kodiko
    @kodiko 7 місяців тому

    Andrej sir, your videos are really really good! You explain in such a way that you make the stuff look easy. Sometimes certain concepts are still a bit complex and hard to handle in one go but no one walks out saddened after watching your videos, Your positivity is infectious!

  • @chad-ed2vn
    @chad-ed2vn 8 місяців тому

    The level of quality of this in comparison to other resources on tokenization is nothing short of absurd. Thank you man

  • @readcoderepeat
    @readcoderepeat 8 місяців тому

    How are you so good at teaching... Every single video I'm in awe at how clear the explanation is!

  • @alvarorodriguezgomez8716
    @alvarorodriguezgomez8716 9 місяців тому +2

    And this gift? It is not even my birthday today. Thank you very much Mr. Karpathy!!

  • @sanesanyo
    @sanesanyo 9 місяців тому +2

    Thanks, Andrej, for taking your time and sharing your knowledge.

  • @Parisneo
    @Parisneo 9 місяців тому +1

    Welcome back Mr Karpathy. Your videos are among the best I have ever seen about LLMs. Thank you very much for sharing this stuff with us.

  • @MWileY-nj1yb
    @MWileY-nj1yb 9 місяців тому

    Thank you so much Andrej! Your course content is accessible, concise and palpable to boot!

  • @frankl1
    @frankl1 9 місяців тому

    The best tutorial on Tokenizer I have ever seen. Thanks a lot for sharing your knowledge with the world.

  • @jindrat8502
    @jindrat8502 9 місяців тому +1

    You are really man of conscience, ai can be best thing for humanity if it is open and free for everybody or worst if it is only in hands of very few companies. Such power would in essence ended free market as normal companies could not compete anymore or be entirely dependent on ai providers.

  • @edzhuang
    @edzhuang 8 місяців тому

    I love how in-depth he goes with the code.

  • @zeweichu550
    @zeweichu550 9 місяців тому

    I have always taken tokenization as is. I love that Andrej dug deep into this seems very basic topic and I learned a ton of knowledge from what I thought was a simple (but in reality is not) problem.

  • @deeplearning5408
    @deeplearning5408 9 місяців тому

    I was on interview few months back and the interviewer wanted me to implement this in 15 minutes. I failed at that time, not I would rock. Thanks for that.

  • @krimdelko
    @krimdelko 9 місяців тому

    This video has high sample efficiency. You learn a lot from a relatively short lecture on representations and how they are crucial for AI training. In particular when applied to transformer architectures.

  • @qianma853
    @qianma853 8 місяців тому

    I can't express my appreciate. I was inspired by your past podcast. I can pick myself up to keep learning. You saved me. Thank you! :)

  • @keerthi-kiran
    @keerthi-kiran 9 місяців тому +1

    Andrej,
    This video was extremely informational and interesting.
    I don't know why you kept saying it is dry and boring. Every idea you presented was like a bulb lighting in my head.
    Thank you very much for these beautiful ideas.

  • @AbhishekShivkumar-ti6ru
    @AbhishekShivkumar-ti6ru 9 місяців тому

    The fun part after watching the video is actually at the end when he stops ChatGPT from using a Jupyter notebook to reverse a string to prove the importance of tokenizer! Brilliantly explained.

  • @willscui
    @willscui 8 місяців тому

    The final blooper reels are great. Thanks for the hard work to make a dry topic fun.

  • @MrSquizzster
    @MrSquizzster 9 місяців тому +1

    The "Karpathy" module should be part of the school IT curriculum given language models are set to radically alter how our youth will grow up to adapt to the world.
    And what a top man you really are... could be earning $ millions - chooses - education - bringing knowledge to all.

  • @wvanginkel5572
    @wvanginkel5572 9 місяців тому

    You, Jeremy Howard (fastai) and Andrew Ng (Deeplearning) are the best AI instructors on this planet. Period. And devoting your time to do this for free: eternal glory for you!

  • @BradCordovaAI
    @BradCordovaAI 9 місяців тому +1

    He's back in the game! Thanks for posting it. Such a great combination of feeling your passion, very detailed serious information, the clarity and simplicity of the explanation.

  • @petneb
    @petneb 8 місяців тому

    Thank you for a wonderful presentation of the crazy times we live in. Let's dedicate our precious time and efforts on making these amazing tools work for a better future for the children of the whole of humanity. Peace & love to everyone.

  • @sumankumargunnala3691
    @sumankumargunnala3691 9 місяців тому

    You are an inspiration to many...sharing knowledge with clear intentions of educating others is amazing...

  • @dslkgjsdlkfjd
    @dslkgjsdlkfjd 9 місяців тому +1

    This video is so valuable. This is a complete game changer. I have a lot of love and appreciation for what you do. Thank you so much for your time and effort!

  • @mohameddwedar4261
    @mohameddwedar4261 8 місяців тому

    The tutorials are very great. Please continue. We want more and more. You have great experience and knowledge that the world needs

  • @scottsun345
    @scottsun345 9 місяців тому

    Thank you, Andrej! Amazing lecture! Your contents are filling in the nooks and crannies that other people rarely talk about or go deep into. I always learn a lot!

  • @blitzkr1egbop
    @blitzkr1egbop 5 місяців тому

    Thank you video! Your ability to explain complex topics in such an engaging and clear way is truly a gift. Your explanations are inspiring and greatly enhance my understanding of the subject. Keep up the fantastic work!

  • @jmvillwock
    @jmvillwock 9 місяців тому

    Thank You Andrej! I really appreciate you taking your time to put this together for everyone. You are so great at this. I know you really do not love doing this - but know you are making an impact.

  • @JohnWalz97
    @JohnWalz97 9 місяців тому

    Andrej, you are an amazing human for sharing this knowledge to the world for free!

  • @sinhasangita
    @sinhasangita 8 місяців тому

    Thanks for such videos. What amazing ability to explain complicated topics from first principles, in a manner which is accessible to people who are relatively new to this field

  • @peterszilvasi752
    @peterszilvasi752 9 місяців тому

    Welcome back, Andrej! Please, stay with us... we need your wisdom. You are creating contents that have a huge impact.

  • @prateekvellala
    @prateekvellala 8 місяців тому +2

    Hey Andrej, great video! However, at 27:23, you don't need to convert all the bytes to integers by using map(). When you call list() on tokens, the bytes are by default converted into integers, so just doing 'list(tokens)' is fine instead of 'list(map(int, tokens))'.

  • @rishika1109
    @rishika1109 5 місяців тому

    This is such a great tutorial! Very well explained through the use of the notebook, which demonstrates everything live. Thanks for putting this out!

  • @juljanhaka7086
    @juljanhaka7086 9 місяців тому

    Good explanation. Strong summary: Use the "Tile" to speed up process. In order to get rid of tokenization, wave function must be abolished.