How ChatGPT Works Technically | ChatGPT Architecture

Поділитися
Вставка
  • Опубліковано 23 кві 2023
  • Get a Free System Design PDF with 158 pages by subscribing to our weekly newsletter.: blog.bytebytego.com
    Animation tools: Adobe Illustrator and After Effects.
    Checkout our bestselling System Design Interview books:
    Volume 1: amzn.to/3Ou7gkd
    Volume 2: amzn.to/3HqGozy
    The digital version of System Design Interview books: bit.ly/3mlDSk9
    ABOUT US:
    Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

КОМЕНТАРІ • 263

  • @sameerizaj5458
    @sameerizaj5458 Рік тому +361

    Sir i'm being very honest your 5 to 7 minutes video always taught more than the week of study,these viusal are so helpfull and also i love the fact whatever word you use you first explain the meaning behind that make's thing more easy to understand

    • @happyruimi
      @happyruimi Рік тому +13

      You should probably drop the course if you learnt more in this 5 min video than you did in 4 weeks...

    • @user-dh7ut3wh7w
      @user-dh7ut3wh7w 7 місяців тому +7

      @@happyruimi People love learning superficial stuff that makes them feel smarter lol

    • @omgmaw
      @omgmaw 15 днів тому

      Sar sar sar

  • @cexploreful
    @cexploreful Рік тому +51

    Love the way you animate the presentation! Everything went so smooth and clear!

  • @ferdous_khalifa
    @ferdous_khalifa Рік тому +18

    Thank you so much for creating this insightful UA-cam video! Your hard work and dedication to providing quality content are truly appreciated. You’ve managed to convey the information in a clear and engaging way, making it easy for viewers like myself to understand and enjoy. Keep up the fantastic work, and I’m eagerly looking forward to your future videos!

  • @satychary
    @satychary Рік тому +20

    As always, CLEAR AS THE BLUE SKY - Alex, EVERY one of your explainers is pure gold, including this one! Thank you for making this.

  • @jonosutcliffe1
    @jonosutcliffe1 Рік тому +3

    The best summary available. I needed a good summary for non engineers about how it works and I wish I'd found your explanation before creating my presentation. Very nice work, thanks!

  • @ramaati18
    @ramaati18 2 місяці тому +1

    Wow! The best animation in slides i have seen in any tutorials! Every word you utter during you presentation is golden and easy to learn easily and quickly!⭐️⭐️⭐️⭐️⭐️!

  • @OsamaAdel
    @OsamaAdel 8 місяців тому +1

    I turned to be more complicated than I first thought. However this is natural, since its capabilities are fascinating and growing from day to day. Very nice video, thank you a lot.

  • @chrismachabee3128
    @chrismachabee3128 Рік тому +3

    This is a very good video. It is the best nuts and bolts video I have seen and you've about think I have even heard of and I've been listening to everything I can, so fine job, well done and thanks.

  • @sudzam
    @sudzam 11 місяців тому

    Wonderful explanation! Just enough detail to explore sub-topics in detail.. Thanks.

  • @moneycrab
    @moneycrab Рік тому +6

    Thank you for this! So clear and helpful

  • @MrKelaher
    @MrKelaher 7 місяців тому

    Great video, helps to clear up some confusion by "going behind the curtain"

  • @sivam5204
    @sivam5204 9 днів тому

    Animations are awesome :) easy to follow !

  • @DevCoder
    @DevCoder Рік тому +8

    Man you explained everything in a simple and clear way. Thank you very much for this helpful content

  • @richardglady3009
    @richardglady3009 8 місяців тому

    Thank you very much for this great explanation. As a non-computer expert, the information was well presented and very understandable. Thanks.

  • @KumarBodana
    @KumarBodana 2 місяці тому

    Excellent video! Best explanation I've seen on ChatGPT

  • @goneni1504
    @goneni1504 5 місяців тому

    Excellent. Concise but thorough and clever. Thanks a lot. Love the burger analogy.

  • @debashishbramha
    @debashishbramha 3 місяці тому

    Excellent analysis.Thanks from India.

  • @Tony-dp1rl
    @Tony-dp1rl Рік тому

    Knew this was coming on your channel, great little intro to the topic for sharing with people, thanks.

  • @thydevdom
    @thydevdom 10 місяців тому

    A few months ago I was looking exactly for this kind of video. Thank you!!!

  • @betweenprojects
    @betweenprojects Рік тому +4

    I am amazed by the results. A great wordsmith/people pleaser but factually about as reliable as a first year undergraduate in a bar.

  • @rlewisf1
    @rlewisf1 Рік тому +1

    Very useful and professional presentation. Thank you.

  • @SanjaySingh-jo3py
    @SanjaySingh-jo3py Рік тому

    Voice to slide !! Perfect, Sir 🙏🙏🙏🙏🙏

  • @moiserwibutso4899
    @moiserwibutso4899 3 місяці тому +1

    Thanks for this amazing explanation. The visuals are so fantastic 👌

  • @rubbish9231
    @rubbish9231 10 місяців тому +4

    As a software engineer I learned how to become a good chef. I asked gpt for it's implementation and informed me well

  • @wernerkallmann9105
    @wernerkallmann9105 Рік тому +1

    Excellent explanation. Thank you very much.

  • @jntaca
    @jntaca Рік тому +8

    I follow a lot of divulgation tech channels.
    You are the most clear and concise of all.
    Thanks for your work !

  • @rajneeshverma4026
    @rajneeshverma4026 6 місяців тому

    super simple explanation and very insightful.

  • @deepflyball
    @deepflyball 5 місяців тому

    New sub here. Thanks for such a clear explanation. I really enjoy the way you explain things and the graphics you use. Looking forward to more videos. Happy New Year.

  • @pawandhailPWRIES
    @pawandhailPWRIES Рік тому

    Excellent tutorial, very insightful !

  • @arthurcolle2778
    @arthurcolle2778 Рік тому +38

    Excellent video, covers all key concepts - RLHF, PPO, etc... and how they relate to the GPT models. Great content!
    +Subscribed

    • @jeroenvermunt3372
      @jeroenvermunt3372 9 місяців тому +1

      Those are concepts for reinforcement learning, I missed the key concepts of the LLM itself. I found out via other sources that the actual key concept of the LLM itself is multi-head attention

  • @L_Christ_BR
    @L_Christ_BR Рік тому +3

    Estou impressionado com a tecnologia utilizada pelo ChatGPT-4! É fascinante como a Inteligência Artificial evoluiu nos últimos anos, permitindo que máquinas possam entender e responder às nossas perguntas de uma forma quase humana. No entanto, é importante lembrar que, assim como qualquer tecnologia, a IA também pode ser perigosa. A capacidade de aprender e evoluir rapidamente significa que as máquinas podem se tornar imprevisíveis e tomar decisões que podem ser prejudiciais para os seres humanos. É crucial que os desenvolvedores de IA levem em consideração a segurança e a ética em suas criações, para que possamos aproveitar os benefícios da tecnologia sem comprometer nossa segurança - Texto criado pela IA

  • @bobbyandthomas
    @bobbyandthomas 9 місяців тому +1

    Thank you for explaing so nicely!

  • @inber
    @inber Рік тому

    Great explanation, much appreciated. I learned a lot.

  • @jdrake411
    @jdrake411 Рік тому

    I found your review very useful, thank you!

  • @JBoy340a
    @JBoy340a Рік тому +1

    Very nice and clear explanation.

  • @SubashiniBala
    @SubashiniBala 6 місяців тому

    Pretty insightful content !!
    On the side note, I liked that you have brought up an example with Indian prime minister

  • @szamee83
    @szamee83 17 днів тому

    Excellent. Thank you

  • @micbab-vg2mu
    @micbab-vg2mu Рік тому

    Great explanation - thank you

  • @dionisos8152
    @dionisos8152 Рік тому

    Congratulations, this video is very clear and useful.

  • @rahuldinesh2840
    @rahuldinesh2840 Рік тому

    This is classic presenation. Thanks.

  • @nguyenhonghanh2043
    @nguyenhonghanh2043 9 місяців тому

    Thanks for the video, I find it very helpful.

  • @dineshchandgr
    @dineshchandgr 5 місяців тому

    amazing explanation. thank you

  • @hanimahdi7244
    @hanimahdi7244 Рік тому

    Very nice work, thanks!

  • @imagai.store.2323
    @imagai.store.2323 10 місяців тому

    been searching like this one, thank you so much sir

  • @ganeshkameswaran7123
    @ganeshkameswaran7123 11 місяців тому

    Nice explanation, thanks!

  • @williambrackett7100
    @williambrackett7100 7 місяців тому

    Fantastic explanation!

  • @darissalzburger
    @darissalzburger 3 місяці тому +1

    I rarely comment the videos, but I had to comment yours. Amazing explanation and visualization. Thanks

  • @lloydwyngard7233
    @lloydwyngard7233 Рік тому

    Great video, very informative thanks!

  • @bitsnbytes4406
    @bitsnbytes4406 Рік тому

    Great video! Thank you very much.

  • @MandarPophali-yy1yz
    @MandarPophali-yy1yz Рік тому +1

    This is great summary. Can you have quick summary on differences between BARD and chatGPT?

  • @kennethroark917
    @kennethroark917 11 місяців тому

    This is gold. Thank you!

  • @yuli.kamakura
    @yuli.kamakura Рік тому

    Very exciting, easy to understand

  • @thanhlv2
    @thanhlv2 11 місяців тому

    Great video. Keep doing your great work 👍👍👍👍👍

  • @alexharvey9721
    @alexharvey9721 9 місяців тому

    Great video. Clear and broad while still short - that's a sub from me, thanks!
    Sometimes it seems like a lot of steps to fine tune the usefulness of statistical representations instead of just going to the effort of trying to understand cognition. I wonder how responsible it is. But I guess morality has never stood in the way of bucketfuls of cash!
    The irony is many of those who developed the tech are incredibly thoughtful and morally grounded, while those in control are employed for their moral flexibility.

  • @FlareGunDebate
    @FlareGunDebate Рік тому +10

    Bitwise operation, if/elseif/else, and neural network are orders of complexity in flow control. ChatGPT is huge in terms of parameters but it isn't any more sophisticated than modern translation software which relies primarily on tons of user data.

    • @divotiontogod
      @divotiontogod Рік тому

      right, most people fail to understand and see how chatgpt is not able to for example write a clear code, it generates always a buggy code, and one has to elaborate more on minuscules of requirement for it to change it answer to a more better one. plus its answers are not mathematically correct, ask a few complex math questions and you will know!
      AI can never beat humans, ill iterate, even the dumbest human!

    • @williamtim5893
      @williamtim5893 Рік тому +3

      The information age creates the data for the AI age

    • @FlareGunDebate
      @FlareGunDebate Рік тому

      @@williamtim5893 yeah OpenAI is neither open source nor artificial intelligence

  • @santi044
    @santi044 6 місяців тому

    super well animated video

  • @user-jq2up3ft6f
    @user-jq2up3ft6f Рік тому

    Great Job, Thank you!

  • @MrDanieluy
    @MrDanieluy Рік тому

    Brillant resumee and presentation !

  • @diondewet8522
    @diondewet8522 Рік тому

    Wow.....brilliant explanation

  • @exxzxxe
    @exxzxxe 11 місяців тому

    Very well done!

  • @superpowerdragon
    @superpowerdragon Рік тому +11

    can you do a video on how Stable Diffusion work technically?

  • @praveends06
    @praveends06 11 місяців тому

    Beautify articulated.

  • @terryliu3635
    @terryliu3635 7 місяців тому

    awesome video!

  • @williebrits6272
    @williebrits6272 5 місяців тому

    Awesome, well done

  • @sheryll9966
    @sheryll9966 5 місяців тому

    Great content!

  • @VictorAntonioLive
    @VictorAntonioLive 10 місяців тому

    Exceptional video!

  • @ldohlj1
    @ldohlj1 Рік тому

    Thanks.
    Please do one for Stable Diffusion too

  • @Larry21924
    @Larry21924 6 місяців тому

    This content is a guiding star, revealing new pathways of understanding. A book with parallel material touched me deeply. "The Art of Meaningful Relationships in the 21st Century" by Leo Flint

  • @modolief
    @modolief Рік тому

    Superb, as usual

  • @marciabrown5569
    @marciabrown5569 Рік тому

    I really enjoyed your analogy. Though it is still over my head I do think I understand a bit more.

  • @damonwu9658
    @damonwu9658 Рік тому

    Thank you for sharing, great stuff, and langchain next?

  • @dr.imayavarambanmunuswamy808
    @dr.imayavarambanmunuswamy808 10 місяців тому

    Many thanks Sir.

  • @IbrahimAkar
    @IbrahimAkar Рік тому

    Excellent Video - thank you. What software do you use to create your UA-cam presentations?

  • @HypnoStellar
    @HypnoStellar 7 місяців тому

    i like this video alot thanks

  • @romeobernabe6871
    @romeobernabe6871 Рік тому

    Thank you!

  • @williamschandran
    @williamschandran Рік тому

    well explained , Thanks

  • @bhushankshire2854
    @bhushankshire2854 3 місяці тому +1

    amazing. what tools do you use to make these videos??

  • @buntykumar7270
    @buntykumar7270 3 місяці тому

    This is awesome.

  • @BATMAN_1
    @BATMAN_1 2 місяці тому

    Thanks!

  • @NaterFernat
    @NaterFernat 2 дні тому +1

    So, ChatGPT is basically Akinator on steroids.

  • @tomtyiu
    @tomtyiu 10 місяців тому

    wow, now I totally understand how it works technically. Thanks

  • @renatoigmed
    @renatoigmed 10 місяців тому

    Even though I don't understand English perfectly, I managed to get a good idea of how it works. it is much more enlightening than the lazy analogy that they just say "ChatGPT talks about everything but has no awareness of what the subject is about". But imagine if there was...

  • @not_amanullah
    @not_amanullah 3 місяці тому

    Thanks ❤

  • @vikasgupta1828
    @vikasgupta1828 Рік тому

    Thanks

  • @mehediazad1780
    @mehediazad1780 Рік тому

    Sir I'm being very honest your 5 to 7 minutes video always taught more than the week of study, these visual are so helpful and also I love the fact whatever word you use you first explain the meaning behind that make's thing more easy to understand(2)

  • @OneAndOnlyMe
    @OneAndOnlyMe Рік тому +1

    Great explanation. As a computer scientist GPT is really not that mind blowing when you know that behind the scenes it's a giant data model and algorithms. It's magic to many non-computer scientists, but we can distinguish science from magic.

    • @herrbonk3635
      @herrbonk3635 Рік тому +1

      Really?? I'm a "computer scientist" of sorts myself (CPU logic designer, compiler writer) but doesn't get sh*t from this. The video does not really explain anything "technical" (despite what the title says), only hyper loose analogies that tells me nothing.

    • @OneAndOnlyMe
      @OneAndOnlyMe Рік тому

      @@herrbonk3635 As a computer programmer of 40+ years, AI is not some great mystery to me; large data models and quite simple algorithms at the core of it, combined with the computer capacity we now have. The theory has been around since the 1940s.

    • @herrbonk3635
      @herrbonk3635 Рік тому

      @@OneAndOnlyMe That wasn't the point. Neural networks are no mystery to me either. My complaint was that this guy doesn't explain anything in concrete terms.
      It was mainly other models in the 1940s and the better part of the 1900s though. More focus on recursive list processing (Lisp) and logic programming (like Prolog).

    • @OneAndOnlyMe
      @OneAndOnlyMe Рік тому

      @@herrbonk3635 I don't think the point is to explain in concrete in terms, more to just explain concepts and principles.

    • @messiisthebest
      @messiisthebest 10 місяців тому

      It is all about attention mechanism

  • @philipsun4834
    @philipsun4834 10 місяців тому +1

    to be more specific, the minute on 1:55, Token ID is the vector, instead of Token, right?
    as Token can consist of alpha-numeric value, but the vector is purely the numeric with digits only.
    that is why the vector database is coming as the storage of those vectors for searching and indexing.

  • @rajeshkumarsahu7605
    @rajeshkumarsahu7605 Рік тому +1

    Have learnt a lot from your vlogs and posts. Thanks Alex!

  • @freekyninjacat8207
    @freekyninjacat8207 Рік тому

    Ffs, exactly what I just needed! :D

  • @nithinbhandari3075
    @nithinbhandari3075 Рік тому +12

    Hi, like your video a lot. Thanks.
    Can you please create a video on computational power and cost for running GPT3?
    How many GPU are required to run one instance of GPT3?
    And How to dynamically scale server for GPT3?
    How many request per instance of GPT3 can handle request per second, request per minute, and request per hour?

  • @onlinecreations7781
    @onlinecreations7781 3 місяці тому

    Pretty same as phase of a compiler 😍🙏

  • @SantoshNair1
    @SantoshNair1 Рік тому +1

    7:00 - there is a mistake in the graphic at this mark, where the prompt should have been a finance statement/question, but instead it remains the roses poem from the previous example. Probably a copy paste error.

  • @5P4C3V01D
    @5P4C3V01D Рік тому

    Pleeasse MOREEE!

  • @Belalrazaa
    @Belalrazaa Рік тому

    thank u sir

  • @aigriffin42604
    @aigriffin42604 Місяць тому

    Could you please post something that is more up-to-date to this year thanks!❤🎉😁😊

  • @adityendrapratapsingh7999
    @adityendrapratapsingh7999 Рік тому

    @ByteByteGo what tool do you use to animate your presentations?

  • @hubstrangers3450
    @hubstrangers3450 Рік тому

    could expand how the constraints of the moderation API is developed (What type of parameters and arguments are provided on the subject of desired), thank you

  • @user-zl2iv9sq6b
    @user-zl2iv9sq6b Рік тому

    What kind of tools used in your presentation. How you did the animation?

  • @TynOng
    @TynOng Рік тому +7

    Could you cover Vector databases for LLM next time please?

  • @phil7121
    @phil7121 Рік тому +1

    Sahn is the Michael Jordan of giving ELI5 explanations of complex things