Groq-LPU™ Inference Engine Better Than OpenAI Chatgpt And Nvidia

Поділитися
Вставка
  • Опубліковано 27 гру 2024

КОМЕНТАРІ • 59

  • @krishnaik06
    @krishnaik06  8 місяців тому +15

    Probably the most important video for anyone who are preparing for Genertaive AI :)

  • @utkarshkapil
    @utkarshkapil 8 місяців тому +3

    I wish I could give you a 1000 likes.
    Thanks for making these videos!

  • @AravindBadiger
    @AravindBadiger 8 місяців тому +13

    NSA is already ahead of the race. They are invisible and invincible. 😊

    • @AravindBadiger
      @AravindBadiger 8 місяців тому +1

      "Sentient World Simulation and NSA Surveillance - Exploiting Privacy to Predict the Future?" Google this and please read this article. 🤯

    • @Thinesh_Kumar
      @Thinesh_Kumar 8 місяців тому +1

      What does NSA means here ? Can you give the full form of it

    • @CyberEnigma
      @CyberEnigma 8 місяців тому +1

      @@Thinesh_Kumar I guess he’s talking about the National Security Agency? An intelligence arm of the US government

    • @Thinesh_Kumar
      @Thinesh_Kumar 8 місяців тому +1

      @@CyberEnigma yep, I too tried to checking through internet and chatbots. No relatable answers to that.

    • @AravindBadiger
      @AravindBadiger 8 місяців тому

      @thineshkumar5068 @CyberEnigma Google this "Sentient World Simulation and NSA Surveillance - Exploiting Privacy to Predict the Future?"

  • @vishnuannavarapu3888
    @vishnuannavarapu3888 8 місяців тому +3

    Always no words to explain your content ✨️ 😌 it's amazing

  • @badrinarayanans355
    @badrinarayanans355 8 місяців тому

    Amazing Krish. Thankyou for sharing about GROQ. Came to know the importance of inferencing. Hope you will be uploading projects using GROQ inference engine soon 😊.

  • @ankitpersie1
    @ankitpersie1 8 місяців тому +3

    hi @krishnaik sir, this is a personal feedback .Have been following your videos and your amazing way of explaining things.
    Based on the same enrolled in one of the courses(generative AI) in ineuron.Though the topics covered are great, you definitely need to have a look at the articulation skills of the instructor.The quality is shockingly low and same is visible in the freecodecamp video as well.They are just throwing around some words while explaining key concepts and that too not very clearly.
    You are such a great teacher with extraordinary knowledge and we all believe in your brand but you should look into this as this was not a great experience.

  • @shalabhchaturvedi6290
    @shalabhchaturvedi6290 8 місяців тому +2

    Krish ! Your videos are amazing and I learned a lot about Langchain the most from your videos. Thank you!

  • @dhanashrikolekar-j7e
    @dhanashrikolekar-j7e 8 місяців тому +3

    Thank you Krish sir ! Your videos are amazing ...

  • @bikrampani5308
    @bikrampani5308 8 місяців тому +2

    one like from me for choosing such amazing topics.. waiting eagerly for ur next video on this with code for me to try on👍

  • @twinklepardeshi3113
    @twinklepardeshi3113 8 місяців тому +3

    Amazing video thanks Krish Sir

  • @BharathPARUL
    @BharathPARUL 8 місяців тому +3

    We are waiting for that video.. as a beginner we need that video a lot..

  • @akashvishwakarma6588
    @akashvishwakarma6588 8 місяців тому +3

    really amazing thanks for sharing 😇😇

  • @robinchriqui2407
    @robinchriqui2407 8 місяців тому +2

    Hi Krish, thank you for your work. Could you make a video for fine tuning of a multimodal model for example for medical?

  • @deepak_kori
    @deepak_kori 8 місяців тому +2

    Need end to end project sir❤

  • @SantK1208
    @SantK1208 8 місяців тому +1

    Hello Sir , thanks for this video ❤❤
    Kindly also teach us on llamaparse, qdrant, nomic embeddings etc for RAG system

  • @CodeWithHimanshu
    @CodeWithHimanshu 8 місяців тому

    i give you 1000000 likes sir, Thank you so much for such a amazing videos.

  • @raghavsharma6430
    @raghavsharma6430 8 місяців тому +3

    Thanks for sharing 😊😊

  • @HariKrishna-yl8yi
    @HariKrishna-yl8yi 8 місяців тому +3

    Thank you sir for sharing this video ❤❤

  • @manaskulkarni2075
    @manaskulkarni2075 4 місяці тому

    Amazing explanation Sir!!

  • @seemanshushukla4990
    @seemanshushukla4990 8 місяців тому +2

    Sir, I feel olama was trying to achieve the same thing in terms of Inferencing time. It would be amazing to watch the real time Inferencing comparison b/w olama and Groq-LPU on top a open LLM model(s)

  • @nishantchoudhary3245
    @nishantchoudhary3245 8 місяців тому +3

    Keep it up sir

  • @Arun-zn9vd
    @Arun-zn9vd 8 місяців тому +2

    Many companies prefer not to utilize third-party APIs due to concerns about potential data leakage. I tried using Replicate API to use Llama2, but they rejected the proposal for this reason.

  • @mahtabsoin7239
    @mahtabsoin7239 4 місяці тому

    Excellent video, Krish, I'd love to have access to the project that you mentioned. Please let me know if it's already available somewhere.

  • @Ishaheennabi
    @Ishaheennabi 8 місяців тому +2

    how high school students can land internship or job in generative ai or ai in whole

  • @yatinkundra1839
    @yatinkundra1839 8 місяців тому

    amazing !! eagerly waiting for the project

  • @BharathPARUL
    @BharathPARUL 8 місяців тому +5

    Sir you said that next video will be AI engineer roadmap and with resources...

  • @deadpoolzk
    @deadpoolzk 8 місяців тому +2

    bro what about grok model in the race of llm

  • @kingki1953
    @kingki1953 8 місяців тому

    But, is it P NP problem? Because the time complexity?

  • @sweela1
    @sweela1 5 місяців тому

    Amazing work !!!

  • @poshaboinapavansai8487
    @poshaboinapavansai8487 8 місяців тому +1

    Which gonna make fast in these too
    1. ERA 1BIT
    2.Or this grow

  • @cindydao2598
    @cindydao2598 8 місяців тому +1

    Hi Krish, can we use this technology to train the llm also?

  • @gomkar8181
    @gomkar8181 8 місяців тому +3

    Welcome

  • @PawanMusing
    @PawanMusing 7 місяців тому

    Gamechanger in the realm of GenAI

  • @SantK1208
    @SantK1208 8 місяців тому +2

    You are 🔥

  • @sambamurthykaki8467
    @sambamurthykaki8467 8 місяців тому +2

    hello sir I am SAMBA MURTHY a MECHANICAL ENGINEER GRADUATE in passed out in 2019 have nearly 5 years of career gap (prepared for gate and some family health issues) and my job in past is not at all related to DATA SCIENCE. Now I have completed GOOGLE DATA ANALYTICS PROFESSIONAL CERTIFICATE PROGRAM in coursera. and also I have completed your recently upload ROAD MAP TO BECOME A DATA ANALYST IN 2024. SO Please Help me how to build the RESUME WITH RESPECT TO THE CAREER GAP OF 5 YEARS and HOW TO TO CRACK THE INTERVIEW WITH 5 YEARS CAREER GAP please PLEASE 🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻

  • @ThamizhSelvanselvamani
    @ThamizhSelvanselvamani 8 місяців тому

    please upload end to end project of this topic sir

  • @anangrajsinghtomar3279
    @anangrajsinghtomar3279 8 місяців тому

    Really helpful video. Would love to see the code.

  • @pankhaniyamanav9637
    @pankhaniyamanav9637 8 місяців тому +4

    🔥

  • @cmarquay
    @cmarquay 8 місяців тому

    Why aren't you trying Mistral?

  • @tahiraiwhiz
    @tahiraiwhiz 8 місяців тому +1

    The comparision is not fair vs GPT3.5/4
    Gamma7B has 7 Billion parameters.
    GPT3.5/4 has more than 1 trillion parameters.

    • @krishnaik06
      @krishnaik06  8 місяців тому

      Here the comparison is for inference not best llm

    • @tahiraiwhiz
      @tahiraiwhiz 8 місяців тому +1

      Krish - I like the video and agree with you however my point is that larger Language model like GPT4 will have slower inference time than a model like Gamma-7B.
      The actual comparison would be to host Gamma-7B on some other platform and compare time with Groq.

    • @supritblackhawk
      @supritblackhawk 3 місяці тому

      Parameter size doesn't just affect the "quality" of the model but also the inference time for output tokens. This is not an apples to apples comparison and it is weird to see a teacher make such statements with confidence.

  • @lenovox1carbon664
    @lenovox1carbon664 8 місяців тому +3

    People who disliked are those who bought shares in nvidia 😂😂

  • @MARKXHWANG
    @MARKXHWANG 8 місяців тому

    if you know they used 700 chip to demo this what would you think? show a 1 chip by chip comparison okay?

    • @MARKXHWANG
      @MARKXHWANG 8 місяців тому

      groq has 64Mm of memoery per chip. does that surpise you?

  • @ravindarmadishetty736
    @ravindarmadishetty736 3 місяці тому

    Superb

  • @GhostCoder83
    @GhostCoder83 8 місяців тому +2

    Groq is fast

  • @MARKXHWANG
    @MARKXHWANG 8 місяців тому

    I am sure 64 mb of memory make it great