#3-Deployment Of Huggingface OpenSource LLM Models In AWS Sagemakers With Endpoints

Поділитися
Вставка
  • Опубліковано 20 гру 2024

КОМЕНТАРІ • 42

  • @krishnaik06
    @krishnaik06  7 місяців тому +4

    Check out the complete p[laylist of GenAI on AWS Cloud Playlist: ua-cam.com/video/2maPaQutcWs/v-deo.html

    • @__john663
      @__john663 7 місяців тому +1

      Hey krish bro, Is the groq completely free or there is any subscription or hidden charges?

    • @__john663
      @__john663 7 місяців тому +1

      Hi krish anna
      Can make a video using llama3 8b model with llama-index and chat engine because I need the ai is capable to document retrieval and general interactions. Is this capable to do

    • @KumR
      @KumR 7 місяців тому

      One request Krish. There is a separate playlist u added 3 months for bedrock. Could you merge those with this playlist too?

  • @intellectfactory
    @intellectfactory 6 місяців тому +15

    IMPORTANT NOTE : When you create a Domain, user profile and launch any instance, make sure you turn off/pause the instance one you are done with your work. If you don't and just close the browser, the instance will still be running and you will be charged for it if it crosses the free tier limits. I did this mistake and got billed $52 and got to know about it only when I got the bill in my email. Make sure you check the Bills page regularly to see if you are being charged for any running instance.

    • @bornclasher1294
      @bornclasher1294 4 місяці тому +1

      Great information brother. Thank you soo much

    • @viswanathhemanth
      @viswanathhemanth Місяць тому

      Yes. very important same thing happened to me as well

  • @yogeshmagar452
    @yogeshmagar452 7 місяців тому +6

    Krish Naik Respect Button❤

  • @classicemmaeasy2292
    @classicemmaeasy2292 7 місяців тому +1

    Your consistency is contagious ❤💯

  • @THEINDIANSAVIOR
    @THEINDIANSAVIOR 2 місяці тому

    It's been a great journey with your amazing lectures ❤❤. Th aka for the sincere work and helping . Sir one request
    Could you please create playlist for entire LLM. And Gen AI combined together
    So that we can easily come to know the continuity

  • @Raaj_ML
    @Raaj_ML 3 місяці тому +2

    Sorry Krish...Not sure why you were in a hurry towards the end in explaining that image_uri part...Not clear how is that different from the initial hub image deployment you were explaining..

  • @rsnoor
    @rsnoor 2 місяці тому

    Sir this is quiet useful and thanks for the step by step explanation. One kind request sir, i think you are shaking your legs continuously and that is shaking your video as well which is distracting, so please either your video even smaller if shaking legs is you mannerism sir.

  • @ne8123-g3x
    @ne8123-g3x Місяць тому

    Hi, great work!
    Can you discuss how to add concurrency and scale it up? for example for deploying a embedding model to embed 100M vectors efficiently.
    Thanks

  • @AnilKumar-im2ur
    @AnilKumar-im2ur 7 місяців тому

    Great work!, expecting your next video is to create one session to deploy LLM models using aws ec2 instance.

  • @AshishKumar-sj1ys
    @AshishKumar-sj1ys 7 місяців тому

    Your tech news video was awsome. please make another ones on regular basics 🎉

  • @torontoTamilan7
    @torontoTamilan7 7 місяців тому

    Hi Sir , I'm mainly looking for your video on Gemma 7b fine-tuning in sagemaker and deploy as endpoint , it would be highly helpful if you can create a video for this . Step by step . Thanks a lot sir , I'm one of your huge fan . Great work.

  • @SwethaSelvaraj-br6gi
    @SwethaSelvaraj-br6gi 7 місяців тому +1

    Can you make a video on serving LLM model BentoML

  • @__john663
    @__john663 7 місяців тому +1

    Hi krish anna
    Can make a video using llama3 8b model with llama-index and chat engine because I need the ai is capable to document retrieval and general interactions. Is this capable to do

  • @austinduke8876
    @austinduke8876 3 місяці тому

    Where does the model id come from?
    I looked for it on HuggingFace but I think I missed where that's listed for a given model

  • @__john663
    @__john663 7 місяців тому +1

    Hey krish bro, Is the groq completely free or there is any subscription or hidden charges?

  • @jefinprince
    @jefinprince 7 місяців тому

    Can you make a video on creating a bedrock chatbot using langchain and streamlit with multiple knowledge bases and to select a particular knowledge base with a scroll down menu.

  • @harshadapatke885
    @harshadapatke885 7 місяців тому +2

    Thanks for uploading it. One request to you- Can you please make videos on model quantization?

  • @Ishaheennabi
    @Ishaheennabi 7 місяців тому +1

    amazing sir❤

  • @viewview6687
    @viewview6687 6 місяців тому

    Krish, can you tell me what cost it was used for this video if i following as your tutorial pls ?

  • @WanderingSatty
    @WanderingSatty 6 місяців тому +1

    Best moment 16:10 :)

  • @viewview6687
    @viewview6687 6 місяців тому

    how much it cost to run code following this video Krish ?

  • @hamidraza1584
    @hamidraza1584 7 місяців тому

    How to deployment rag model on Amazon. Prepare a video for this

  • @ujjalroy1442
    @ujjalroy1442 7 місяців тому

    Awesome video thanku sir

  • @sheikhobada8305
    @sheikhobada8305 7 місяців тому +1

    Great👍

  • @HDSV10
    @HDSV10 7 місяців тому +1

    Chat Q n A with UA-cam video transcript by uploading yt link + multilingual text to speech sir make this project video

  • @123arskas
    @123arskas 7 місяців тому

    Love the videos

  • @shalabhchaturvedi6290
    @shalabhchaturvedi6290 7 місяців тому

    Respect!

  • @KrishanKumar-qk9sh
    @KrishanKumar-qk9sh 7 місяців тому

    How many users it can handle

    • @krishnaik06
      @krishnaik06  7 місяців тому

      You cN set it to auto scalable

  • @rishiraj2548
    @rishiraj2548 7 місяців тому

    👍💯🙏

  • @debjeetmukherjee4591
    @debjeetmukherjee4591 2 місяці тому

    Is it free
    ..

  • @mohitnemade5320
    @mohitnemade5320 2 місяці тому

    Kindly requested please remove subtitle in the video, its getting irritate to watch

  • @AshishKumar-sj1ys
    @AshishKumar-sj1ys 7 місяців тому

    Where is the first video krish not able to find it 🥲