How To Use Meta Llama3 With Huggingface And Ollama

Поділитися
Вставка
  • Опубліковано 4 жов 2024

КОМЕНТАРІ • 64

  • @sanadasaradha8638
    @sanadasaradha8638 5 місяців тому +28

    Instead of showing all new models it is better to implement a single open source llm for all use cases including fine tuning. At the same time it is better to make an end to end project with opensource llm.

    • @THOSHI-cn6hg
      @THOSHI-cn6hg 5 місяців тому

      Agreed

    • @devagarwal3250
      @devagarwal3250 5 місяців тому +7

      There are already same video about showing new model.
      It is better to make a video on how to implement it

    • @KumR
      @KumR 5 місяців тому +2

      I am with you. New models will keep coming. Focus needs to be on an end to end project

    • @Shubhampalzy
      @Shubhampalzy 4 місяці тому +1

      how to fine tune ?
      I need some help to build a custom chatbot trained on custom dataset using llama 3.
      Please help

    • @farajacod3717
      @farajacod3717 3 місяці тому

      @@Shubhampalzy did you find a way to finetune llam3?

  • @r21061991
    @r21061991 5 місяців тому +1

    Hey Krish, It will be more helpful if you can take a session on how to use an offline LLM on a custom dataset for QnA

  • @saharyarmohammadtoosky
    @saharyarmohammadtoosky 3 місяці тому +1

    Hi Krish, thank you for great knowledge you are sharing, I want to run ollama on aws sagemaker, do you know or have any video regarding doing that, I already saw your video to install and work locally, I do not know how to do on the cloud.

  • @viratsasikishorevarma3535
    @viratsasikishorevarma3535 5 місяців тому +1

    Hi Krish sir I need a help, please make a video on this basic topic: how ,why to setup virtual environment for python.❤

  • @happyhours.0214
    @happyhours.0214 5 місяців тому +3

    Sir, please make a llm video on how to train llm models on custom data.

  • @rumingliu9787
    @rumingliu9787 5 місяців тому +1

    Thanks sir. Very helpful. Just one question, what's the benefit of Ollama compared with hugging face? I guess it is Local deployed but has some basic requirements for your laptop's hardware.

  • @girishkumar862
    @girishkumar862 5 місяців тому +3

    Hi, there will be 10 billion models coming in future and so on..

  • @nitinjain4519
    @nitinjain4519 5 місяців тому +1

    When using the Llama3 model, sometimes it gives me an incomplete answer. What can I do to avoid incompleteness when generating responses from the Serverless Inference API?

  • @KunalDixitEdukraft
    @KunalDixitEdukraft 5 місяців тому

    Hi Krish,
    Firstly, thanks to your consistent efforts to keep us updated and learn the latest techs in the realm of Data Science.
    How can I sponsor you on Git Hub and earn a badge?

  • @ParthivShah
    @ParthivShah Місяць тому

    Thank You for this video, krish sir.

  • @mhemanthkmr
    @mhemanthkmr 5 місяців тому +1

    Hii Krish I too tried the llama3 in ollama response is slow but in your machine the response is fast you are using GPU then what GPU you using ?

    • @shotbotop3790
      @shotbotop3790 5 місяців тому

      He has a Titan RTX (around 64gp vram) 💀

  • @janneskleinau6332
    @janneskleinau6332 5 місяців тому

    Please make a Video on how to finetune LLaMA! I would appreciate it :) Love your videos btw

  • @KumR
    @KumR 5 місяців тому

    New models will keep mushrooming every day. I think now videos should focus on more end to end projects using these models. Not just sentiment analysis or language translation or text summarization. Some real life project end to end.

  • @theyoungitscholar4127
    @theyoungitscholar4127 Місяць тому

    Is there a way I can use int8 (select specific quantization) for llama3.1 using ollama

  • @vysaivicky4724
    @vysaivicky4724 5 місяців тому

    Sir one doubt how much knowledge of dsa is required in data scientist field please clarify

  • @siddhanthbhattacharyya4206
    @siddhanthbhattacharyya4206 5 місяців тому

    Krish i wanted to know what would be the pre requisites to follow your langchain series? How much knowledge do i need?

  • @kavururajesh1760
    @kavururajesh1760 5 місяців тому

    Hi Krish can you please upload a video on Moirai for Time Series LLM Model

  • @nishant9847
    @nishant9847 2 місяці тому

    where will those downloaded model files get saved?

  • @vamsitharunkumarsunku4583
    @vamsitharunkumarsunku4583 4 місяці тому

    How to download llama3 model in local from NVIDIA NIMS? kindly make a video on it please. Thank you

  • @cairo8905
    @cairo8905 5 місяців тому

    Hi
    I have a voice model on Google drive
    but I don't know how to upload it on huggingface
    can you tell me how to upload it?
    or giving you the model link and you upload it if you don't mind 😁

  • @asadurrehman3591
    @asadurrehman3591 4 місяці тому

    sir plzzzzzzzz tell me about this error.
    RuntimeError: "triu_tril_cuda_template" not implemented for 'BFloat16'

  • @JorgeLopez-gw9xc
    @JorgeLopez-gw9xc 5 місяців тому

    I have ollama on my computer and I am currently using it to run AI models through Python. I need to correct complex instructions that I can only run with the 70B model, the problem is that due to its complexity it takes a long time to execute (2 minutes), how can I lower the times? Currently the model runs on the CPU, how can I configure ollama to use the GPU?

  • @hse13166
    @hse13166 5 місяців тому

    do we really need ollama to run llama3. when we are able to download/ clone the entire model from HF, do we still need Ollama for running the model? What is the next step after you download the model from HF? how to use it in the Langchain code without Ollama? is that possible?

  • @dhaneshv-tz7qc
    @dhaneshv-tz7qc 3 місяці тому

    can u make video for llama 3 fine-tuning and API creation

  • @herashak
    @herashak 5 місяців тому

    When doing Question answering I got an error about logits and LlamaForCausalLM not being compatible, not sure how you got that to work as you said

  • @JourneyWithMystics
    @JourneyWithMystics 4 місяці тому

    Bhaiya how do I convert Hindi video into Hindi text, please 🙏 reply much needed ❤

  • @itzmeakash9695
    @itzmeakash9695 5 місяців тому

    Hello sir, I have a doubt. Is there any platform to find the latest research papers to read? Also, how can I stay updated about the latest developments in the fields of general AI and AI?

  • @podunkman2709
    @podunkman2709 4 місяці тому

    Take look at this demo:
    >>> How many liters of water per minute can a Dutch windmill pump out?
    That's an interesting question!
    The answer depends on the specific design and size of the windmill. However, I can give you some general
    information.
    Traditionally, Dutch windmills are designed to pump water from shallow sources, such as polders or wells, for
    irrigation purposes. The capacity of these windmills varies greatly, but a typical small to medium-sized windmill
    might be able to pump around 0.5 to 2 liters per minute (L/min).
    Some larger industrial-scale windpumps can pump much more, up to 10-20 L/min or even more, depending on the
    turbine design and the pressure head of the water.
    Really? What a sh****

  • @OmSingh-ng3np
    @OmSingh-ng3np 5 місяців тому +1

    This can be fined tune in the same way right?

    • @Shubhampalzy
      @Shubhampalzy 4 місяці тому

      how to fine tune ?
      I need some help to build a custom chatbot trained on custom dataset using llama 3.
      Please help

  • @claudiograssi5192
    @claudiograssi5192 5 місяців тому

    to run locally which gpu do you use?

  • @anaghacasaba9351
    @anaghacasaba9351 4 місяці тому

    How can we fine tune llama 3 with a pdf?

  • @tejas4054
    @tejas4054 5 місяців тому

    Ye kaam.chatgpt bhi krta hai to ye kyu use kre hum. Llama

  • @ChemFam.
    @ChemFam. 5 місяців тому

    Sir how and from where we will get the api key

  • @rajsharma-bd3sl
    @rajsharma-bd3sl 4 місяці тому

    Dude, don't just copy from hugging face and make a video... try to implement these models on some problem like NER

  • @kshitijnishant4968
    @kshitijnishant4968 5 місяців тому

    my command prompt is raising error saying Ollama not found? any help guys?

    • @krishnaik06
      @krishnaik06  5 місяців тому

      U need to download and install it

  • @0f9yxtizitdl
    @0f9yxtizitdl 5 місяців тому

    Liked your new look, Mr clean.

  • @spiritualworld842
    @spiritualworld842 5 місяців тому

    Sir I'm totally stuck between data field and software field plzz suggest me to overcame from depression 😢😪

    • @tejas4054
      @tejas4054 5 місяців тому

      Best way don't see youtube its too much overloaded ,,,,,with so much go back to time travel use books read books programming and use pen paper this overload information on youtube is dangerous

  • @tarunmohapatra5734
    @tarunmohapatra5734 5 місяців тому

    Sir please activate neurolab

  • @danielfischer4079
    @danielfischer4079 5 місяців тому

    Ollama is downloading really slow for me, any1 else?

  • @Superteastain
    @Superteastain 5 місяців тому

    This guys good.

  • @tejas4054
    @tejas4054 5 місяців тому

    Pair kyu hilaate ho bhai video me

  • @deepak4166
    @deepak4166 5 місяців тому

    What's app meta ai is awesome 🎉

  • @itxmeJunaid
    @itxmeJunaid 5 місяців тому

    😮

  • @rishiraj2548
    @rishiraj2548 5 місяців тому

    🙏🙂

  • @mohsenghafari7652
    @mohsenghafari7652 5 місяців тому

    tanks krish .
    please answer my email ❤

  • @AnkitVerma-62990
    @AnkitVerma-62990 5 місяців тому

    First Comment 😅