Llama 3.2 Fine Tuning for Dummies (with 16k, 32k,... Context)

Поділитися
Вставка
  • Опубліковано 2 гру 2024

КОМЕНТАРІ • 19

  • @Harshal378
    @Harshal378 Місяць тому

    what an evolved version of 2010 notepad instruction. Loved it.

  • @lucasa8710
    @lucasa8710 2 місяці тому

    I like the style of this video, dam!! Nice job

  • @pmo1972
    @pmo1972 2 місяці тому

    Awesome. Easy to follow. Ty

  • @ChatGPT-ef6sr
    @ChatGPT-ef6sr 2 місяці тому +1

    Please show us how to make embeddings based on vertex ai and how to deploy anything as an web app or android app from vertex. Thank you so much for the wonderful content.

    • @nodematic
      @nodematic  2 місяці тому +1

      Thanks for the suggestion - we'll add that to our video plans.

    • @xXWillyxWonkaXx
      @xXWillyxWonkaXx 2 місяці тому +1

      Agree. That would be a great piece of content to watch.

    • @ChatGPT-ef6sr
      @ChatGPT-ef6sr 2 місяці тому

      @@nodematic Thanks!

    • @ChatGPT-ef6sr
      @ChatGPT-ef6sr 2 місяці тому

      @@xXWillyxWonkaXx yup

  • @igorcastilhos
    @igorcastilhos 26 днів тому

    I have a folder with many PDF's and I would like to fine tune a model to summarize these PDF's and respond to questions in my website. Is there a way to do that using the example of this video?

    • @abdulsami5843
      @abdulsami5843 9 днів тому +1

      you would first have to figure out the parsing logic to correctly extract the text and then put it in a summarizer, if all you want is a summary then there are many good models available on hugging face that you can use directly OR just get a gemini api key and use gemini for it, it should do a decent job at it.

    • @igorcastilhos
      @igorcastilhos 9 днів тому

      @ thank you

    • @abdulsami5843
      @abdulsami5843 9 днів тому

      @@igorcastilhos also if you want to use the PDFs as context to answer questions then you probably need to parse and then put them into a vector store so that they can be retrieved when needed, this is called RAG

    • @igorcastilhos
      @igorcastilhos 9 днів тому

      @@abdulsami5843 I'm using Ollama with the Web UI tool. Inside it, I'm sending to the Knowledge collection some PDFs of resolutions of attorneys, so that they can ask about them whenever they want. The main reason to use Ollama (llama3.2) instead of OpenAI API is that it is free. But I'm having problems accessing the Web UI localhost:3000 from our server in my machine, it doesn't show the models installed in the server machine.

    • @igorcastilhos
      @igorcastilhos 9 днів тому

      @@abdulsami5843 Also, the RAG feature doesn't have a very nice documentation. In my case, we have a distributed folder in microsoft windows (Like C:/) and inside that folder, the attorneys and advocates will send new PDFs through the website, and I wanted to use RAG for it, but it is very hard.

  • @diogomartins9987
    @diogomartins9987 2 місяці тому

    Will this software building studio ever be available for public use?

    • @nodematic
      @nodematic  2 місяці тому

      Yes, it's available now at softwaresim.com/pricing/

  • @jonatasnascimento6584
    @jonatasnascimento6584 Місяць тому

    Hello, I'm from Brazil. I'm new to AI. I would like to build an artificial intelligence to automate university work, as I have a lot of work and I can't keep up with it. I want an AI that can write papers like me using my texts. What adjustments or training should I do? Do I need to change a parameter?

    • @jonatasnascimento6584
      @jonatasnascimento6584 Місяць тому

      In my mind I'm trying to use about 10 review texts of my articles. And 1 expanded summary. I want the AI to write like me without AI plagiarism detection.

  • @tăng-phú-quý.lê
    @tăng-phú-quý.lê Місяць тому

    very nice