How to Fine-Tune and Train LLMs With Your Own Data EASILY and FAST- GPT-LLM-Trainer

Поділитися
Вставка
  • Опубліковано 23 січ 2025

КОМЕНТАРІ • 58

  • @intheworldofai
    @intheworldofai  Рік тому +6

    💓Thank you so much for watching guys! I would highly appreciate it if you subscribe (turn on notifcation bell), like, and comment what else you want to see! Love y'all and have an amazing day fellas.☕ To help and Support me, Buy a Coffee or Donate to Support the Channel: ko-fi.com/worldofai - Thank you so much guys! Love yall
    🧠 Follow me on Twitter: twitter.com/intheworldofai
    🔥 Become a Patron: patreon.com/WorldofAi

  • @stresstherapist
    @stresstherapist Рік тому +15

    It's insane that we have now reached a stage where the regular joe blogs can finetune their own LLM. We got t the is stage so blindingly fast.

  • @intheworldofai
    @intheworldofai  Рік тому +3

    [Must Watch]:
    Insane Ai News of the Week: GPT-5 is Official - ua-cam.com/video/7F4iza1yrkI/v-deo.html
    How To Install UNCENSORED Llama 2 Locally - ua-cam.com/video/RpGXhpeH668/v-deo.html
    ToolLLM: Writes API Calls BETTER Than ChatGPT 4 - ua-cam.com/video/N4R5BBb0o9g/v-deo.html

  • @FushigiMigi
    @FushigiMigi 5 місяців тому +1

    looks awesome. Its over my head.

    • @JesseBurnett-e5p
      @JesseBurnett-e5p 4 місяці тому

      It's probably not. You just have to have passion to do it. Give it a shot.

  • @vitalis
    @vitalis Рік тому +9

    is there a way to use book epub/pdfs to train llms?

    • @AbhishekKumar-mk2li
      @AbhishekKumar-mk2li 10 місяців тому

      Yes you can use pdf as source of knowledge and load using document loader and using vector embedded store in vector database and can now query the question search the answer from the database

  • @shubham6995
    @shubham6995 Рік тому +4

    Hey, can i train a Chatgpt on my writing contents to create blog post using my writing style And if yes, how should i do it?

  • @cngblade
    @cngblade Рік тому +1

    why do i get "The model `gpt-3.5` does not exist"

  • @intheworldofai
    @intheworldofai  Місяць тому

    Join the World of AI Discord! : discord.gg/NPf8FCn4cD

  • @r.sourabhyadav7650
    @r.sourabhyadav7650 Місяць тому

    can someone help me if i have data and i dont want to create dataset for training.

  • @VastIllumination
    @VastIllumination Рік тому

    This is exactly what I was looking for, awesome! Love the pace and clarity of the voice over. Keeps getting better.

  • @XuanGOD
    @XuanGOD Рік тому +2

    I don't have api, can i create my own data set and upload it to train LLM instead of running gpt4

    • @rmt3589
      @rmt3589 4 місяці тому +1

      If you're fine with GPT-3, then GPT-J is a better alternative. Download that, and train it locally.

  • @mastamindchaan387
    @mastamindchaan387 Рік тому +4

    Each tutorial only shows how to train prompts.
    I would like to know how I could train my own PDFs.

    • @andrewjcooke
      @andrewjcooke Рік тому +4

      I agree i'd be nice if you could dump PDFs into one

    • @rtdev8512
      @rtdev8512 Місяць тому +1

      you mean train pdf? then, RAG is what you re looking for

  • @BoraA-1-1
    @BoraA-1-1 2 місяці тому

    beats are insane ma g

  • @intheworldofai
    @intheworldofai  Рік тому +1

    HUGE ChatGPT Update! Fine-tune GPT 3.5 Model! - ua-cam.com/video/GYZQbSzrE2A/v-deo.html

  • @jnabmazhar
    @jnabmazhar 8 місяців тому +1

    very nice and informative video. I need a help here, can you please suggest me step-by-step that to train a Medical related data, what I will have to do to train it using GPT 4 LLM model. Thank you

  • @gavinLovesMetallica
    @gavinLovesMetallica Рік тому

    Thank you! More power to you!

  • @intheworldofai
    @intheworldofai  Рік тому

    LlamaGPT: Access Uncensored LLAMA 2 - Self-Hosted, Offline, Private, and FREE! (Install Tutorial) - ua-cam.com/video/NZFpEEpg1u4/v-deo.html

  • @intheworldofai
    @intheworldofai  Рік тому

    EASIEST Method To Fine-Tune and Train Large Language Models! (Llama Factory) - ua-cam.com/video/nmIG8bJ38FQ/v-deo.html

  • @d.m4569
    @d.m4569 3 місяці тому

    Are we not supposed to use ai generated datasets for machine learning? Im new to this

  • @intheworldofai
    @intheworldofai  Рік тому

    How to Fine-Tune and Train LLMs With Your Own Data EASILY and FAST With AutoTrain ua-cam.com/video/fj7X7i1b858/v-deo.html

  • @SinchanMallick-z8h
    @SinchanMallick-z8h 2 місяці тому

    Do i need to write my own code?

  • @nishantnishant6475
    @nishantnishant6475 7 місяців тому

    “Introduction to GenAI and Simple LLM Inference on CPU and finetuning of LLM Model to create a Custom Chatbot” - This project is assigned to me , i am quite confused Can anyone help me ?

  • @intheworldofai
    @intheworldofai  Рік тому

    How to Fine-Tune and Train LLMs With Your Own Data EASILY and FAST! No Code! ua-cam.com/video/TOZDyPRdg1Y/v-deo.html

  • @prateekkumar-u5h
    @prateekkumar-u5h 7 місяців тому

    If I have a csv file to create a custom LLM, can I add the .csv path to dataset-name

  • @HongAnhLuong-e4q
    @HongAnhLuong-e4q 3 місяці тому

    Hi, Can I ask you if I want to finetune a model to extract meaningful data and structure it into dataframe, is it possible to use your method?

  • @wammaknowremixswat987
    @wammaknowremixswat987 Рік тому +1

    Love the video

  • @intheworldofai
    @intheworldofai  Рік тому

    How to Install TextGen WebUI - Install ANY LLMs IN Minutes Locally! (Oobabooga) - ua-cam.com/video/efoJ9GUOymY/v-deo.htmlsi=HTZHMNvfVtdGizsj

  • @particularindividual-cf5jn
    @particularindividual-cf5jn Рік тому

    Why not use text generation webui? Easier, more customizability and it's free right? Or am I wrong?

  • @pradeepkandasamy8687
    @pradeepkandasamy8687 Рік тому

    Whats that dataset part...will it be on hughing face too?

  • @alexeilevinzon2916
    @alexeilevinzon2916 Рік тому

    Great as always! thank you :)

    • @intheworldofai
      @intheworldofai  Рік тому

      Thanks so much! Appreciate it a lot. Have a great day.

  • @intheworldofai
    @intheworldofai  Рік тому

    CREATE and SELL Ai Models WIth A Single Prompt - $500/Month (Installation Tutorial) ua-cam.com/video/XZjN4HRwqEk/v-deo.html

  • @tonyd7644
    @tonyd7644 11 місяців тому

    Hi @WorldofAI Would the GPT-LLM-Trainer be ideal for this use case: Fine tuning an LLM to write in a certain style? For example, "blue widget repair" websites have a certain style of writing. I would also like it to adhere to some specific grammar instructions (e.g., "write in active voice"). Thanks!

  • @Malins2000
    @Malins2000 Рік тому +20

    you could consider hiding your Open-ai-key ;)

  • @octavianduma252
    @octavianduma252 Рік тому

    I am trying to use your tutorial to train a local model running in LM-Studio on server mode is that possible? I downloaded your notebook for llama 2 and opened in on jupyter notebook. Is that a use case that should work?

  • @intheworldofai
    @intheworldofai  Рік тому

    NEW Falcon 180B: The New Open-Source LLM King! (Installation Tutorial) - ua-cam.com/video/f5mXGFrTwZ8/v-deo.html

  • @kiranbhairava2586
    @kiranbhairava2586 Рік тому

    Does the free openAI api works?

  • @intheworldofai
    @intheworldofai  Рік тому

    GodMode: AI Chat Browser - Chat With Multiple LLMs Simultaneously - (Installation Tutorial) ua-cam.com/video/uN81iT2ieiY/v-deo.html

  • @Leonardo_A1
    @Leonardo_A1 Рік тому

    Hi, great video thanks. Do I need a new PC or is it better to use vrtual PC in the Web? And if PC is needed, which good configuration is needed (sorry for that :-) CU Leonardo from germany

  • @intheworldofai
    @intheworldofai  Рік тому

    OpenGPTs: Opensource Alternative to OpenAI's GPT Builder! - ua-cam.com/video/UHg36m7SRHk/v-deo.html

  • @intheworldofai
    @intheworldofai  Рік тому

    OpenCopilot: FREE Opensource Ai Copilot For The Web Powered By ChatGPT (Installation Tutorial) ua-cam.com/video/TuS5A9Emjww/v-deo.html

  • @shivamkumar-qp1jm
    @shivamkumar-qp1jm Рік тому

    You rocked this is a great content for LLM Trainer

  • @MarkFerenciSongs
    @MarkFerenciSongs Рік тому +1

    Cute cats

  • @emmanuelgarcia5451
    @emmanuelgarcia5451 Рік тому

    ¿Crees que podemos pasar la formación a través de un pdf con la información cargada? Es bastante caro estar ejecutando el programa todo el tiempo y cuando lo ejecuto, ¿qué tienes que hacer ya que no se muestra en el video

  • @matthiashj
    @matthiashj Рік тому

    Big thanks for your video but, it doesn't work at "Load Datasets and Train" cause of "model = AutoModelForCausalLM.from_pretrained" highlighted in red

  • @intheworldofai
    @intheworldofai  Рік тому

    How to Create Ai Chatbots EASILY With ONE PROMPT! TextBase - (Installation Tutorial) - ua-cam.com/video/GZEPe6raKLM/v-deo.html