Ingenium Academy
Ingenium Academy
  • 203
  • 57 331

Відео

Quantizing Models from Hugging Face Using BitsnBytes | Quantization | Ingenium Academy
Переглядів 307 годин тому
We show you how to load in a model from hugging face and quantize it to 16 & 8-bit precision.
4 bit Quantization Example Packing & Unpacking | Quantization | Ingenium Academy
Переглядів 147 годин тому
We walk you through how to quantize an array of numbers from 32-bit to 4-bit using a packing algorithm.
How To Quantize To 2 & 4 Bits | Quantization | Ingenium Academy
Переглядів 157 годин тому
We show you from a high-level how packing algorithms work and how we can use them to quantize a tensor to 2 or 4 bits.
Inference With Quantized Weights | Quantization | Ingenium Academy
Переглядів 217 годин тому
We discuss how to perform inference with a quantized weight matrix.
Quantization Per Group | Quantization | Ingenium Academy
Переглядів 79 годин тому
We discuss how to extend the granularity of our quantization algorithm past quantizing per channel to quantizing per group.
Quantization Per Channel | Quantization | Ingenium Academy
Переглядів 319 годин тому
We show you how to increase the granularity of your quantization algorithm with per channel quantization.
Symmetric Quantization Implementation | Quantization | Ingenium Academy
Переглядів 189 годин тому
We show you how to implement symmetric quantization in code.
Understanding Symmetric Quantization | Quantization | Ingenium Academy
Переглядів 149 годин тому
We explain what symmetric quantization is and how it differs from asymmetric quantization.
Quantizing and Dequantizing PyTorch Tensors | Quantization | Ingenium Academy
Переглядів 139 годин тому
We show you how to write the code to quantize and dequantize tensors in PyTorch.
Understanding Linear Quantization | Quantization | Ingenium Academy
Переглядів 99 годин тому
We explain what the goal of linear quantization is with the intent for you to develop an intuitive understanding of the algorithm.
Linear Quantization Formula | Quantization | Ingenium Academy
Переглядів 99 годин тому
We walk through the formula for linear quantization and show how the scale and zero point are derived.
How to Quantize An Array of Numbers | Quantization | Ingenium Academy
Переглядів 319 годин тому
We show you how to quantize an array of values by hand on the whiteboard.
Data Types and Precision in PyTorch | Quantization | Ingenium Academy
Переглядів 189 годин тому
We discuss the different types of precision to represent model parameters in and which of these are available to us in PyTorch.
What Is Quantization | Quantization | Ingenium Academy
Переглядів 209 годин тому
We explain to you what quantization is from a high-level and why it matters.
Building Custom Tools in LangGraph | LangGraph | Ingenium Academy
Переглядів 8973 місяці тому
Building Custom Tools in LangGraph | LangGraph | Ingenium Academy
Creating Agent State in LangGraph | LangGraph | Ingenium Academy
Переглядів 3593 місяці тому
Creating Agent State in LangGraph | LangGraph | Ingenium Academy
Drafting Our First Agent in LangGraph | LangGraph | Ingenium Academy
Переглядів 3263 місяці тому
Drafting Our First Agent in LangGraph | LangGraph | Ingenium Academy
What is LangGraph? | LangGraph | Ingenium Academy
Переглядів 1,9 тис.3 місяці тому
What is LangGraph? | LangGraph | Ingenium Academy
Fitting a Decision Tree Classifier | Machine Learning | Ingenium Academy
Переглядів 475 місяців тому
Fitting a Decision Tree Classifier | Machine Learning | Ingenium Academy
Decision Trees | Machine Learning | Ingenium Academy
Переглядів 185 місяців тому
Decision Trees | Machine Learning | Ingenium Academy
Precision, Recall, & F1 Score | Machine Learning | Ingenium Academy
Переглядів 365 місяців тому
Precision, Recall, & F1 Score | Machine Learning | Ingenium Academy
Fitting Logistic Regression Model | Machine Learning | Ingenium Academy
Переглядів 265 місяців тому
Fitting Logistic Regression Model | Machine Learning | Ingenium Academy
Classification Dataset Overview | Machine Learning | Ingenium Academy
Переглядів 155 місяців тому
Classification Dataset Overview | Machine Learning | Ingenium Academy
Logistic Regression | Machine Learning | Ingenium Academy
Переглядів 115 місяців тому
Logistic Regression | Machine Learning | Ingenium Academy
Intro to Classification | Machine Learning | Ingenium Academy
Переглядів 105 місяців тому
Intro to Classification | Machine Learning | Ingenium Academy
Fitting Multiple Regression Model | Machine Learning | Ingenium Academy
Переглядів 225 місяців тому
Fitting Multiple Regression Model | Machine Learning | Ingenium Academy
Fitting Simple Linear Regression Model | Machine Learning | Ingenium Academy
Переглядів 305 місяців тому
Fitting Simple Linear Regression Model | Machine Learning | Ingenium Academy
Exploring Our Dataset | Machine Learning | Ingenium Academy
Переглядів 295 місяців тому
Exploring Our Dataset | Machine Learning | Ingenium Academy
What is Regression? | Machine Learning | Ingenium Academy
Переглядів 105 місяців тому
What is Regression? | Machine Learning | Ingenium Academy

КОМЕНТАРІ

  • @AnsarMazhar-g6o
    @AnsarMazhar-g6o 11 днів тому

    Name the book from which you took this determinant and linear independence relation

  • @Unknownfor13
    @Unknownfor13 Місяць тому

    Very helpful ma mannnn <3

  • @vootanical5512
    @vootanical5512 2 місяці тому

    Quite appreciate your sharing

  • @nicolasklosptock3686
    @nicolasklosptock3686 2 місяці тому

    Hi! I really like your videos! I wanted to ask, why did you "hide" the rest of the videos on the LangGraph playlist? Is there a platform or some place else I can finish watching them?

  • @nicolasklosptock3686
    @nicolasklosptock3686 2 місяці тому

    Hi! I really like your videos! I wanted to ask, why did you "hide" the rest of the videos on the LangGraph playlist? Is there a platform or some place else I can finish watching them?

  • @nicolasklosptock3686
    @nicolasklosptock3686 2 місяці тому

    Hi! I really like your videos! I wanted to ask, why did you "hide" the rest of the videos on the LangGraph playlist? Is there a platform or some place else I can finish watching them?

    • @ingeniumacademy6575
      @ingeniumacademy6575 2 місяці тому

      @@nicolasklosptock3686 Glad you are enjoying the videos! The rest of the videos are now apart of our paid course on Udemy. You can search our name and course title in Udemy and find it. Here is the course title: “LangGraph: From Basics to Advanced AI Agents with LLMs” Thank you for watching!

    • @nicolasklosptock3686
      @nicolasklosptock3686 2 місяці тому

      @@ingeniumacademy6575 Thank you for your response! I wanted to know if I could ask you some questions about human-in-the-loop. I'm working on a project and there's something I can't seem to figure out. Is there a way we could communicate?

  • @nicolasklosptock3686
    @nicolasklosptock3686 2 місяці тому

    Hi! I really like your videos! I wanted to ask, why did you "hide" the rest of the videos on the LangGraph playlist? Is there a platform or some place else I can finish watching them?

  • @jacksmith-ih9rm
    @jacksmith-ih9rm 2 місяці тому

    Great!

  • @jayven7306
    @jayven7306 2 місяці тому

    Amazing video

  • @ABHISHEKMARUTIJYOTIBA
    @ABHISHEKMARUTIJYOTIBA 3 місяці тому

    great video mate keep helping and teaching people request - can you just change sequence of videos in your playlist it'll be easy to watch in earliest first form

  • @matheuskao7331
    @matheuskao7331 3 місяці тому

    Do you think working with tools as 'functions' instead of python classes is the best? I saw some people creating classes to do it, not sure if it's the preferable way to orchestrate.

  • @noihr4469
    @noihr4469 3 місяці тому

    Very well explained! Thanks for the videos

  • @proterotype
    @proterotype 3 місяці тому

    That just made “state” so easy to understand for me

  • @proterotype
    @proterotype 3 місяці тому

    Really like your content man

  • @proterotype
    @proterotype 3 місяці тому

    How this dude only has less than 1,000 views is beyond me

  • @haemonyang6278
    @haemonyang6278 3 місяці тому

    Great Video! Appreciate

  • @SaugatThapaChettri
    @SaugatThapaChettri 3 місяці тому

    can i get a github link or any link where i can find the code?

  • @falconer8518
    @falconer8518 3 місяці тому

    When implementing the example, you may have an error in the tokenize_input functions. This function assumes dynamic padding, but in new versions of hugging face, this is implemented through collator. padding = "max_length" does not mean dynamic padding, but padding with a fixed value Example (truncation = "True", padding = "max_length", max_length = 120) The error that appears after deleting padding = "max_length" occurs for the following reason. return_tensors = "pt" assumes the return of the tensor. The tensor has the property of equality of all objects inside it in length, and they are not aligned with us. The correct option tokenizer(prompt, truncation = True).input_ids And then use collator. Here is an example: ua-cam.com/video/7q5NyFT8REg/v-deo.html ua-cam.com/video/nvBXf7s7vTI/v-deo.html huggingface.co/docs/transformers/main_classes/data_collator Also note that each task has its own collator. Experiment)

  • @larissacury7714
    @larissacury7714 4 місяці тому

    Thank you very much!

  • @학습및서치용
    @학습및서치용 4 місяці тому

    Hello i'm korean high school student and i'm here for my report about svd. I searched lots of videos but your one is the best one to understand. Thank you

  • @abramcz
    @abramcz 4 місяці тому

    Part 1 makes it pretty easy to guess what part 2 is going to be, so viewers can do it on their own and use this second video as a check. Maybe you didn't plan it that way but it works out nicely.

  • @abramcz
    @abramcz 4 місяці тому

    Saw this proof in a book but the notation was so confusing, came here to the web for a demonstration with plain English description, as you have done. Thank you.

  • @حامدحبیبی-س7ف
    @حامدحبیبی-س7ف 5 місяців тому

    very good

  • @Familyguy2141
    @Familyguy2141 5 місяців тому

    this is cool, many thanks, bro !!!

  • @ROKKor-hs8tg
    @ROKKor-hs8tg 6 місяців тому

    You are amazing thank you

  • @texwiller7577
    @texwiller7577 6 місяців тому

    Many many thanks for this video. It helped me a lot!

  • @AlexPadula
    @AlexPadula 7 місяців тому

    Great video! Could you share a link to your colab notebook?

  • @westonwalker3888
    @westonwalker3888 7 місяців тому

    Thanks. This helped a ton!

  • @romitbhandari8790
    @romitbhandari8790 7 місяців тому

    Sound is too low!!

  • @notV3NOM
    @notV3NOM 7 місяців тому

    Thanks

  • @djurosvemirac88
    @djurosvemirac88 8 місяців тому

    Thanks for the video. How can we create our own dataset for text summarization and how big should it be to train the model properly?

  • @hasanaghaazad2805
    @hasanaghaazad2805 8 місяців тому

    Finally. The best explanation of top_p 👍 Thanks

  • @israelmohr
    @israelmohr 8 місяців тому

    Promo SM

  • @proterotype
    @proterotype 8 місяців тому

    Dude, this is a great series of videos. I just want to document that you only had ~500 subs at time of writing (03/2024) for when your channel blows up

    • @blanne9628
      @blanne9628 8 місяців тому

      it appears as 236 subscribers to me

    • @proterotype
      @proterotype 8 місяців тому

      you’re right it is 236 subs. It was ~500 VIEWS. My bad. Thanks for the accurate correction

  • @vfryhn2
    @vfryhn2 8 місяців тому

    Thank you, this is really usefu

  • @liquidmobius
    @liquidmobius 9 місяців тому

    You should actually declare variables like: int myvar {7}. Not with the assignment operator (=). That's considered best practice and is the preferred method recommended by Bjarne S.

  • @MuhammadAdnan-tq3fx
    @MuhammadAdnan-tq3fx 9 місяців тому

    this is good but where is GitHub code ?

  • @saramirabi1485
    @saramirabi1485 10 місяців тому

    Hi, thanks and I am glad about your video. just is it possible to share codes in GitHub or any other platform? It can be so practical. Also , we are eager for more videos regarding ChatGPT 🙂

  • @dianazoua939
    @dianazoua939 11 місяців тому

    Hey ,please could you send your code ?

  • @ElectroFriedBees
    @ElectroFriedBees 11 місяців тому

    This is great info, but you do not include links to your notebooks anywhere. It would add a ton of value to have them available in order to follow along with your instructions.

  • @lechristopherblackwell1234

    Great video, Ty!🎉❤

  • @TheAmit4sun
    @TheAmit4sun Рік тому

    What if your embeddings contains both simple text and then json to support the text whatever the text is explaining about. How can we tell the model just parse the json part of the retrieved doc and not text and when replying reply both?

  • @adamvita7600
    @adamvita7600 Рік тому

    Hi, do you have a twitter or something? Can I contact you? Many great videoes!!

  • @kevon217
    @kevon217 Рік тому

    Quick and simple, thanks!

  • @tonvossen7555
    @tonvossen7555 Рік тому

    Thanks for the video! Where can I find the inner product video you were referring to in the video? I wasn't able to find it.

  • @SamuelJunghenn
    @SamuelJunghenn Рік тому

    Good video. Are you available for consultation?

  • @thenewdimension9832
    @thenewdimension9832 Рік тому

    Very helpful ,if possible write clearly please 🙏

  • @evanjoshychittilappilly7959

    Really good video guys!!!! 🤩😘

  • @FiveTrackTape
    @FiveTrackTape Рік тому

    This was really helpful for abstracting my understanding of vector spaces. (And gremlin spaces.) Of course I was waiting for the null gremlin space in R where the x and y axis cross because I've heard gremlins don't like crosses. Keep up the good work.

  • @chesterfowler7066
    @chesterfowler7066 2 роки тому

    𝐩𝓻Ỗ𝓂Ø𝓈M 💋