$0 Embeddings (OpenAI vs. free & open source)

Поділитися
Вставка
  • Опубліковано 21 лис 2024

КОМЕНТАРІ • 296

  • @phobosmoon4643
    @phobosmoon4643 Рік тому +134

    45 seconds in and you have already asked all of the correct questions. you have my attention, sir.

    • @kop-lg7lo
      @kop-lg7lo Рік тому

      And my like

    • @ssathessa
      @ssathessa Рік тому +1

      16:00 in and you have completely lost my attention, along with my hopes for being to do this as a 1st timer😂

    • @funkdefied1
      @funkdefied1 5 місяців тому

      @@kop-lg7loand my comment

  • @TC-Loom
    @TC-Loom Рік тому +13

    After watching dozens of hours of similar videos this year, this is the best one. Thank you

    • @carpal4489
      @carpal4489 Місяць тому

      ah yes javascript and co way better huh?

  • @mohamedamine_47
    @mohamedamine_47 8 місяців тому +1

    While I didn't originally come to watch the TypeScript implementation, I found myself fully immersed in your explanations. It wasn't until I'd watched the first 30 minutes that I realized the video was over an hour long.
    Thank you for sharing this!

  • @erikmejiass
    @erikmejiass Рік тому +14

    I don’t usually post comments, but in this case would do an exception to thank you for the easy to understand and to the point explanation. It’s rarely found these days.
    Hats off to you 💪

  • @MadeInJack
    @MadeInJack 5 місяців тому +1

    Man, you are the reason why UA-cam is such an awesome platform. Thank you so much for this golden course!

  • @shabarinathk8954
    @shabarinathk8954 2 місяці тому +1

    27:50 : Bro started counting from 0 , what a legend and a true engineer

  • @mortocks
    @mortocks Рік тому +11

    First tutorial that actually makes sense and explains the ecosystem without hand waving. Thanks!!!!!!

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому +3

      You bet! Thanks for watching 😃

    • @kiiikoooPT
      @kiiikoooPT 3 місяці тому

      that is actually not true, all the basic scripts in this video start with a hand waving instead of an "Hello World"

  • @johngrant7197
    @johngrant7197 10 місяців тому +2

    I love that you rock Typescript in domains usually reserved for Python.

  • @eyemazed
    @eyemazed Рік тому +16

    damn i love when i dive head into NLP content, get instantly overwhelmed and then a video like this gets randomly recommended and instantly clears away about 120 questions that i had. thanks man

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому +1

      Awesome!

    • @Richardziani
      @Richardziani Рік тому +1

      Hey, I totally feel you! 😍 It's amazing how stumbling upon the perfect video can make all those overwhelming questions disappear in an instant! 🙌 Thank you so much for sharing your experience, it's truly inspiring! 🌟 Keep diving headfirst into NLP content, my friend! 💪

    • @Mullheimer
      @Mullheimer Рік тому

      It's amazing how Google just reads your mind. At this point it is just getting retarded. Every day exactly the right yt vid comes up. I've been querying large pdfs today via chatgpt...

  • @chrissparks8377
    @chrissparks8377 Місяць тому +1

    With a heavy CompSci / Math background, I found this to deliver CRAZY VALUE ❤ in terms of knowledged gained. You touched on the data structures, algorithms, Web API's, JavaScript ecosystem trends, and most importantly, the fundamentals of text embeddings and modern trends around their usage and deployment in an approachable, hands-on manner. 🤯
    I'm always on UA-cam, but literally had to look for where I could comment -- this might be my 3rd ever... Fantastic work 👏 🎉

  • @sheikhakbar2067
    @sheikhakbar2067 9 місяців тому +4

    It's almost 3:00 in the morning, I am going to sleep and watch this excellent video tomorrow!

    • @JoEl-jx7dm
      @JoEl-jx7dm 9 місяців тому

      Same but different day

  • @zeelthumar
    @zeelthumar Рік тому +1

    I have never watched full tutorial that contains javascript bcz I'm a python guy but for the first time I have gone through the whole tutorial and obviously I subscribed...................U are just awesome...............keep it up

  • @justinyoung1762
    @justinyoung1762 Рік тому +5

    This is the best ML for JS tutorial I've seen. SUPER helpful that you started with foundational topics. Thanks for making this.

  • @fille.imgnry
    @fille.imgnry 11 місяців тому +5

    This is sooo good. The way your thinking, explaining, digging deeper, wanting to understand why things are happening the way they do. Thank you!

  • @comptvlee
    @comptvlee Рік тому +55

    Insanely helpful content. You've been one of the content leaders carrying the burden of disseminating all these complex topics into my head. Started with the supabase docs all the way here and I'm grateful!!! This is game changing for my career

  • @jimg8296
    @jimg8296 9 місяців тому +2

    Wow that was comprehensive and informative. Never realized there was so much involved in selecting models for creating embeddings.
    Thank you so much!

  • @richardyim8914
    @richardyim8914 7 місяців тому +2

    This was crazyyy useful. Not a software or web developer, but trying to use embeddings for academic research. Really great walkthrough!

    • @mahuzedada
      @mahuzedada 3 місяці тому

      There's a tool that allows you to manage embedding without code

  • @cesar_ai_eng
    @cesar_ai_eng Рік тому +1

    I've watched just two of your videos and I feel like I've learnt 6 months of ML Engineering. Many many thanks

  • @jagrat12354
    @jagrat12354 5 місяців тому +2

    Every sec of the video was worth watching

  • @SamirLohiya-sm7ze
    @SamirLohiya-sm7ze 9 місяців тому +2

    This is a great video, and it makes me feel like there is no need to refer to any other video.
    What a great piece of content!

  • @danielbusquets3282
    @danielbusquets3282 8 місяців тому +1

    Very good video. I just implemented a semantic search engine in my app and it works like magic

  • @scign
    @scign Рік тому +1

    I love how my head comes up with a question and you go down that exact rabbit hole! You just won a new subscriber here.

  • @JohnnysaidWhat
    @JohnnysaidWhat Рік тому +1

    I used clip to embed some fields of study and then feed it user input which would "fuzzy map" to my embeddings. Worked so so well and saved me a ton of heartache. Didn't realize this model could do text2image and vice versa. Will have to try that out as well!

  • @jervx829
    @jervx829 3 місяці тому +1

    Sir, Thank you 🫡. I have difficulty focusing to videos like this and I watched many tutorials before and often got bored & ended up closing it. But your explanation was so good and I enjoy learning from you. Thank you for sharing your knowledge to us God bless you sir! I wished I discovered you earlier when I was still on college last year, my capstone project could've been different.

    • @jervx829
      @jervx829 3 місяці тому

      For those who trying on Nextjs 14 app router (server side). Don't use pnpm. Switch back to npm

  • @deeerwin1113
    @deeerwin1113 5 місяців тому

    Thank you for covering a lot of sub topics without going deep too much! I learned a lot

  • @M110ification
    @M110ification 11 місяців тому

    This is the tutorial I've been trying to find. I like how you describe the different components of the system and didn't just start with a walk thru how to setup a dev environment and other mundane pieces.

  • @abagatelle
    @abagatelle Рік тому +2

    I'm.....overwhelmed! Learn't that it's a very long road. Very pleased I found your excellent channel.

  • @shinchima
    @shinchima 11 місяців тому +2

    just the ticket - cheers for uploading

  • @rickgeyer9685
    @rickgeyer9685 6 місяців тому

    This is absolutely the best explanation of embeddings I have ever seen. Thanks so much for this excellent video!

  • @ninjagaskin
    @ninjagaskin Рік тому +5

    This beats watching Netflix. Thank you for such a well-put-together tutorial/lecture on embeddings 101.
    I would really value your advice (and this community too) on a question I have for a personal project:
    I am attempting to build a pdf analyzer for financial reports - 10ks, Annual Reports, Financial Statements, etc...
    What is the best metric / category you recommend I use for my embedding model and LLM too?
    the goal is to allow the upload of any pdf, embed the pdf, store in a vector db, and then query some question answering along with memory capabilities.
    - new subscriber

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому +4

      Great use case! I would focus on a retrieval based model which is best suited for question-answer style matching. In terms of which one - I think you will just need to try some of them and test to see if your queries are matching with the content you expect. Good luck (thanks for the sub)!

  • @pranjalagnihotri6072
    @pranjalagnihotri6072 Рік тому +4

    Thank you so so much for this banger video few days ago I was working on a side project (inspired by Wesbos talk) to find the similarity between a tweet replies and group them together I first used bag-of-words to generate word vectors and then used OpenAI embeddings only to find out I need to setup a paid account because of that I had to pause my side project and I would say right after this I am going and will complete my projects using huggingface models thank you so much. I explored HF but was not able to gather such details like you explained everything in video❤

  • @bakistas20
    @bakistas20 Рік тому +4

    I love how detailed your tutorials are! Keep on

  • @ymroddi
    @ymroddi Рік тому +2

    Just a side note for those using transformer models in production - interacting with the model should be done in a worker per official docs so it is off the main thread. I know your example was very bare bones so this wasn't an issue.

  • @shuaiber
    @shuaiber Рік тому +3

    Fantastic content. Loved the contextual information in the beginning which is relevant to understand all the different components in the ecosystem.

  • @SantamChakraborty
    @SantamChakraborty Рік тому +2

    Thank you ! That was amazingly lucid and well put together. Keeping an eye out for your future videos.

  • @yuri.caetano
    @yuri.caetano Рік тому +2

    Bro your video is hell good edited and content is good, congratulations

  • @Muennighoff
    @Muennighoff Рік тому +3

    Amazing video! Will work on adding a ranking for the individual MTEB task tabs. Also we're working on adding more tasks (e.g. code embeddings) & other models to the leaderboard! 🤗

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому +1

      That’s amazing Niklas, thanks for the update!

    • @cklim78
      @cklim78 Рік тому

      Great! Look forward to the updates especially on the code embeddings task, may I know any targeted date when the updates will be released?

  • @eru6ite
    @eru6ite Рік тому +1

    Dang! I'm not even halfway and I've already learned so much. Amazing content, mate! 🍻

  • @stephensinclair276
    @stephensinclair276 Рік тому +1

    That was one of the best videos I have seen on this topic. Going to look for more!

  • @JunYamog
    @JunYamog 11 місяців тому +1

    Thanks I made it on the end of the rabbit hole. Interesting to learn that you can do embeddings in a browser.

  • @borknagarchile
    @borknagarchile 10 місяців тому +1

    Your video is amazing, you pretty much see all the possible the use cases for when you are trying to implement something like this. Thanks 🎉

  • @hasaniqbal233
    @hasaniqbal233 Рік тому +1

    Really appreciate you doing these videos using TS and not Python.

  • @Bruh_688
    @Bruh_688 8 місяців тому +1

    Love you man, thanks for coding and making this tutorial in JavaScript/TypeScript.

  • @lofikiwii
    @lofikiwii Рік тому +1

    My man!!!! Huge! (it's tony), glad to see a new video! And this was one a monster video! Its jammed pack with so much information man.
    Keep it going my man!

  • @stephenk8632
    @stephenk8632 7 місяців тому +1

    Amazing video! Thanks. It was uncanny how questions would be popping in my head and you'd answer them in the next sentence lol. Thanks again

  • @papa4614
    @papa4614 Рік тому +5

    Yes very nice to see your still doing vids ❤❤❤ there is so much your teaching us, thanks for that. I hope you still do the part 3 video series on the electron screensaver project 🤩 stay save

  • @martinp3839
    @martinp3839 Рік тому +2

    Excellent! Especially the way you build up the episode from explaining core concepts to a layman..glad I stumbled upon your channel..

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому

      Glad it was helpful!

    • @martinp3839
      @martinp3839 Рік тому

      I am new to javascript and typescript. When I cloned the repo and tried executing "npm run dev" in the "HuggingFace/apps/embeddings-huggingface/src", get this error "TypeError [ERR_UNKNOWN_FILE_EXTENSION]: Unknown file extension ".ts"", Hit a roadblock. Kindly advise how I can fix this.

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому

      Sounds like you may be running the code as JavaScript (TypeScript has a compile step). The easiest way to get off the ground is probably to install ts-node and run your TS files through that.

  • @moy2010
    @moy2010 Рік тому +1

    Probably the best content I have watched on the subject. Kudos!

  • @rikvermeer1325
    @rikvermeer1325 Рік тому +2

    Hmmz... finally a good overview on embeddings that is in depth AND understandable
    I will watch this multiple times

  • @grant_vine
    @grant_vine Рік тому +1

    Best hour and 24 mins spent this week 😊

  • @AngelEduardoLopezZambrano
    @AngelEduardoLopezZambrano Рік тому +5

    This video got me into the rabbit hole of your channel! You just got a new subscriber. Excited to see what you'll come up with next. Particularly, I'd like to see how to fine tune text generation models in modest hardware using javascript. Thanks!

  • @neoblackcyptron
    @neoblackcyptron Рік тому

    I'm glad I found this channel. It's very rare to come across super knowledgeable people like the owner of this youtube channel in the AI field who really know their stuff.
    I am planning to start an AI consulting business, cutting costs reducing token costs is a big deal for me, this really helped.
    By the way I heard AI consultants who know their stuff: ML, Genetic Algorithms. Robotics, Computer Vision and LLMs with some RPA thrown in can charge $200/hour is that a fair rate or am I underselling me skills. I don't want to ruin it for the rest of my peer by quoting too low.

  • @crometica
    @crometica Рік тому +1

    It's incredibly valuable, and you've gained a fan ❤. Keep up the fantastic work!

  • @roguesherlock
    @roguesherlock Рік тому +1

    man this was so helpful. Thank you!
    Also, I loved all the btws, fyis, fun facts and side quests haha

  • @vinitjha_
    @vinitjha_ Рік тому +1

    Great explaination. You simplified every bit of detail👏

  • @jakubwerner11
    @jakubwerner11 9 місяців тому +1

    So well explained, thank you!

  • @PatrickSteil
    @PatrickSteil 10 місяців тому +1

    Wonderful video... helping to teach us how all this stuff is working under the covers... new subscriber!

  • @gnomewc22
    @gnomewc22 Рік тому +1

    Man ur just a natural teacher, thank you!

  • @IgnoreMyChan
    @IgnoreMyChan Рік тому

    I love your 2010-like editing with all the micro-cuts making it very exhausting to watch and listen to. 😂

  • @browland601
    @browland601 Рік тому +5

    Love the level of detail here!
    I'm working on an idea to do text classification using sentence embeddings as input features and then doing logistical regression. If the labels (binary classifier for now) correspond well with the embeddings generated from training examples, then my hope is the logistical regression model will work with inputs not seen before but close semantically.
    One of the considerations is which embedding model to use, so lots of food for thought here!

    • @theepicosityofpizza
      @theepicosityofpizza Рік тому +1

      This is how they tested classification performance in the benchmark mentioned, so you're on the right track

    • @omijmangukiya8984
      @omijmangukiya8984 Рік тому

      i suggest using setfit

  • @SmallTownDev
    @SmallTownDev Рік тому +1

    By far the most informative resource 🚀

  • @mytechnotalent
    @mytechnotalent Рік тому +1

    Great job and very detailed I like the JS internals showing the steps.

  • @khangvutien2538
    @khangvutien2538 Рік тому +1

    With this video, you got a new subscriber.
    Thanks.

  • @sarojregmi200
    @sarojregmi200 10 місяців тому +1

    I think they saw your video and added the sentence transformer label in there.

  • @Franx570
    @Franx570 Рік тому +2

    I'm only 30 minutes in, but Jesus this video is gold 👏👏

  • @TheTaygan
    @TheTaygan 7 місяців тому +1

    Great video with awesome explanations... well done

  • @ThunderboltPath
    @ThunderboltPath 11 місяців тому

    I appreciate so much that you made a video about this as I’m learning. But more than 90 mins was really long and I had to skip over some detailed explanations to get to see the demo 😂 So if anything, I’d hope you did it in 2 parts, one video for just the demo of these new technologies (what they can do for me) and another going into details behind everything. That’s my 2 cents… Loved the content 🎉😊

  • @handlez411
    @handlez411 11 місяців тому +1

    Awesome video! Thank you!

  • @Swanidhi
    @Swanidhi Рік тому +1

    Love the rabbit hole content! Subscribed!

  • @snsa_kscc
    @snsa_kscc Рік тому +24

    Another banger, bro! You are on 🔥. I love the fact ML ecosystem is morphing with TS/JS web dev. Massive thanks, this was a joy to watch. Have a nice one.

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому +1

      Appreciate it & thanks for watching! Very excited to see the new possibilities in the TS/JS ecosystem.

  • @hamzakyamanywa9792
    @hamzakyamanywa9792 2 місяці тому +1

    loved watching this!

  • @lakinmohapatra
    @lakinmohapatra Рік тому +1

    Very nice explanation. Thanks a lot

  • @luis96xd
    @luis96xd Рік тому +3

    Fantastic video, everything was well explained! Thanks
    Wow, it was an excellent solution to get Array length 1 of embeddings forking the model and adding the label Sentence Transformer, you really research a lot before making a video, great job! 👏💯
    I learned a lot, of programming of types, of model parameters and outputs

  • @monterourena
    @monterourena Рік тому +1

    Amazing job! Please continue doing these videos 🙌🏻

  • @shtrumj
    @shtrumj 8 місяців тому +1

    please more content , more depth, loved it, subscribed.

  • @N4LNba777
    @N4LNba777 8 місяців тому +1

    Amazing video, thanks for saving me a ton of time!

  • @RishuKumar-zo2hc
    @RishuKumar-zo2hc Рік тому +1

    Very informative
    Please release more videos
    Love your content

  • @eliaweiss1
    @eliaweiss1 Рік тому +1

    wow!!! amazing stuff, thanks for all this info!

  • @danjsy
    @danjsy Рік тому +1

    Great video thank you an excellent channel. For corporate use cases where they are predominantly Microsoft houses, for retrieval use cases can you see past the new OpenAI implementations? Thanks !

  • @lucamiamiflorida5065
    @lucamiamiflorida5065 Рік тому +1

    best video on the topic, thanks!

  • @jdkh89
    @jdkh89 Рік тому +1

    Wow I learned so much from this. Thank you so much!

  • @mbrochh82
    @mbrochh82 10 місяців тому +1

    super good tutorial!!

  • @aliandiazperez7602
    @aliandiazperez7602 Рік тому +1

    Excellent video tutorial and teaching skills!!!!!

  • @DavitBarbakadze
    @DavitBarbakadze 9 місяців тому +2

    Man I wish you'd create those videos more often. Maybe do a Patreon acoount. I'd gladly pay.

  • @artem-yw8km
    @artem-yw8km Рік тому +1

    cool realy improved inference results

  • @gunerdown
    @gunerdown Рік тому +1

    You got my sub, great content!

  • @sirishkumar-m5z
    @sirishkumar-m5z 3 місяці тому

    An excellent comparison of embedding tools! Another free option worth exploring is Hugging Face's Transformers, which offers robust embedding qualifications. #AIEmbeddings #HuggingFace

  • @justine_chang39
    @justine_chang39 11 місяців тому +1

    this video is amazingly good

  • @manishbabbar9969
    @manishbabbar9969 Рік тому +1

    Really liked your content. Thanks for sharing such engaging information.

  • @LWC
    @LWC Рік тому +1

    Really great video. Thank you for it!

  • @AhmadAwais
    @AhmadAwais Рік тому +2

    Such an underrated video and channel. You go man! 🫡👍

  • @raphauy
    @raphauy 9 місяців тому +1

    Thank you very much!

  • @mohegyux4072
    @mohegyux4072 Рік тому +1

    lol I didn't know the name of the channel until minute 40, subscribed

  • @renanmonteirobarbosa8129
    @renanmonteirobarbosa8129 Рік тому +2

    this exists since 2018 ish hahaha I am glad people is learning

  • @adrienazie
    @adrienazie Рік тому +1

    Thanks for the time and effort you have put into creating this video. Great content and explanation.

  • @archiee1337
    @archiee1337 Рік тому +1

    Great video, thank you😊

  • @aksh1618
    @aksh1618 Рік тому +3

    Another great one! I'm really hooked onto the high quality content you're producing! On a related note, which one of these open source embedding models would you consider using for something like ClippyGPT, and are actually you planning to switch to one of these?

    • @RabbitHoleSyndrome
      @RabbitHoleSyndrome  Рік тому

      Thanks for watching! Great question - we will definitely consider it. Will have to do a deeper dive, but ideally a model that performs well with retrieval. Also need to consider practicalities around deployment and operation, so usually smaller model = better.

  • @sevindis
    @sevindis Рік тому +1

    Great content, thank you so much!

  • @orenmizr
    @orenmizr Місяць тому +1

    that was very interesting. thanks🙏

  • @VarunM-f8g
    @VarunM-f8g Рік тому +1

    amazing content man. hats off👏👏