Yujian Tang
Yujian Tang
  • 132
  • 66 352
Llama 3.1 vs Llama 3 for RAG performance on Unstructured Data
Right after the release of Llama 3.1, Nina Lopatina from Unstructured has already done some evals. What's she learned? Come hear about her RAG evals on July 30th!
Follow for more events - lu.ma/oss4ai
Переглядів: 314

Відео

Real-world Data Prep for LLMs: Challenges and SolutionsReal-world Data Prep for LLMs: Challenges and Solutions
Real-world Data Prep for LLMs: Challenges and Solutions
Переглядів 6146 днів тому
Building LLM applications? One of the top problems you'll face is going to be presenting the LLM with good input data. Good LLM responses need good input data. Clean, native text PDFs that are used in explainer articles and example code are rarely what you'll encounter in production use cases. Real-world data is wild to say the least! ​ Here are some challenges you'll face: - Scanned PDFs - Sca...
Graph RAG DemoGraph RAG Demo
Graph RAG Demo
Переглядів 997 днів тому
What does Graph RAG actually look like? Watch Jason Koo from Neo4j walk us through a Graph RAG example. For more tech talks like this check out lu.ma/oss4ai #genai #technology #neo4j
Make RAG better with GraphsMake RAG better with Graphs
Make RAG better with Graphs
Переглядів 587 днів тому
You can use RAG to make LLMs better by injecting your data. You can use graphs to make your RAG apps even better via Graph RAG. Jason Koo from Neo4j explains how this works. For more tech talks, both online and in person, check out lu.ma/oss4ai #graphdatabase #neo4j #llms
What is RAG? Explained by Jason KooWhat is RAG? Explained by Jason Koo
What is RAG? Explained by Jason Koo
Переглядів 227 днів тому
Jason Koo explains RAG. For more tech talks like this check out lu.ma/oss4ai #ai #llms #machinelearning
Everything You Need to Know about Graph RAGEverything You Need to Know about Graph RAG
Everything You Need to Know about Graph RAG
Переглядів 787 днів тому
What even is Graph RAG? Jason Koo from Neo4j breaks it down for us. Find more tech talks both online and in person at lu.ma/oss4ai #techtalktuesday #devtools #ai #graphdatabase
Graph RAG with Where's WaldoGraph RAG with Where's Waldo
Graph RAG with Where's Waldo
Переглядів 597 днів тому
Jason Koo from Neo4j explains what Graph RAG is and how it works via Where's Waldo! Find more tech talks both online and in person at lu.ma/oss4ai #ai #graphdatabase #programming
How to Create Breakthroughs in Data ManagementHow to Create Breakthroughs in Data Management
How to Create Breakthroughs in Data Management
Переглядів 157 днів тому
An excerpt from my interview with Chang She, CEO and Co-Founder of LanceDB. Learn more about one of the most innovative databases, optimized for multimodal AI training, analytics, and retrieval, and up to 100 times faster than Parquet for many AI workloads. Keep up with more talks like this by subscribing to lu.ma/oss4ai #genai #devtools #programming #data #machinelearning
The CEO of a Vector DB Company Speaks on the Future of AIThe CEO of a Vector DB Company Speaks on the Future of AI
The CEO of a Vector DB Company Speaks on the Future of AI
Переглядів 137 днів тому
An excerpt from my interview with Chang She, CEO and Co-Founder of LanceDB. Learn more about one of the most innovative databases, optimized for multimodal AI training, analytics, and retrieval, and up to 100 times faster than Parquet for many AI workloads. Keep up with more talks like this by subscribing to lu.ma/oss4ai #genai #ai #devtools
How LanceDB tackles CAP TheoremHow LanceDB tackles CAP Theorem
How LanceDB tackles CAP Theorem
Переглядів 428 днів тому
An excerpt from my interview with Chang She, CEO and Co-Founder of LanceDB. Learn more about one of the most innovative databases, optimized for multimodal AI training, analytics, and retrieval, and up to 100 times faster than Parquet for many AI workloads. Keep up with more talks like this by subscribing to lu.ma/oss4ai #ai #devtools #programming #databaseconcepts
An innovative database changing the whole AI field : the idea behind LanceDBAn innovative database changing the whole AI field : the idea behind LanceDB
An innovative database changing the whole AI field : the idea behind LanceDB
Переглядів 348 днів тому
An excerpt from my interview with Chang She, CEO and Co-Founder of LanceDB. Learn more about one of the most innovative databases, optimized for multimodal AI training, analytics, and retrieval, and up to 100 times faster than Parquet for many AI workloads. Keep up with more talks like this by subscribing to lu.ma/oss4ai #genai #ai #devtools
Awesome AI Dev Tools by OSS4AI - JulyAwesome AI Dev Tools by OSS4AI - July
Awesome AI Dev Tools by OSS4AI - July
Переглядів 17116 днів тому
This month's talks feature: - Video AI by Christian Safka and Ari Korin from Tavus - Should you learn an LLM Framework by Yi Ding - 14 startup pitches
Building LLM Evals That Work IRLBuilding LLM Evals That Work IRL
Building LLM Evals That Work IRL
Переглядів 5617 днів тому
Arize AI is a leading company in the evaluation space. Not only have they been a player since before it was popular, but they have plenty of real world experience. Aparna Dhinakaran comes and talks with us about lessons learned. Clipped from the Mid Year Gen AI Zoo by OSS4AI. Want to learn more about #ai? Follow lu.ma/oss4ai for more information. #devtools #llms #generativeai
Manage, Visualize and Search Video Data on Your LaptopManage, Visualize and Search Video Data on Your Laptop
Manage, Visualize and Search Video Data on Your Laptop
Переглядів 2617 днів тому
Computer vision data is large by nature, and that makes it tough to manage on something like your laptop. Visual Layer has made that possible through their new open source tool - fastdup. Danny Bickson talks to us about how to use it. Clipped from the Mid Year Gen AI Zoo by OSS4AI. Want to learn more about #ai? Follow lu.ma/oss4ai for more information. #devtools #computervision #genai #artifici...
A Database for Multimodal AI,A Database for Multimodal AI,
A Database for Multimodal AI,
Переглядів 2617 днів тому
As we've seen already this year, multimodal AI is top of mind for many AI practitioners. Vishakha Gupta has done research on AI at Intel and brought her expertise into the startup world through ApertureData, a vector graph database. Clipped from the Mid Year Gen AI Zoo by OSS4AI. Want to learn more about #ai? Follow lu.ma/oss4ai for more information. #generativeai #devtools #llm #llmops

КОМЕНТАРІ

  • @awakenwithoutcoffee
    @awakenwithoutcoffee День тому

    appreciate it!

  • @emirhanozmen2289
    @emirhanozmen2289 День тому

    RuntimeError: Trying to backward through the graph a second time (or directly access saved tensors after they have already been freed). Saved intermediate values of the graph are freed when you call .backward() or autograd.grad(). Specify retain_graph=True if you need to backward through the graph a second time or if you need to access saved tensors after calling backward. I took this error. (I am not using the same dataset). Thank you.

  • @chucklewacker
    @chucklewacker 3 дні тому

    😮

  • @seth.photongraphy2673
    @seth.photongraphy2673 4 дні тому

    Haha we have actually made an app similar to Parallel live (with agents) for a hackathon

  • @nerdymathematician
    @nerdymathematician 5 днів тому

    thank u!

  • @ozne_2358
    @ozne_2358 6 днів тому

    I have two questions : 1) I understand that this is multiplication free, with ternary weights being essentially additions and subtractions. However, it's still not clear to me if these additions and subtractions are performed on floating point numbers (presumably bf16). 2) I looked at the paper and I don't understand the relation between the MLGRU and the GLU. They seem to share a Wg matrix, but is it really the same ? Fig.2 in the article a matrix Wm is shown, but not in the equations of th eGLU. Very confused.

  • @JBoy340a
    @JBoy340a 9 днів тому

    Looks like very interesting techniques. And great to see the team also looked at the potential implementation cost reductions from MatMult free. It will be interesting to see how this scales up to larger models.

  • @vitalis
    @vitalis 16 днів тому

    Very cool, could you share the workflow and Notion notebook?

  • @michaelmoore7568
    @michaelmoore7568 Місяць тому

    obviously you have to read the docstrings to do the Class LSTM(nn.module): part? ....no?

  • @jameskim6442
    @jameskim6442 Місяць тому

    Ace is both highest and lowest in most games of poker and black jack.

  • @shoewipe
    @shoewipe Місяць тому

    Can you do high/low with suits and face_cards working with lists and tuples?

    • @yujiantang
      @yujiantang Місяць тому

      yeah

    • @shoewipe
      @shoewipe Місяць тому

      @@yujiantang I ended up figuring it out last night- took me a while to work out the game logic kinks, now I’m just working out game-flow. You helped changed my perspective though so thank you. Excited to see how you execute it

  • @pickle6163
    @pickle6163 Місяць тому

    I know this an old video, would it be possible to change the code a bit to work with "Deck Builder" type game instead of just a standard deck

    • @yujiantang
      @yujiantang Місяць тому

      yeah, just replace the cards

  • @paraglide01
    @paraglide01 Місяць тому

    Nice and simple I like it.

  • @paraglide01
    @paraglide01 Місяць тому

    Nice and simple Like it.

  • @koescoin810
    @koescoin810 2 місяці тому

    1:00 Yess, exactly the point: long system prompt + input.

  • @techfren
    @techfren 2 місяці тому

    hi! nice content 🤝

  • @ivanzelenin3986
    @ivanzelenin3986 2 місяці тому

    Thank you very much for your work! Helped me a lot!

  • @dallasthegreat
    @dallasthegreat 2 місяці тому

    nice!!

  • @quinton2442
    @quinton2442 4 місяці тому

    Bruh you're quick with it, but also straightforward. I like your style of teaching for sure!

  • @gappy500
    @gappy500 4 місяці тому

    why not for i in range(0, number): if i * i == number: print(i) much easier and you get the value of what number is the square root

    • @yujiantang
      @yujiantang 4 місяці тому

      sure, you can do that, the runtime for that is a bit longer though, especially as your number gets larger

    • @gappy500
      @gappy500 4 місяці тому

      @@yujiantang if i'm not mistaken there's a module to remove caches and unnecessary codes to speed up fibonacci sequence, i think it would work on this too

  • @foadrezaei1425
    @foadrezaei1425 7 місяців тому

    What is the names of the algorithm used in here? Does it have a mathmatical name?

    • @yujiantang
      @yujiantang 5 місяців тому

      no idea really 🤣 this is the method I used to use when I did math contests, just implemented in Python

  • @noahtah1511
    @noahtah1511 8 місяців тому

    thank you for this! i'm working on a blackjack project for class and didn't know how to approach the deck of cards, this will help!

  • @Inte8ranD
    @Inte8ranD 8 місяців тому

    Sorry for misspelling your last name, @Yujian Tang

  • @Inte8ranD
    @Inte8ranD 8 місяців тому

    Hey Yujian, can we use a csv, instead of a json? To use as a file to store the information? @Yujian Jung

    • @yujiantang
      @yujiantang 8 місяців тому

      yeah, you totally can, that would be for more tabular data - ie you want to be able to related different entities and such

  • @bhavyamaniar7523
    @bhavyamaniar7523 8 місяців тому

    Really?

    • @yujiantang
      @yujiantang 8 місяців тому

      yes, this is really how gpt works (at a high level)

  • @Jmvars
    @Jmvars 8 місяців тому

    I managed to create a deck and to even shuffle the deck! Now I just need to figure out how to deal the cards out to multiple players and I'm one step closer to making a card game.

    • @yujiantang
      @yujiantang 5 місяців тому

      just checking in - how is that card game going?

  • @user-dv3ks7rr7k
    @user-dv3ks7rr7k 9 місяців тому

    I have a question regarding the step n**2 <= num ; so I understood that this means that the prime factors of a number all exist less than or equal the square root of a number num. But in the case of num as 28 , it has a prime factor of 7 , and 7 squared is not less than or equal 28 , but somehow the code also worked and i got 7 included in the prime factors as a result. So does this code only checks prime factors less than or equal to square root of a number ? or did i get this wrong as somehow it also worked correct with 28; maybe this while statement only means that for n less than or equal square root of the number to divide num by n??

    • @yujiantang
      @yujiantang 8 місяців тому

      the code will add both the smaller and larger factor when n==4, you got 7 back because 4 x 7 = 28

  • @smillsmagsmillicent1523
    @smillsmagsmillicent1523 9 місяців тому

    hi! great video! what extension do you use to color code everything?

    • @yujiantang
      @yujiantang 9 місяців тому

      haha i think it's dracula

  • @dmitry8732
    @dmitry8732 10 місяців тому

    if I do "while n <= num", I get the same result. Why should I do "while n**2 <= num"?

    • @yujiantang
      @yujiantang 10 місяців тому

      both will yield the same results, using n**2 uses less loops so it's faster/better/stronger/harder/etc

  • @HosheaManein
    @HosheaManein 11 місяців тому

    this is actually work! thank you!

    • @yujiantang
      @yujiantang 10 місяців тому

      well of course it actually works :p

  • @AmritBasi
    @AmritBasi 11 місяців тому

    recently came across this channel and I'm enjoying this style of content, many thanks!

  • @Acql268
    @Acql268 Рік тому

    Right now doing an assessment, this video really helped out.

  • @antongunasingam9426
    @antongunasingam9426 Рік тому

    Don't you use elif and else instead of 3 if statements?

  • @user-vj2qh5un1i
    @user-vj2qh5un1i Рік тому

    Write a program by using class and methods to show winner if below scenario pass in deck of cards. King of Spade, Queen of Heart King of Heart, Queen of Diamond King of Diamond, Queen of Club King of Club, Queen of Spade Hint: Input should be two digit like (2,5), if 2= King of Spade and 5= Queen of Heart then person is the winner. can u help me with this scenario

  • @mrbodybag6283
    @mrbodybag6283 Рік тому

    cool

  • @777TYT
    @777TYT Рік тому

    there is not enough link to githov so as not to copy the code manually from the screen to your computer. think about it in the future. the video also starts with some kind of vague start, as if I had to watch some previous videos before it, although it does not say that this is part 2 or something like that.

    • @yujiantang
      @yujiantang Рік тому

      Here's the github: github.com/ytang07/nn_examples/blob/main/pytorch/rnn/lstm.ipynb

  • @Sanyat100
    @Sanyat100 Рік тому

    you are the best teacher I have ever seen !

  • @AlexeyMatushevsky
    @AlexeyMatushevsky Рік тому

    Why do we need to intialize the hidden_states and cell_states of the lstm every training step?

    • @yujiantang
      @yujiantang Рік тому

      hidden state weights are not retained from each training step, also i don't believe i'm initializing them every step, just each epoch, you can also re-initialize each batch if you are doing truncated backprop through time

  • @SilviaVeronicaNoriega
    @SilviaVeronicaNoriega Рік тому

    nice, short and clear

  • @randomvidsyt671
    @randomvidsyt671 Рік тому

    Yo, dude keep going, keep creating videos like this i want to learn from you

    • @yujiantang
      @yujiantang Рік тому

      Thanks! Glad that these are helpful :)

  • @jarrett1042
    @jarrett1042 Рік тому

    *promo sm* 💥

  • @leonmilledge7981
    @leonmilledge7981 Рік тому

    First

  • @StaMariaRock
    @StaMariaRock Рік тому

    Very nice video, I have a question about PCA If you train a model, let's say EigenFace, in OpenCV, and you want to use it to compare the trained model with an image, using PCA, how can you do that? Basically my doubt is comparing an Eigenfaces model with an image and the output should be the closes PCA image and its class

    • @yujiantang
      @yujiantang Рік тому

      Hi Gianmarco, I'm not sure I totally understand the question, what do you mean compare the trained model with an image using PCA? You want to compare the eigenvectors?

    • @StaMariaRock
      @StaMariaRock Рік тому

      @@yujiantang yes, compare a trained model with an image based on the eigenvalues and select the image that is the closest to the new input

  • @datbeef7023
    @datbeef7023 Рік тому

    Its cool seeing someone use flask for a change! Cant wait for part 2 :)

  • @gitaralang
    @gitaralang Рік тому

    Thanks for the vid good help for us beginners. Can I ask what is the empty card list for? Thanks!

    • @yujiantang
      @yujiantang Рік тому

      Hi Benedict, great question. It's so that we have an object to insert the cards that we are creating into!

  • @anitta_oficial
    @anitta_oficial Рік тому

    how to do with a function?

    • @yujiantang
      @yujiantang Рік тому

      Hi Ana, you could put all the code into a function and that should do the trick, if you have more questions or want to talk about the code itself, feel free to jump into here --> discord.gg/ysARSHdkcF and ping me

  • @roubos7264
    @roubos7264 Рік тому

    Thanks alot!

  • @shawngibford7790
    @shawngibford7790 Рік тому

    Bruh. This is exactly what I was looking for. You the realist. Just found your channel and will be munching on your videos until finals are done.

    • @yujiantang
      @yujiantang Рік тому

      Awesome to hear Shawn, happy to help!

  • @FelipeCampelo0
    @FelipeCampelo0 Рік тому

    lol you type so fast

    • @yujiantang
      @yujiantang Рік тому

      lol thanks! i developed my typing speed from playing too much league of legends as a high schooler 🤣

  • @jaywandery9269
    @jaywandery9269 Рік тому

    Short & simple. Thanks

    • @yujiantang
      @yujiantang Рік тому

      Awesome, glad to be of help!