Gen AI Course | Gen AI Tutorial For Beginners
Вставка
- Опубліковано 6 чер 2024
- This Gen AI tutorial for beginners is sort of like a Gen AI mini-course where a person can start learning the fundamentals of Gen AI and in the end, we build two end-to-end projects. Below is the outline of the exact topics that are covered.
Code for project 1: github.com/codebasics/langcha...
Code for project 2: github.com/codebasics/langcha...
LangChain source code: codebasics.io/resources/langc...
Vector database article: www.pinecone.io/learn/vector-...
00:00 Overview
00:29 What is Gen AI or Generative AI?
01:23 Gen AI evolution
10:00 What is LLM (Large Language Model)?
13:55 Embeddings, Vector Database
21:24 Retrieval Augmented Generation
28:16 Tooling for Gen AI
29:14 Langchain Fundamentals
1:14:49 End-to-End Project 1: Equity Research Tool
2:28:25 End-to-End Project 2: Retail Q&A Tool
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
Need help building software or data analytics/AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
🎥 Codebasics Hindi channel: / @codebasicshindi
#️⃣ Social Media #️⃣
🧑🤝🧑 Discord for Community Support: / discord
📸 Codebasics' Instagram: / codebasicshub
📝 Codebasics' Linkedin : / codebasics
------
📝 Dhaval's Linkedin : / dhavalsays
📝 Hem's Linkedin: / hemvad
📽️ Hem's Instagram for daily tips: / hemvadivel
📸 Dhaval's Personal Instagram: / dhavalsays
🔗 Patreon: www.patreon.com/codebasics?fa...
OpenAI has stopped issuing few credits. You have two options (1) By spending less than 5$ on openai API, you can complete this project. You will learn a valuable skill by spending money that may be less than what you spend in a restaurant for a dinner. (2) Use LLama 3 etc open source model in groq.com or do the project using google gamma or palm models (the second project has relevant information on that).
To learn AI concepts in a simplified and practical manner check our course "AI for everyone": codebasics.io/courses/ai-for-everyone-your-first-step-towards-ai
M about to get my salary and with it i first want to learn power bi , I will buy ur power bi
2,700 rs course in few days . Plz help me in that after completely understand power I'll buy this one. I trust u man , u r the correct person to guide youth.
Hiiiiiiii sir .i have just known your channel . I have qst plzzzf i need help .im pharmacist specialized in biochimistry médicale and moléculer génitics .is master in data science in usa good idea or nooo plezzz in need your advice 😢❤
Hi Dhaval, Thankyou so much for this tutorial. I am currently doing 2nd project (Retail Q&A Tool)
When tried to execute in jupyter notebook, getting this error:
"Retrying langchain.llms.google_palm.generate_with_retry.._generate_with_retry in 2.0 seconds as it raised RetryError: Timeout of 60.0s exceeded, last exception: 503 failed to connect to all addresses; last error: UNKNOWN"
But, when tried to run curl in postman getting proper response.
Could you please help me to fix this 503 failed to connect to all addresses issue.
Thank you.
so far the best explanantion I heard on LLM. Thanks for all your hardwork in these videos.
sir your way of explaining things with examples is mindblowing , never seen anyone teaching like this before , absolutely amazed . thank you for this course 🙏🙏
The way you explain everything thing more effectively is really good
I come from a Non-IT background and have found myself delving into the fascinating world of programming and cutting-edge technologies. Thanks to the invaluable guidance and tutorials by Dhawal Patel, I've been able to not only grasp but also teach Python, Java, and delve into complex domains like Machine Learning. Currently, my focus lies in research within bioinformatics, where I utilize deep learning and NLP techniques.
I owe a tremendous debt of gratitude to Dhawal Sir, whose teachings have been instrumental in shaping my journey. Without his insightful tutorials and unwavering support, I wouldn't have dared to dream of venturing into these domains. My deepest respect and appreciation go out to Dhawal Sir for his mentorship and guidance.
Wow - you did such an awesome job producing this video! superb explanations and video production. Thanks for making this
Thanks for this detailed video sir.. this was my first video watching on GenAI, this video has given initial confidence about basic info already…Tks a ton 🙏
Insanely Great Dhaval sir, waiting for more on Gen AI!
You are just awesome. Your teaching techniques are mindblowing i mean i dnt need to much stress my brain very smooth explanation awesome
Wowed. Thanks for your teaching. It is so useful for me. I have used generative AI for a long time, but your explaination makes me clarify my thoughts.
it was a fast track study. Great content !
love the way you explain everything
Hermano muy interesante, sigue adelante y agradecido por compartir tus conocimientos, saludos desde Peru!
Great Content Dhaval bhai! 👌🏻
Amazing content.
Thanks for this video.
Thanks for the wonderful explanation
Really nice video, thank you for the hard work 👍
congratulation on 1 million subscriber
Thankyou so much sir for this course❤🙌🏻
56:34 Thanks for the tips. It was much needed.
Waiting for your videos on LLM ❤
thank you for this peace of art!
You make LLM, Langchain super easy👍
Thank you sir for prepare such informative video on Gen AI, GPT model etc..❤
Glad you liked it
Thanks man..God bless..saved me so much time..
00:01 Overview of Generative AI
02:31 Evolution from statistical ML to deep learning with neural networks
07:30 Transformers have led to a variety of powerful AI models.
09:59 Buddy is a stochastic parrot with mimicking ability and statistics-based predictions.
14:58 Understand Vector database and semantic search
17:21 Word to numeric representation using word embeddings
21:29 Retrieval Augmented Generation (RAG) allows fine-tuning or building AI models on specific data sets.
23:48 Using GPT-3 for querying data sources
28:24 To work with Gen AI, you need models, cloud services, and frameworks.
30:27 LLM based application using OpenAI API
34:36 Creating separate keys for different projects and managing them securely
36:55 Using LLM to generate creative restaurant names based on cuisine preferences.
41:33 Implementing Simple Sequential Chain concept in Gen AI Course
44:00 Using sequential chains to get both restaurant name and menu items in Gen AI Course
48:44 Setting up Streamlit for application development
51:15 Using response data to display restaurant name and menu items in UI
56:13 Practice coding while watching the video
58:22 Gen AI has a reasoning component for answering questions beyond its knowledge
1:02:48 Using Gen AI to retrieve information about Elon Musk's age in 2023
1:05:11 Initializing environment variables and using AI tools in an agent.
1:09:49 Using conversation chain to optimize cost and memory
1:12:15 Optimize OpenAI token cost by limiting conversational buffer memory
1:16:39 Research analysts provide detailed stock research for companies like Tata Motors and Reliance.
1:18:42 Importance of building a specialized tool over using Chat GPT
1:22:52 Using semantic search for finding relevant text chunks
1:24:56 Utilizing Vector databases for faster search and retrieval
1:29:05 Installing and loading Lang chain library in Jupyter notebook
1:31:39 Providing explanation about the movies.CSV file contents.
1:36:25 Text splitting and merging for efficient processing
1:38:35 Using Lang chain provides a simple API for text splitting.
1:43:22 Text splitting process using separators and size constraints
1:46:05 Gen AI Course explains recursive text splitter and merging for chunk optimization
1:50:23 Demonstration of using libraries to convert text into vectors
1:52:42 Using meditation and yoga to improve mental health with vector representation
1:57:30 Gen AI performs semantic search to provide results based on context, not just keywords
1:59:42 Retrieval QA with Sources Chain
2:04:06 Creating open API embeddings for document retrieval
2:06:39 Using a Vector database and creating a retrieval chain for text analysis.
2:11:06 Assembling the final project with pre-built individual pieces
2:13:10 Loading environment variables and creating basic UI in Gen AI module
2:18:20 Saving data in memory and displaying progress
2:20:46 Setting up Vector database and creating retrieval QA chain in Python
2:25:43 Automated news research tool for equity analysts
2:27:53 Utilizing vector databases for storing embeddings in large projects
2:32:07 Utilizing Google Palm and SQL Database Chain in Lang Chain Framework
2:34:10 Introduction to Vector Database and Google Palm for AI applications
2:38:14 Explaining the t-shirt records and database setup
2:40:45 Setting up a SQL database object with URI
2:45:40 Understanding the importance of correct database mapping for accurate results
2:48:17 Learning to run and manage queries in DB Chain
2:53:13 Summing of stock quantities for white color t-shirts
2:55:42 Storing data into arrays and using Hugging Face embedding for generating embeddings
3:00:34 Vector store converts input questions into embeddings for similarity matching.
3:02:52 Import SQL prompt template to generate queries.
3:07:42 Enhanced querying functionality with additional parameters
3:10:00 Creating a streamlit UI with few lines of code
3:14:54 Creating a main function in Python and running SQL queries in a database chain
3:17:27 Using Streamlet to ask and answer questions efficiently
Crafted by Merlin AI.
Great Tutorial💯 on GENAI.
I am waiting for your videos and at last get this
great course , thanks for sharing
Great explanation
thanks for amazing content
Thanks bhaiya ❤🎉
Excellent.
good one thanks. keep it up
Thank you bro.
You sound like the GFG founder Sandeep Sir ...He is my fav mentor
Thanks man
wow it is very interesting tutorial
some warnings are coming ,as the code in course compatible with earlier version. please provide the updated code. because after some time the code will stop working as well.
Please do a course on AIOps.
Thanks for this. Can u do one on CrewAI ?
Hi! Can i join data analyst boot camp now or like is there any other date to join for a new batch?
Should we create the few shot (question, query, answer value ) list manually? Or can we generate these too using llm? I mean similar statements using llm? Also, how many samples should we add ?( My question is about the contents of few_shots array)
Amazing
so this is my into to genai, what should someone go for after completing this course.like should i go on and make projects with diff models or should i go on and learn core ml..(more interested in the genai space)
sir can you give topics to explore in llms for eg: in ml and dl we focus on gradient descent like topics...what to focus in llms?
Post more Gen Ai tutorial and continue it
lab magic is not available for windows . what is the replacement for this
Very nice
Please do a Data Engineering course
I have run the codes but shows as module errors and are deprecated. How to fix this?
at the 37:24 , displayed code i tried, but got an error that your 5$ limit is out of bound, and on openai it shows i used 0$ and i followed each and every step now i feel like i am not build for coding
thanks
how to install the modules. Does jupyter notebook has a terminal of its own?. Coming from a non Cs background, Kindly help
Sir m apka y ai course lana chta hu toh aap mujha y btya beginner to advance ka course hai apka pass please send the link and sir m y bhi puchna chta hu nodejs p bhi hm ai or machine learning kar sakta hu kya
Hi codebasics team i have 1 request to make here please if possible bring affordable course on product management it is a great field to explore but there are not much content available please bring this course you will be a life saviour for many of us as well as bring it with job assistance as well.
Great content..!! Please make an end to end project using pinecone vector DB
Yes. Point noted 👍
@@codebasics yes sir , we really need it , till when can we expect a video on this?
what other project ideas we can do based on this ? It would be helpful if you suggest any ..
Can you please provide end to end real world NLP projects using techniques like POS, NER, Text classification etc.
There are no good NLP projects on You tube in other channels.
I've a simple question!
How does llm decide that the data it has do not contain answers to the questions asked by the user?
As an example, in your equity research project, let's say I asked for the stock price of a company whose data is not present in the links I provided, how will llm decide that it has no answer for that.
Can you make vedio on fine tunning LLM
Hello sir please make video on future scope in ai engineering VS data science.
If i have complete non tech background and if i want start today than what should i choose
Btw i had downloaded road maps of both field which you have provided
Sir lovely video and explanation. How is this video different from your paid course on AI? Please answer
Are you referring to our "AI for everyone" course on codebasics.io? That course has much more exclusive content than this video. You can go to our website and check the curriculum
2:27 I created this project without using Open AI models. I just used opensource models.
Hello Sir ,I wanted to devlop an Ai text to image and image to image ,please suggest me how to devlop
Need a course on mlops
can you also provide info about how to do it using huggingface and similar to it which are of free of cost. so that this project will be helpful for more people
Too good
I agree he has explained such complex topics in a very lucid easy to understand way! Thank You
What is the difference between this 3 hrs video content and your paid course ??? @codebasics
Finally Rocky bhai stayed in code basics office..All gold 🪙 kept there
Sir..your teaching style is mind blowing...Please always try to make projects using only open source LLMs because we dont have money to buy OpenAI API key and 5 doller using my email id and many of my extra email iDs ..all those 5 dollers have been exhausted and now we dont have enough email IDs to generate free OpenAI dollers. PLEASE ONLY OPEN SOURCE LLMS FOR ANY UPCOMING PROJECTS...Thanks a lot...
Point noted. In this video, there is one project with opensource LLM. I am also going to build few more end to end projects using Llama 3 and other open source models. Stay tuned!
sir, i am unable to buy credit from open AI can u please give me solution alternative for same projects, ? thanks
What is the python version used for rockybot project? Can anyone help me ?
Day 1 of asking making course video on MLOPS..🙂✨
👍
Make course on math for AI😊
is google palm still avaialble
If a student who has zero knowledge in gen Ai can follow this video or need any pre knowledge???
Hi could you please kindly make 0:11 videos on
Data cleaning
Webscrapping
Data manipulation
Data connections all concepts explained in one project shot
And also video on python for data acience and gen ai in easy method so that we could do the projects
Thank you
And also
Sir dont even know how to implement python could you please help me
please upload in hindi video on generative ai
Want to learn
to_vectorize = [" ".join(example.values()) for example in few_shots]
to_vectorize
Here is an error occured, sequence item 3: expected str instance, dict found. could any one of the team look over in it, so that it can help other students while accessing the code.
My Open AI key is not working it shows max usage done like what should i do , i used it for first time
Yes, it looks like openai has discontinued the credits. One option is to spend money, it will be probably 3$ or less so in terms of INR, 270 RS (or less) and for learning a crucial skill, I guess most of the people can spend this type of money (actually people spend such money for a lunch or a breakfast so why not on a learning project). The other thing I am planning to do is publish another end to end LLM project using Lllama2 or some other open source model, will need few days for that but I will have it published before the end of the May 2024 on this same channel
Sir i want to take the course(data analyst) of yours which costs 6300.I don't even have any prior knowledge regarding data analytics. Can you tell if the course is beginner frndly and do the projects we do will increase the weightage of my resume? Please answer to this real quick sir!
It will help for sure.
@@nagamaniv3189 thanks! 👍
outdated(for first project), you'll need to make certain adjustments.
1. Use OpenAI and langchain version as mentioned in requirements.txt if you face indexError and/or pickle error.
2. You might encounter an error where it says davinci -003 is a deprecated version, please change the model as:
llm = OpenAI(model="gpt-3.5-turbo-instruct", temperature=0.9, max_tokens=500)
The project runs following these steps as of 9th May, 2024 but issues may arise later.
For first project, you may have to pay as openai has stopped free credits but by spending only 5$ or less you can run that project. Also for the other project, let us know what exact error are you getting?
@@codebasics i am still receiving free credits from openAI. The project runs without any need to pay, provided some adjustments are made. I have edited the original comment, pls check it.
Lastly, thanks a lot for taking out time to respond, its highly appreciated!
Awesome. Thank you. LLM world is changing so fast and one need to use a common sense to make tweaks like how you did it. Good job 👍🏼
@@56_IT-B_AAKARSHROY What adjustments did you make without having to pay? Getting a RateLimitError as I try to run the first project
@@olaanthony-egorp3784 i didnt have to make any adjustments for that. sorry, my earlier comment is reflecting that. i intended to say that for different errors. i feel like its free for selected users only.
can you do a course on mlops?
Yes, point noted. Give me some time, I will publish a mini course on ml ops
@@codebasics thank you your courses are really nice
Thanks mate. This one is going big. MLOPS 🔥 waiting @@codebasics
Yes sir please
Thank you sir
Why this code is not running....it gives an error that openai has no module
@memeologicalworld8929 I am also getting same error, is this error resolved ?
Can openai secured for office data
yes. if you use Azure openai service
OpenAI has stopped giving free credits. They have mentioned this officially. Can you please give an alternate solution for it Dhaval?
Yes. You can use llama 3 in groq.com. Also just think about this, if you spend less than 5$ you can do this project with openai. We usually spend more than 5$ for dinner with friends, isn't it worth spending money on learning a valuable skill?
Sir start mlops course in hindi
Sir lauch genAI course in Hindi
I am using OPENAI first time and showing me this error code: 429 - {'error': {'message': 'You exceeded your current quota, please check your pla
I had encountered the same error and the reason is you have to buy open api key as it no longer provides the free credits for using the open api key. After I bought the key and ran the code the error was gone
@@mansibarse8806bro from where we should buy
Same error bro
@@mansibarse8806bro kitne months ke liye purchase Kiya hai api key
@@mansibarse8806 how did you pay I mean I don't get option to pay
doh, can't set up Google api keys in Europe.
GIVE US THE ROAD MAP FOR COMPUTER VISION ENGINEER LIKE AI ENGINEER ROAD MAP
Not getting free credits sir as you mentioned.
Yes, it looks like openai has discontinued the credits. One option is to spend money, it will be probably 3$ or less so in terms of INR, 270 RS (or less) and for learning a crucial skill, I guess most of the people can spend this type of money (actually people spend such money for a lunch or a breakfast so why not on a learning project). The other thing I am planning to do is publish another end to end LLM project using Lllama2 or some other open source model, will need few days for that but I will have it published before the end of the May 2024 on this same channel
@@codebasics Sir Agree- Spending around 5$ - Rs 490 for gaining $500 dollars later, is a easy bet. I already invested. I was just sharing if that's the issue.
getting stuck only becuase of API calling problem from OpenAI feeling sad , leaving whole video project now without doing. Stuck in the starting please make videos more clearly and prcisely by blurring your keys, doing each part step by step. (Not everyone is a heavy coder like you, who is watching.)
I got this error when running the code to store vector index create in local, been searching many sources but still couldn't solve the issue, could you kindly help take a look, thanks in advance !
"TypeError Traceback (most recent call last)
in ()
2 file_path="vector_index.pkl"
3 with open(file_path, "wb") as f:
----> 4 pickle.dump(vectorindex_openai, f)
TypeError: cannot pickle '_thread.RLock' object"
Hi did you solve this issue
I have same one
Not sure if you resolved this but may be this is happening because something non serializable in FAISS output. I took a workaround to complete this tutorial. Instead of saving to a file, I used local vector store. Use this code snippet
# Save the vector into vectorstore instead of a file:
vector_store_openai = FAISS.from_documents(docs, embeddings)
vector_store_openai.save_local('vectorstore')
#Retrieve it from vector store instead of a file:
vector_store_local = FAISS.load_local("vectorstore", OpenAIEmbeddings(), allow_dangerous_deserialization=True)
chain = RetrievalQAWithSourcesChain.from_llm(llm = llm, retriever = vector_store_local.as_retriever())
Can i learn this. I know little bit about python
yes