Chat Bot With PyTorch - NLP And Deep Learning - Python Tutorial (Part 1)
Вставка
- Опубліковано 5 жов 2024
- In this Python Tutorial we build a simple chatbot using PyTorch and Deep Learning. I will also provide an introduction to some basic Natural Language Processing (NLP) techniques.
1) Theory + NLP concepts (Stemming, Tokenization, bag of words)
2) Create training data
3) PyTorch model and training
4) Save/load model and implement the chat
Resource:
This tutorial was inspired and adapted from the following article:
"Contextual Chatbots with Tensorflow": chatbotsmagazi...
✅ Write cleaner code with Sourcery, instant refactoring suggestions in VS Code & PyCharm: sourcery.ai/?u... *
📚 Get my FREE NumPy Handbook:
www.python-eng...
📓 Notebooks available on Patreon:
/ patrickloeber
⭐ Join Our Discord : / discord
If you enjoyed this video, please subscribe to the channel!
NLTK:
www.nltk.org
You can find the code on GitHub:
github.com/pat...
PyTorch Beginner Course:
• PyTorch Tutorials - Co...
Please checkout my website to see all tutorials:
www.python-eng...
You can find me here:
Twitter: / patloeber
GitHub: github.com/pat...
Icons:
fontawesome.co...
fontawesome.co...
#PyTorch #NLP #DeepLearning
----------------------------------------------------------------------------------------------------------
This is a sponsored or an affiliate link. By clicking on it you will not have any additional costs, instead you will support me and my project. Thank you so much for the support! 🙏
You are the best!! Among all the youtube videos about chabot , you are the only one to explain step by step the fundamentals of coding a chatbot.
glad you like it!
Very clear. Much better than the later tutorials. I understood the meaning of tokenization and bag of words when you demonstrated what happens during the execution of the code.
You can tell the difficult theory to the easy one,you're the master!😁
Such a good explanation, seriously anyone with a negative IQ can also understand!
Never stop uploading please :)
thanks so much!
.👆Friendship often ends in love; but love in friendship
I saw many videos but your explanation is great.
Glad to hear that :)
Waited for months from your last series on pytorch :). Please make videos on NLP with pytorch
yes I finally got around to do some pytorch tutorials! part 2,3, and 4 will be released in the next 3 days. I hope to do even more NLP in the future
Oh man I love that, I'm working on a chatbot based project and these videos will definitely help me
glad to hear that!
I am really happy to see your efforts. You have done a great job. thanks sir
thanks!
Very informative and explains everything! Please do more videos like this!
Amazing tutorial, I've no idea about ML or DL, but the video is crisp enough to make understand everything 😊
Glad to hear that!
thank you so much for this helpful video! would you consider teaching how to implement a GUI along with it?
Yes good suggestion! I’ll consider it
you made it much easier for me , great job
Beautiful Explanation bro! just wow!
glad to hear that!
Watched this video... And boom 💥 SUBSCRIBED!!! 😍
yeah thanks a lot :)
thank you so much for a wonderful tutorial! by the way, I was curious as to which vscode theme you were using-i find it very nice!
.👆look at the girls
This is really awesome. After this I want you to develop a machine learning model and deployment using flink kafka hadoop
I will have a look at this...
@@patloeber Please have a look. It will be like a big data archteciture for a bank where each transaction will be monitoried
I like it. Thank you! Is this rule-based or learning-based (retrieval or generative)?
It looks like training dataset is same as test set, am I right? Using an AI method to recognize the chat instead of using "if--else" structure.
great video man. Really helpful for my course project. Thank you.
Sir, thanks for this video seeing this video has made me love love NLP. I was looking for where to specialise in. Thanks 👍
you sound a lot like Kumail Nanjiani. Great video btw
Not at all weeb
This tutorial is more german than Germany itself. But great tutorial anyways!
Haha thx
lucky you, you haven't experienced bavarian English xD
Nice video, thanks! Just one question: Is this bag of words methode really also how chatbots (as far as I understand also assistants like siri?) with huge amounts of data work. So apple really has millions of tag with possible inputs that can be labelled to one of the tags like "greeting" and so on? Hard to imagine, since it would be such a long way for it to work well :O
I guess they are self learning bots ,they don't have huge data chunks they rather learn as they progress talking with you
no they use much better method like word2vec.
very clear and easy to understand..thank you for this tutorial :)
Thanks! Glad you like it
Really great!! Keep uploading.
Hey,
Can you build a notification reader(who speaks what's the notification) using python...?
By the way
Your videos are just awesome ❤️
Glad you like it! Will add it to my list
Very helpful video and implementation is very clear, Thanks Man
glad you like it!
This is a nice video man!, I was hoping if you could do also a chatbot in web? Thank you so much for the effort
Nice - thanks for taking the time to make the video
Love your playlist on this! Can we use Word2Vec instead of Bag of Words for word embedding?
Can you also show how to do entity extraction in a video or a blog post?
I am trying to do this code on google colab but facing some issues like how to creat environment or use pytorch there, can you guide me through? also getting errors on tokenizing(sentence)
Can I work on this project in jupyter notebook
Thank you so much for this great project! I have a slight doubt... In 20:21 part of the video, when we are running the stem function, why doesn't the output show `['organiz', organiz', organiz']` because when you were explaining the concept of stemming you had shown another example where the words universe and university were stemmed as univers and univers repectively
I watched all parts and Deployment. I executed also. Amazing work, thank you for sharing 😍. One funny thing I noticed is coffee and tea delivery needs 2-4 days🤣.
this course is amazing!!! I'm familiar with python, but have no any experience on ML.
any prerequisites for building the chat bot? TensorFlow Tutorial or PyTorch Tutorial both are needed?
Great job, thank you so much
Glad it was helpful!
@@patloeber I would like to ask you for a favor, how may I find Covid19 psychologic Dataset other than Kaggle. Thank you in advance
Thank you very much for this video.I always search to find this kind of explanations and knowledges.You are really great :)
thanks :)
I am chemist actually .I ve learning python and machine and deep learning and NLP for 3 years.I rarely need to help but sometimes I really need too but there is nobody to ask
Very easy to follow. Very good explanation. Thank you very much.
Please make a chatbot more advance using rnn And other techniques
Thanks for the instructive content! Can you tell me what editor/ IDE you use with python?
I use VS Code. I have a tutorial about my editor setup on this channel :)
Danke für das tolle Video.
Ich habe einen Fehler, würde mich über einen Kommentar freuen
line 134, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.
This probably means that you are not using fork to start your
child processes and you have forgotten to use the proper idiom
in the main module:
Vermutlich unter Windows, num_workers=0 for the DataLoader, and use if __name__ == "__main__" could be tried to solve this
very understandable
Hey, I’m creating a twitter bot that searches for tweets that indicate suicidal tendencies and I want to implement an AI that identifies this kind of tweets.
That’s an awesome application! I have a tutorial where I set up the titter api if you want to have a look at that: ua-cam.com/video/yCYPzoG25ak/v-deo.html
could u add about how to link database for storing different credentials
Thanks a lot keep up the good work
Thanks!
i know this might not be seen but at 14:10 in the stemming stage why did the 'e' get chopped off form the word 'anyone'?
I believe this is a mistake
Many Thanks!!
great video !! just one doubt what do i have to specify in data.pth
Thank you so much for this great project! I have a slight doubt...Every time I import a new package like numpy or random on my VS Code, my system isn't able to read it. It says 'ModuleNotFound' I tried everything from changing to path to reinstalling multiple times but it doesn't work. Please help me out with this. Thank youu
having the exact same problem for installing and importing anything. did you find any general solution?
PS C:\Users\Jane_Brit\Desktop\ProjeTasarimi\ChatBot> conda activate pytorch
Could not find conda environment: pytorch
You can list all discoverable environments with `conda info --envs`.
I'm getting an error like this. Can you help?I'm getting an error like this. Can you help?
The environment is not created so it gives an error that way
14:49
yes before is theory :)
This is a great explanation!!
I have one doubt...what should you include in your intents file so that the bot responds with some default message every time it does not recognize a sentence asked by the user
I implemented this in part 4. You don't need to put the default message into the intents. You can simply put it in your code and whenever the probability for intent classification is not high enough, you can return the default message
genial, gracias por la informacion
Will it answer questions regarding Home Remedies?
hey there great tutorial! i'm having just one problem, when stemming the words when i debug i always get 'None' as a result
Good video sir, can I use pyttsx3 on this model?
What a great video
thank you!
This is really great tutorial, and currently I have a problem about using TF-IDF instead of boW, anyone has any resources to figure it out, please? I will appreciate it!
Do I need to learn pytorch before I learn this??
Hello! can you create a video on how to create a bot on facebook user account not on page using python or js ?
What IDE are you using? Great video!
Vs code
Just a quick question what is the IDLE used in the video? Could I just use pyCharm.
I use VS Code but Pycharm is great, too :)
I reckon this might be a dump question, but NLTK is that minded for english only?
Thanks so much. It was very understandable. But every time I put a new package in python and run it, it still says Module not found error.
can we get the slides you used for the theoretical parts?
Great tutorial! The bot works perfectly fine! Is there any chance you could recommend any german stemmer which works as simply as the PorterStemmer? Really struggling to get this bot to talk german with me....
spacy has german lemmatization support, which is better than stemming anyway. You can also try to skip this part and see if it works without it
is it possible to recive files(upload files) from a bot like pdf and word file?, I found no tutorials teaching that concept
If I wanted to make this bot only respond with questions and never anything other than a question, would it be possible to train it with just the intent file or would I need extra code?
Should work with the intent file
What kind of algorithm did you use for this entire system? I hope you can reply.
Hey ! Can u add button response in this ?
Can we run this without setting up a virtual environment? If yes, how?
Yes you can, just install it with pip. This will install all packages into your main Python site-packages folder
What if you misspell a word? Does bow take it as a 0?
Which model of chatbot is being used here in this chatbot and why? Please reply
Is it necessary to create a virtual environment
Hi! I'm an early beginner to coding in general. I too am trying to create a chatbot I can use for my website. I just don't know which IDE to use. Which one is Mr. Loeber using in this video?
Hi all,
i'm getting a error while downloading punkt, i searched everywhere but no answer ,please someone give me a alternative
[nltk_data] Error loading punkt:
Hey ive seen all your videos for chatbot and even made specifically for my needs, however I just want to ask how do you break into new line in chatbot UI, what to write in intents.json to break in new line in chatbot UI??
May I know Which platform he is using for coding? Please help
how can we add voice recognition in the chatbot?
and how and where should I put the code ?
Why not lemmatize vs. stem?
Great explanation buddy !
Hi Python Engineer may I ask what kind of neural network did you used in this project thanks !
Up i want to know too. thanks
A very simple feed forward neural network with linear layers and relu. The key here is in the data preprocessing! Feel free to try out a more complex model :)
@@patloeber Thanks I would just like to ask also if it is still a feed forward neural network even though you use back propagation?
thnx
Sir please tell what are the primary things to be downloaded to work with this project
you can clone this repo and follow the installation guide in the README: github.com/python-engineer/pytorch-chatbot
Best programming channels I know :
She online classes Arduino
Python engineer
Edureka
thanks!
For some reason, my print statement is not working. nothing is being printed yet I dont get any error
How to train a model to attach a transformer?
Which editor have you used sir?
what good is a chatbot in a terminal?
How do you check the accuracy and model summary in pytorch
can it do followups?
multi-language support?
Is there a way for a chatbot to answer questions and select responses that have been predetermined through a database we have created? If I saw your video, the chatbot still answers and responds to questions manually according to what is written in the code. I want to make it able to answer and determine its responses online through the database
which ide are you using
He used Microsoft Visual Studio Code
Great video, But I get an error from testing stemming...... stemmed_words = [stem(w) for w words] ...... The error is invalid syntax Perhaps I forgot a comma? Anyone know whats wrong? Keith
how to integrate this chatbot to our website?
Hi python engineer, do you know the ideal epoch batch size for small training data of less than 50? I want to ensure that the model is not too 'strict when making prediction. How do I do that?
You have to try it out :) maybe 4 or 8, or even without batches
@@patloeber Thankewww >:)
Hello Patrick, How Can I Stemm in Spanish?
Is it retrieval based chatbot?
U r amazing