You can use any gui module like tkinter or others to create it. Backend functions will be same. You can check how to deploy ml project for more information
@@HackersRealm thanks for the reply! i'm trying to deploy the model,running into a lot of errors.do i need to set up twitter api for real time tweet collection?
Thanks you very much sir for making amazing video .sir I have request to you to make a video regarding future engineering and feature selection . thanks
First of all thanks for such amazing explaination, But I want to ask you that from feature extraction step you didn't use datavisualization or list of hashtags you created. I have done the same whole code as well as second time after preprocessing I jumped on feature extraction and both gave the same output in f1_score and accuracy_score!!! So can you explain how bag of word has helped in classification??? In which step they classified positive and negative tweets?
Glad you liked the video!!! hashtag won't give us meaning results as it doesn't contain the actual tweet, so i didn't use that. bag of words are used to identify the set of words that considers positive or negative. Initially it's available in dataset, after that it will try to predict it.
Yes sir its reallyhelpful, one week i stuck in this program but i got a solution now do more like this sir if you don't mine post tutorial video of adv python its more helpful for beginners lyk me once again tq sir.
Sir, in sentimental analysis positive words are happy like that and negative words are sad like that what we consider if the word is not happy .it's a positive side or negative side sir
Facing issue regarding installing the wordcloud.... " ERROR: wordcloud-1.5.0-cp34-cp34m-win_amd64.whl is not a supported wheel on this platform. " how to fixed it?
Hello Sir! I hope you're doing well, Sir I got an error when I typed this command: df1['clean_tweet'] = df1['clean_tweet'].apply(lambda x: " ".join([w for w in x.split() if len(w)>3])) AttributeError: 'float' object has no attribute 'split' I would be grateful if you would help me out a little :)!
@@HackersRealm I am working with a different dataset indeed but I've checked the datatype of the column using the info() command and it shows object datatype. So I think this shouldn't come up with an attribute error but it still shows that error.
@@HackersRealm Sir my problem got solved! I did a small conversion of x.split() into str(x).split(). It gave me tweets without short words successfully :).
@@HackersRealm It's redirecting to analytics vidya and when I go to github and try to access dataset its telling can't open....It says can't show files that are this big right now ..and open raw data like that
Hey I would love to get in contact with you as I need just a bit of help in my dissertation for my Masters, if you won’t mind of you of course. Thank you in advance
Big thank you Ashwin, it helped me do a project overnight.
Glad it was helpful!!!
Same here !!
great tutorial!! can you tell me how would we go about making a gui for this model? using gradio maybe?
You can use any gui module like tkinter or others to create it. Backend functions will be same. You can check how to deploy ml project for more information
@@HackersRealm thanks for the reply! i'm trying to deploy the model,running into a lot of errors.do i need to set up twitter api for real time tweet collection?
Thanks you very much sir for making amazing video .sir I have request to you to make a video regarding future engineering and feature selection . thanks
Noted, I will create seperate video for feature engineering
+1
Thanks for the caption it helps a lot !!! Send hi it to Brazil.
hey!! great work....just wanted to know which algorithm did you actually use in above video
It's logistic regression
Sir please make some more advanced project like this for cse students
yeah sure, I will be making more projects!!!
did u know how to download the dataset ? help me out of this
Are these too basic to put on cv?
Thank you so much.You made me understand complex problem to simple.Hats off..keep going.Can u make video on choosing statistical test.
sure, I will make separate videos for the concepts!!!
First of all thanks for such amazing explaination,
But I want to ask you that from feature extraction step you didn't use datavisualization or list of hashtags you created. I have done the same whole code as well as second time after preprocessing I jumped on feature extraction and both gave the same output in f1_score and accuracy_score!!!
So can you explain how bag of word has helped in classification??? In which step they classified positive and negative tweets?
Glad you liked the video!!! hashtag won't give us meaning results as it doesn't contain the actual tweet, so i didn't use that. bag of words are used to identify the set of words that considers positive or negative. Initially it's available in dataset, after that it will try to predict it.
@@HackersRealm Got it!!! Thanks you so much!!!
can i use the same pre-processing procedure for SVM,naive bayes and random forest model?
yes you can
thank you for a clear explanation
Happy to Help!!!
Sir you said the objective was to detect hate speech in tweets. so what can we conclude from the results? I am a little confused.
the negative reviews we are classified are hate speech, using this model, we can able to identify that
@@HackersRealm what does the accuracy scored show us in this case?
@@ephrembekele5241 how many tweets we predicted correctly using the model
Which algorithm is used in this process which u have explained
Tq sir its more helpuful for my project
glad it was helpful!!!
Yes sir its reallyhelpful, one week i stuck in this program but i got a solution now do more like this sir if you don't mine post tutorial video of adv python its more helpful for beginners lyk me once again tq sir.
@@mouskey advanced in python or data science?
@@HackersRealm both
@@mouskey sure, planning to do that!!!
How can I classify it as neutral as well?
and
How can we integrate the model into a web app?
you have to use the dataset that has neutral class and use flask to integrate in web app
Can you recommend a book for python and machine learning?
thanks very much brother, good luck
Always happy to help!!!
Hello sir, i have an issue downloading wordcloud even after installing c++ build tools , what could the issue be
what error you're facing while installing?
how can we get confusion matrix eg precision, recall, f1 scores?
you can use classification report module to get that
Can You Please Make video for this? "Automated Classification of Societal Sentiments
on Twitter With Machine Learning"
I have done a video on real time twitter sentiment analysis. you can check if that's the case
How do you get that dataset?
How do I get data directly from the Twitter tweets?
Please suggest way for that.
the dataset can be downloaded from the links in the description. For real time, twitter analysis, I will make a video in the upcoming weeks
Sir I am a btech first year student. can you tell me how can we get current tweets from twitter in csv file using python?
You can use tweepy to get current tweets; You can also check realtime twitter sentiment analysis in the playlist
Please make video on live tweets analysis using machine learning
Yeah, will do that soon
It will create data leakage problem if we get BOW before splitting the data into train & test.
i have to do research paper , where can i find whole code. because it was not there on github
it's available in github... go to machine learning project repository and find the folder with title
Since the data was imbalanced, you should use oversampling technique
Hlo sir, sorry for disturbing you i have one doubt if the letter is not happy which kind of senmential the code will take positive or negative?
i didn't get you, can you rephrase it!!!
Sir, in sentimental analysis positive words are happy like that and negative words are sad like that what we consider if the word is not happy .it's a positive side or negative side sir
@@mouskey it may consider positive, to overcome these limitations, we may go for lstm models
@@HackersRealm okay sir tq for ur valuable reply, Sir in this video you use lstm?
@@mouskey No, I have used a machine learning algorithm, check fake news detection project, I have used lstm in that
Sir , could you please tell me the code of movie review in twitter sentimental analysis and the project uses also.
the process remains the same for any kind of sentiment analysis
@@HackersRealm tq sir
I want to make a project on detection of self harming or Sucidial tweets
Can you help me with the knee osteoarthritis
I didn't understand, could you please explain more details about this
Sir on df['clean_tweet'] = np.vectorize(remove_pattern)(df['tweet'],"@[\w]*") when I run this code the output for clean tweet shows none
How to rectify this error
please check whether the data is loaded
Thank you sir ..When I remove the '\w' the output run without error and showed all cleaned tweets
@@AIResearchTechniques Glad to hear that
@@AIResearchTechniques i am facing same issue can u help me
Sir is this a project for CSE or ECE
we can't specify any department for the projects, anyone can use based on the applications
hello sir , why cant we do logistic regression directly ? why we using nlp ?
we cannot give text data as it is, as the model can't understand. It can only get information through numbers.
Sir how to use SVM instead of logistic regression do you have code or can you please explain
replace the model name with svm model, that's it
Your data has label for 1 as racist(negative) and 0 denotes tweets as not racist(positive) .So what did you consider for neutral tweets??
This dataset doesn't have neutral, you can use other tweets dataset for 3 classes!!!
sir can we bert model ?
Yes but you have to use corresponding preprocessing methods for it
@@HackersRealm thank you
Can we apply naive Bayes ?
yes we can apply
Thank you 😊
Happy to help!!!
كيف يمكن الحصول على جدوله البيانات من النص الكلمات ام من اين ومن لا يدخلنا csv
Bro why i can't use PorterStemmer? Is there any that i need to install?? Please help
you can use that if you installed nltk package
@@HackersRealm but already installed bro
@@floweraddictxx6238 then it will work, it has all the modules
Can you please tell me from where I can Download the Dataset
you can get it from link provided in description or github
Hello sir..i got an error while visualisation the frequent words..it says that only supported for Truetype fonts..plz help me
are you using different dataset?
@@HackersRealm yess
@@RiyaSalvi-q4e the please check the type of the column and may be change to strings
My dataset has all objects.. so i need to convert them in string? Then this problem will get resolve?
@@RiyaSalvi-q4e yes most likely!!!
Facing issue regarding installing the wordcloud....
" ERROR: wordcloud-1.5.0-cp34-cp34m-win_amd64.whl is not a supported wheel on this platform. "
how to fixed it?
try install visual c++ build tools and retry the command
could you please tell me how did you load the dataset i am getting no such file error
please check whether the file is in the same directory or not
Why we use "np.vectorize" in twitter handle removing
i just showed different ways to pass values to the functions. It's not compulsory to use this
Thanks buddy
Glad it was helpful!!!
Can you help me , i have assignment I have to convert before August 20 😭 about nlp sentiment analysis Tweet
Which part you need help?
@@HackersRealm about sentiment analysis with naive Bayes
@@LTRA-r2o you can use the same flow and change the model for this
Hello Sir, Please help me to download the dataset its not downloading
You can get it from the github repo as well!!!
did u made the regex tutorial?
No Not anything specifically yet!!!
How to get a label on our individual dataset from Twitter?
You can use pretrained model or you have to manually label them by yourself, if you want to create a complete dataset
@@HackersRealm Thank you, but what that label mean? Is it important for research, because I am using my data for thesis
@@Saboor-Hamedi label is the output column which will be used as result
@@HackersRealm How to get that results? I was asking about that
Sir I am getting an empty array for the function of extracting hashtags how to resolve this
are you using different data or same?
@@HackersRealm a different one I have scarped the data myself
@@ghosthanded then you may need to change the processing steps accordingly
@@HackersRealm can you give me a reference for it?
Can't find the CSV file in any links, it would be convenient if just put the link in the description directly.
The dataset link is in the description, you can get it from analytics vidhya or you can get it from github repo too, Please check and let me know
Found them, thank you.
There is error while creating graph unable to create graph by this process
which part you're getting error?
sir not able to get the dataset from the provided link
you can get it from github repo also
hey, i am getting error in the 6th step (remove @user)
what error it is showing?
Hello Sir! I hope you're doing well, Sir I got an error when I typed this command:
df1['clean_tweet'] = df1['clean_tweet'].apply(lambda x: " ".join([w for w in x.split() if len(w)>3]))
AttributeError: 'float' object has no attribute 'split'
I would be grateful if you would help me out a little :)!
can you rerun the code from the start? or you're using different dataset for this project?
@@HackersRealm I am working with a different dataset indeed but I've checked the datatype of the column using the info() command and it shows object datatype. So I think this shouldn't come up with an attribute error but it still shows that error.
@@samreenshamim8161 I think the column may have null values, try to remove null values and proceed
@@HackersRealm okay Sir I'll try 😊
@@HackersRealm Sir my problem got solved! I did a small conversion of x.split() into str(x).split(). It gave me tweets without short words successfully :).
please help me out from this i cant download the dataset , please help me .........
you can download the data from github too, try it
@@HackersRealm got it thanks
can't find dataset sir ..It's redirecting to some site.
you can find it in the github repo
@@HackersRealm It's redirecting to analytics vidya and when I go to github and try to access dataset its telling can't open....It says can't show files that are this big right now ..and open raw data like that
@@srishtimishra5101 In github, you can download the file and use it. or reach me over insta or linkedin, I will share the data
@Srishti Mishra if made the project can you plss share the link of datasets .
where can i get the dataset
you can get it from the link in the description!!!
Please provide the dataset file, it can't be found!
Please check the description or download it from github repo
i don't find CSV file
please check the github link or dataset link
Hey I would love to get in contact with you as I need just a bit of help in my dissertation for my Masters, if you won’t mind of you of course. Thank you in advance
you can book a consultation using the link in the description or reach me via insta or linkedin, Thanks!!
Can you pls share this code here
Please check the github repo for the code, link in the description
how to download dataset?
link is in the description
but i didnt found dataset there
@@roshnimustafa8051 you have to register in that website to get it or you can get it from github repo link too
Dataset?
you can check the github repo!!!
@@HackersRealm It is showing that " we can't show the files that are this big right now"
@@afridmohammed6711 You can download the file and view it or you can use other link to download the file
Hey did you got the dataset