Just an addition in the above video. At 2:55:32 to resolve the error add "("scaler",StandardScaler(with_mean=False))" to cat_pipeline. It is not mentioned in the video
For some reason, I cannot make the 'pip install -r requirements.txt' work (roughly at 36:40 something in the video). I have successfully done (a few times already!) the steps before, I made sure I selected the venv environment in terminal but I don't understand what the issue is. If I got it correctly, 'pip install -r requirements.txt' should instruct setup.py into creating the packages as defined within the requirements.txt file. Krish, do you first need to run setup.py before 'pip install -r requirements.txt' maybe? I am kinda stuck and have been for a few days as I don't understand what am I doing wrong. Any guidance would be much appreciated, as I love this video and I find it amazingly inspiring onto my quest for understanding what a proper end-to-end data science project may be. Thank you very much in advance!
After quite some banging my head against the wall, I have eventually fixed it! Just in case somebody would need this, I literally just needed to save the setup.py and requirements.txt files, as otherwise trying the 'pip install -r requirements.txt' would have resulted into having a blank command to a blank setup.py file. The solution is unbelievably simple, I feel like an idiot for such a setback... but hey, isn't the whole point of this whole project to learn something new, isn't it? 😅
fit_transform is used for learning the transformation parameters from the training data and applying the transformation to the same data. transform is used for applying a previously learned transformation (calculated from the training data) to new, unseen data. It assumes the transformation parameters are already available and fitted on the training data.
Hi Krish Sir, what is the difference between course with Ineuron and Pwskills data science? As I see both of them offering the same course materials but the cost is certainly different.
Hi Krish, thanks for the video! It's a excelent material! I'm just missing the part to create the training pipeline, did you have a intention to do that? Thanks again!
You said more data science interviews are about end-to-end ML projects. What are the type of questions asked? Is it part of take home assignment? Thanks
did anyone else get "Internal Server Error The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application." when tried to predict on url provided by elastic bean stalk
quick question, converting the jupyter notebook code to the whole classes and modules, what is it called? and what are the industry terms for jupyter notebook code and the data ingestion and data transformation classes called
hlo sir while writting this cmd (conda create -p venv python==3.8 -y) i am getting the error as it is showing ('conda' is not recognized as an internal or external command) so what should i do next to complete this process plz do help me sir....
Hey brother your anaconda is not installed global in your computer. you can use anaconda prompt to do this. first open anaconda prompt after write this command. conda create -p /path python==3.10 -y
hello Krish, I am still stuck on setup. I don't know why i can't run the 'typing' module. it keeps throwing errors. please can anyone throw more light on it?
Data Scientist ka course jitna bhi kar lo.. jab job search karte hai recruiters/ agency always demand for an experienced person then Data Scientist ka course and certificate waste hi lagta hai...isse acche ki koi aur course kar lo like web development, android n all these stuffs isme kam se kam freshers ko recruit to kar lete hai.
ValueError: Expected 2D array, got 1D array instead: Reshape your data either using array.reshape(-1, 1) if your data has a single feature or array.reshape(1, -1) if it contains a single sample. i am getting this error in model trainer part, can anyone help ?
I am getting an error after i run app.py on browser saying predict_pipeline.py line num:[18]] error message:[Found unknown categories [("master's degree",)] in column 2 during transform] can anyone help
For some reasons that I don't understand, I'm getting errors when I execute "pip install -r requirements.txt" command in the cmd but not in powershell. Few times it's working but couldn't figure out what's going wrong.
Hi Krish, I have a macbook and I am new to Data Science, is there going to be a difference during running some files in my macos?, I have completer first part but it does not show any changes after commit.
can anyone solve this error : src.exception.CustomException: Error occur in python script name [D:\ML PROJECT\src\pipeline\predict_pipeline.py] line number [20] error message [Found unknown categories [None] in column 1 during transform]
Guys not well...so I have combined the previous project videos u can watch till than..
Get well soon♥️
Tc krish
Krish please take care of your health first,we can wait for your videos
But first be 💯 percent fit
Wish you a speedy recovery
Thanks so much..and love the music
Get Well soon sir i was waiting for the next part, no issue when you are feeling well we can continue.. love you sir🥰
Just an addition in the above video. At 2:55:32 to resolve the error add "("scaler",StandardScaler(with_mean=False))" to cat_pipeline. It is not mentioned in the video
Thank you Bro
One of the BEST end-2-end MLOps training video. Thank you very much!
fit_trandform :- calculate a parameter then transform the data where as fit.transform use a parameter then transform the data.
noice
I can't describe the excitement and amazement I am feeling watching an applying the steps!
I have been waiting for this video for 2 years, thank you Krish.
Great Krish sir... enjoying learning from you... thanks for everything
Just done follow and implement the project ! Thanks alot for this video Krish ! Very easy to understand and cover the general in details !
Hi Krish Sir.
You are one of the best Data scientist Guru from India for whole world.🎉
Thanks a Lot
Sir apne itni mehnat ki hain, thank you dil se
Sir, I'm big fan of yours. You are truly genius. Love from London.
Thanks for sharing this material. It is very well explained!
Thanks so much. I have taken many data science courses and never heard "end-to-end deployment" until I joined your course. I really appreciate it.
go to campus x
@@not_amanullah😮
Wonderful sir. Now that's how you do Data Science.
this was A MUCH NEEDED VIDEO! PLEASE MAKE MORE VIDEOS LIKE THIS
wonderful.... finally completed the whole project....
This is super helpful. Thank you for everything sir .
Really great effort.. Loved and learned a lot in this bro.. Thanks
For some reason, I cannot make the 'pip install -r requirements.txt' work (roughly at 36:40 something in the video). I have successfully done (a few times already!) the steps before, I made sure I selected the venv environment in terminal but I don't understand what the issue is.
If I got it correctly, 'pip install -r requirements.txt' should instruct setup.py into creating the packages as defined within the requirements.txt file.
Krish, do you first need to run setup.py before 'pip install -r requirements.txt' maybe?
I am kinda stuck and have been for a few days as I don't understand what am I doing wrong. Any guidance would be much appreciated, as I love this video and I find it amazingly inspiring onto my quest for understanding what a proper end-to-end data science project may be.
Thank you very much in advance!
After quite some banging my head against the wall, I have eventually fixed it!
Just in case somebody would need this, I literally just needed to save the setup.py and requirements.txt files, as otherwise trying the 'pip install -r requirements.txt' would have resulted into having a blank command to a blank setup.py file.
The solution is unbelievably simple, I feel like an idiot for such a setback... but hey, isn't the whole point of this whole project to learn something new, isn't it? 😅
@@69nukeee thanks a lot, you are live saver
@@69nukeee man thank you so much i literally was breaking my head thinking of this issue u saved my time thanks alot
@@69nukeeethank you brother for 2 hours i been trying but nothing was working but this tip helped mann🎉
And I hope you are fine now. May God bless you with happiness, prosperity and what ever you want 🥰
Thanks for the video Krish. Appreciate if you could tell us mac compatibility commands / steps to perform
God bless you sir... For teaching us 🙏🙏
Great work sir
Sir how can we rank the students based on their scores . Can you please make a tutorial in continuation of this project. I found it very useful .
Thanks for explaining end to end data science project
fit_transform is used for learning the transformation parameters from the training data and applying the transformation to the same data.
transform is used for applying a previously learned transformation (calculated from the training data) to new, unseen data. It assumes the transformation parameters are already available and fitted on the training data.
Hi krish , when will we get the part 2 of this playlist to get to know about CI pipeline.
Thanks in advance.😊
I was just about to comment this
Hi Krish Sir, what is the difference between course with Ineuron and Pwskills data science?
As I see both of them offering the same course materials but the cost is certainly different.
Thankyou for your efforts sir, this tutorial really helps to learn alott.
@Krish Naik
All steps followed exactly how it was shown on screen receiving an error when running the code " pip install -r requirements"
I follow the same steps and code but my artifact file didn't get created
Hey Krish, thanks for the video!
Wouldn't it be better to use pipenv for the venv and package management?
Thanks for the video.
Get well soon sir, our prayers are with you
Thank you so much Krish sir.
Hi Krish, could you please create a playlist on polars library and how it is better than pandas in terms of speed?
Hey khrish, do you have a vscode / Git hub tutorial?? Would be very helpful thanks. Great vid btw!
I am getting an error "No module named dataclasses" . and i am unable to pip install also.. Can anybody help?
Hi Krish, thanks for the video!
It's a excelent material! I'm just missing the part to create the training pipeline, did you have a intention to do that?
Thanks again!
Already written the code in data ingestion
You said more data science interviews are about end-to-end ML projects. What are the type of questions asked? Is it part of take home assignment? Thanks
Thank sir for the great help
I did fsds course and I learned end to end I got a job also as an ml engineer. Now I am revisiting the same in this video to learn something new.
congs bro
Sir music in background is irritating please dont add next time
Why are we preprossing entire dataset first and then doing test train split ?? Wouldn’t it cause info leakage problems?
Namaste,krish naik...i am a fresher and wanted to ask what skills in AIops should i learn to begin with.
Great work Krish 👍 please make a end to end project in Pyspark.
did anyone else get "Internal Server Error
The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application." when tried to predict on url provided by elastic bean stalk
quick question, converting the jupyter notebook code to the whole classes and modules, what is it called? and what are the industry terms for jupyter notebook code and the data ingestion and data transformation classes called
Can u guide me how to upload csv data and other materials which u have added here?
great video
DataFrame.drop_duplicates(subset=None, keep=’first’, inplace=False)
Sir can you please make a video Diabetic retinopathy using deep learning project?
How to create Amazon elastic beanstalk? It is not the same as how you are creating in video.
which vs code theme you are using
Sir you are the best ❤
Hi krish can you please create more end to end projects thanks
Thank you so much sir
what is the title of this project
-e . Red he aa raha hai 2 ghante se try kara hu error he nhi samj raha🥲
grt work sir
Why we are following this approach even when we can do this implementation using jupyter so much easily and faster.
hlo sir while writting this cmd (conda create -p venv python==3.8 -y) i am getting the error as it is showing ('conda' is not recognized as an internal or external command) so what should i do next to complete this process plz do help me sir....
Hey brother your anaconda is not installed global in your computer. you can use anaconda prompt to do this. first open anaconda prompt after write this command. conda create -p /path python==3.10 -y
hello Krish, I am still stuck on setup. I don't know why i can't run the 'typing' module. it keeps throwing errors. please can anyone throw more light on it?
Thanks 👍
Awesome
Sir can I add this project in resume..
What are the basic knowledge required to do this project
Do you know why he uses StandardScaler for the categorical features?
Krish, will u upload your new recorded content to tech neuron or not ? Its been 5 months now asking this qsn and got no update yet ??
Hi Dear. You can avoid background music which is highly irritating and leads to skip your video.
Do we need to do all this work every time we pick up a new project? Please help
Still im getting this error also from src.logger import logging ModuleNotFoundError: No module named 'src'
And exception also
try changing src.logger to logger
could you solve it??i am also getting same error
but logger is not a module
@@lintopanto7892
@@piyushtiwari1712 Dude, I'm getting the same, can't solve it, did you found anything?
There is an error when predicting the math score as "CustomData" is not defined. Could anyone help? Thanks in advance
Sir module error arha hai kernel active he nahi ho raha numpy pandas etc Jo hai wo run nhi horahe
Data Scientist ka course jitna bhi kar lo.. jab job search karte hai recruiters/ agency always demand for an experienced person then Data Scientist ka course and certificate waste hi lagta hai...isse acche ki koi aur course kar lo like web development, android n all these stuffs isme kam se kam freshers ko recruit to kar lete hai.
"conda install jupyter" - those who are struggling to run jupyter notebook on vs code by your venv, first install jupyter in your vevn. Thanks!
why column name mentioned as 'math_score' as per dataset it should be 'math score'
ValueError: Expected 2D array, got 1D array instead:
Reshape your data either using array.reshape(-1, 1) if your data has a single feature or array.reshape(1, -1) if it contains a single sample.
i am getting this error in model trainer part,
can anyone help ?
were you able to resolve this issue, I am facing the same problem?
Use df.reshape(-1,1) if your df is a DataFrame object else use df.values.reshape(-1,1) where df is your dataframe name.
data class is used to design hold data values
PW data science course is good it's cover all topic basic to advanced?
Its a full project or some part is remaining in project completion
Sir can i get the dataset link u have used in this project
can I make this project on jupyter notebook?
I am getting an error after i run app.py on browser saying predict_pipeline.py line num:[18]] error message:[Found unknown categories [("master's degree",)] in column 2 during transform] can anyone help
Thanks.......
Can I put this in my resume? Please reply 🙏
whre is part 2
For some reasons that I don't understand, I'm getting errors when I execute "pip install -r requirements.txt" command in the cmd but not in powershell. Few times it's working but couldn't figure out what's going wrong.
well apparently u have to save that txt file by ctrl+s
i guess . and i am stuck in data ingestion part
Hi Krish, I have a macbook and I am new to Data Science, is there going to be a difference during running some files in my macos?, I have completer first part but it does not show any changes after commit.
like after running the logger file, there was no update.
Hi , I am getting an error while trying to test the logger "ModuleNotFoundError: No module named 'datetime'".
Have you imported the datetime module at the start of your code?
Great work krish.please make this end to end ml project in hindi also.
Sir I am not finding any student.csv file
can anyone solve this error : src.exception.CustomException: Error occur in python script name [D:\ML PROJECT\src\pipeline\predict_pipeline.py] line number [20] error message [Found unknown categories [None] in column 1 during transform]
DID YOU FIND THE SOLUTION
Where is Part 2?
1:08:11
pip install -r requirements.txt.....I cannot see any changes....can anyone guide me on this
happening with me also, did it work out for you ?
pandas
numpy
seaborn
#-e .
and run the command
pip install -e .
Trying on ubantu... getting error for typing.. mmodule
able to sovle
how did u do i m doing it on windows but it is showing error in import typing
,it says no module typing found
@@gawaderajesh
when i am runny pip install -r requirements.txt the files is not running?
pandas
numpy
seaborn
#-e .
and run the command
pip install -e .
@@AV_Kumar check if ur file was saved in the first place . like in files check it if not press ctrl+s
health check severe in env
Tabiyat sahi hai ab ?
No bro...this is a one shot video combined
Please make a data science crash course