**Update (20 May 2021):** After Google's recent I/O event, AI Platform has now changed its name to Vertex AI, so some of the terminology/steps on the GCP platform may be named differently/have slightly different steps, but the main principles of deploying a model should remain. Happy Valentine's Day team ❤️! Sending love to you all. Happy Machine Learning!
Hi Daniel ,I am trying to deploy the code on the Vertex AI,in this they have changed the format and specification of make_prediction() function which you used in video. Now when I am passing image as an instance to this new function I am getting error. Can you please update your code in the github for this entire deployment where you use the new VertexAI specifications?
I almost never comment on UA-cam videos, but here I wanted to break that trend in order to kindly thank you for this tutorial. This was a MAJOR lifesaver for me in my SYS6016 (Machine Learning) course at UVA. Absolutely awesome stuff.
In india, when you say "I'm a driver" some people look down on you. As apposed to that, I absolutely love the fact that you've mentioned you were #4.94 rated uber driver to the seemingly most intellectual minds of Stanford. That's being true of what you are. I like it. I'm learning a lot from you, Danny. Thank you!
Thank you Hemanth, I appreciate it! As for the “driver”, I treat the doorman with as much respect as the CEO. There’s opportunity to bring value to others no matter what your role.
one of the best in the business thanks daniel for this wonderful tutorial, i always had problem about whole lifecycle of model on cloud, but you cleared all my doubts
You read mind, I am sure about it. You have the power of telepathy. I was just searching about this topic an here you upload it right that moment. Thank you very much for the tutorial
Hi @Daniel Bourke thanks for this lesson! I'm looking forward to doing this project but am getting the following error: Collecting requests==2.25.1 Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB) ERROR: Could not find a version that satisfies the requirement tensorflow==2.4.1 (from versions: none) ERROR: No matching distribution found for tensorflow==2.4.1 Has anyone experienced this? My Python version in the virtual environment is 3.10.6
You need to just understand the math, no need to memorize them, because to do anything you'll be using tensorflow or any framework which will handle the math. You can actually skip the math (not recommended) and still be fine. The math is just so that you understand what's going under the hood. The math gets complex as you move ahead, so if you skip a bit of the end it's still fine as long as you understand all the basics. Although if you plan on doing deep research and figuring out new techniques that aid the current ML process, learning math is really really important.
44:28 This is one way, but if you already connected with your Google Drive, then you'd be able to use GCP for that particular account (which I think a lot more easier)
Hi Daniel and many thanks for the effort! Great video! Am I wrong in the following? (This is from the part where you use the app locally with the model deployed on GCP) When you created the model version, right at the bottom of the setup page (57:02), there was the option to choose a service account which you ended up not specifying at that point (neither later?). Then you created a service account, generated a key for it and saved it locally for the app to use when making a request. I did the same and managed to get it worked but only when I don't explicitly specify the sa. When I do specify the sa (during model version creation) I get "Failed to add IAM policy binding" error and model is not deployed. By playing around, I figured that the credentials for the specific sa don't even matter, GCP apparently has some default sa that it uses when one doesn't specify a custom sa.
Hmmm, I’m not 100% sure of what’s going on here. In my experience, I’ve had to make a SA for each specific service, or adjust an existing one for a new service - I thought GCP by default made all SA’s have as little permissions as possible, hence the requirement for creation. Perhaps I’m wrong or it’s been changed?
Thank you sharing this! Quick question, how should I run tensorboard; I ran %tensorboard --logdir logs/scalar - but I keep getting an error of dataset not active
an error occured when trying to save model1 i think this is because using tf 2.7.0 KeyError: "Failed to add concrete function 'b'__inference_model_layer_call_fn_51753'' to object-based SavedModel as it captures tensor which is unsupported or not reachable from root. One reason could be that a stateful object or a variable that the function depends on is not assigned to an attribute of the serialized trackable object (see SaveTest.test_captures_unreachable_variable)."
Hi @Daniel Bourke, Thank you so much I learnt a lot. I noticed that the training code that you provided is not using GPU when I was training it myself on colab and on my PC . I wonder why? Any ideas?
Hello Daniel! I saw that you have a big interest in sports and even a degree. I am also passionate about sports and ML and if you don't mind I would like to ask some question. Do you think that there are good applications of ML in sports? Have you ever done anything related to that? How much expertise would it take? Do you think that building an app like SwingVision (tennis tracking app for iOS) is possible for one person? And what about sports analytics? Finally, could I make a Saas out of that? Have you ever done a Saas (of any type)? Thank you 😉☺️
SwingVision is definitely possible, check out something like “iOS pose detection” and let your imagination run I haven’t personally built a Saas but stay tuned Saas in sports would be same premise as other Saas though: find a problem people have, solve it with software, sell it
Thank you Benedict! As for AWS vs GCP, I’d choose either, they both have similar offerings (just with different names for the services). AWS is probably more commonly used at different companies though
Hey Daniel, First of all thank you so so much for providing such informative content!! I sincerely appreciate all your efforts and hardwork. By watching this video, I have gathered plenty of information. I am going to continue watching all your videos in the coming days!! I am having few doubts. I will be greatful to you if you could guide me and suggest me your thoughts on this. 1. At 1:17:56 you mentioned about one class containing 11 classes while another class with random non-food images. What I understand from here is that you have got 2 main classes, one of them having 11 different classes, which makes it binary classification. How can I train this kind of image directory? I am having similar use case; I want to classify oral and non-oral images, where a non-oral class contaiins any random images of different categories. Could you please help me with this problem? How can classify my images? 2. Could you please let me what are the requirements/preparations that I need beforehand to deploy my trained model into GCP to use it in APP development? Thank you very much once again for such a valuable content!! ❤️ ❤️ ❤️ Keep rising and surprising people with more videos!!!!!
@@mrdbourkei can't install all this on my m1 so switched to windows btw loved the zero to mastery on tensorflow any way u can do a tutorial on deployment a little bit more detailed than this cs class plzz mate we are asking for it for a while after we bought the course cheers mate.
Excuse me Sir. I know that you have earned the Tensor Flow Developer Certificate . Congratulations on that. I am also following your instructions that you gave about that Course Course Of Tensor Flow. Unfortunately before that I referred to random video on UA-cam and tried to use some basic commands of Tensor Flow on Jupyter notebook but a lot of problem start coming with the version . Mostly about ".... . some command could not be found in module" . Also tried to downgrade the version to 1.4 but not much happened. It had became a headache . Can you give some help so that these things do not restrict me from implementing commands while doing the Coursera Course Of Tensor flow. 🙏🙏🙏🙏
I would recommend don't go for lower version check once on tensorflow official certification examination page. you can get to know which version you are really want to use and on which version your exam based. happy learning!
Hello, Great Video! What do you do for a living? Does this channel pays for your bills? Could you make a video on how much you earn from YT and your courses, please? Thank you
Hey Daniel, thank you for the kind words. This article sheds a bit more on how I make money: www.mrdbourke.com/running-a-business-from-a-bedroom-11-months-in/
**Update (20 May 2021):** After Google's recent I/O event, AI Platform has now changed its name to Vertex AI, so some of the terminology/steps on the GCP platform may be named differently/have slightly different steps, but the main principles of deploying a model should remain.
Happy Valentine's Day team ❤️! Sending love to you all. Happy Machine Learning!
Can you please provide the required steps for VERTEX AI?
Hi Daniel ,I am trying to deploy the code on the Vertex AI,in this they have changed the format and specification of make_prediction() function which you used in video. Now when I am passing image as an instance to this new function I am getting error. Can you please update your code in the github for this entire deployment where you use the new VertexAI specifications?
Your honesty is infectious. The way you made your (Eng : ML) ratio clear at the beginning speaks volumes about it. Thanks, Daniel. Amazing work!
Actually this im my most productive video I ever watch , simple and transparent, God Bless You 🎉
The Content you provide in this Tutorials is my Valentine ❤️...!!! Thank you for posting top notch content..!!!
Woohoo! Happy Valentine’s Day Yash ❤️🌹
I almost never comment on UA-cam videos, but here I wanted to break that trend in order to kindly thank you for this tutorial. This was a MAJOR lifesaver for me in my SYS6016 (Machine Learning) course at UVA. Absolutely awesome stuff.
thank you! I appreciate your comment and you breaking your trend to leave it :)
In india, when you say "I'm a driver" some people look down on you. As apposed to that, I absolutely love the fact that you've mentioned you were #4.94 rated uber driver to the seemingly most intellectual minds of Stanford. That's being true of what you are. I like it. I'm learning a lot from you, Danny. Thank you!
Thank you Hemanth, I appreciate it!
As for the “driver”, I treat the doorman with as much respect as the CEO. There’s opportunity to bring value to others no matter what your role.
@@mrdbourke I totally agree with you on that. He/She is as human as I am and deserve respect.
one of the best in the business thanks daniel for this wonderful tutorial, i always had problem about whole lifecycle of model on cloud, but you cleared all my doubts
I just finished ZTM machine Learning course on UDemy. Thank you for all your hard work.
Massive effort Super! Congratulations on finishing!
thanks for coming to our class!!! my favorite guest lecture so far!!
Thank you Lauren ❤️
I would absolutely love for you to make a course about the software needed to deploy models. I'm having to learn bits and pieces from everywhere...
A Great Gift for the people whose valentine is Machine Learning...!!
Another Masterpiece from 'the Daniel Bourke' :)
Happy Valentines Day Yogesh! 🌹
i am bored on the train going home so i found your video best 2 hours of my life
Glad you’re enjoying it Mohamed!
thank you, you are the best person for teaching every things
You read mind, I am sure about it. You have the power of telepathy. I was just searching about this topic an here you upload it right that moment. Thank you very much for the tutorial
Great timing hahaha! Enjoy Shoaib!
You are such an inspiration Daniel!
I had to do this for my college ML project last semester. Could really have done with this video....
I’m a little late!
Incredible tutorial!! Thanks so much :D
Great follow along tutorial! Keep it up!
Thank you Timoose! Plenty more to come
Man this is just what I have started, wow
Enjoy Pinakin!
Great video Daniel. Keep Going!!!
Thank you Aritxa! I appreciate it
Hi! First of all i found this super interesting. I´m doing something similar and this really helps me a lot. Ty !
Glad you enjoyed Tomás!
Thank you so much for this, really great content :)
Thanks! That was awesome content! Which you always have! Love from India!
Thank you Hrishikesh! Love form Australia!
Hi @Daniel Bourke thanks for this lesson! I'm looking forward to doing this project but am getting the following error:
Collecting requests==2.25.1
Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
ERROR: Could not find a version that satisfies the requirement tensorflow==2.4.1 (from versions: none)
ERROR: No matching distribution found for tensorflow==2.4.1
Has anyone experienced this? My Python version in the virtual environment is 3.10.6
make gcloud-deploy is not working timestam 1:09:32. says "zsh: command not found: makefile"
wow.. this is great. was just looking for ML deployment resources 😊 could be a next step of your ML course.
Thank you! The models we used in this tutorial are built in the upcoming course
@@mrdbourke wo hoo.. can't wait :D
Big fan of your work. I hope to get to your level one day.
Thank you Cristopher! All the best legend
Daniel, Do I need to memorize the mathematical equations of machine learning algorithms or just understand the math behind them and what they do?
You need to just understand the math, no need to memorize them, because to do anything you'll be using tensorflow or any framework which will handle the math.
You can actually skip the math (not recommended) and still be fine. The math is just so that you understand what's going under the hood.
The math gets complex as you move ahead, so if you skip a bit of the end it's still fine as long as you understand all the basics.
Although if you plan on doing deep research and figuring out new techniques that aid the current ML process, learning math is really really important.
@@advait7802 Thanks for the advice.
Thanks for sharing the video with the community. very useful actually.
Thank you! Stoked you enjoyed
Thank you for posting such amazing content, so Informative!!!!!😀😀
You’re welcome Ayush! Enjoy legend!
44:28 This is one way, but if you already connected with your Google Drive, then you'd be able to use GCP for that particular account (which I think a lot more easier)
Great content by the way
3:41 I loved the way how he used kite image for small apps and plane for large apps 😂
🚀 soon
@@mrdbourke all the best
Hi Daniel and many thanks for the effort! Great video!
Am I wrong in the following? (This is from the part where you use the app locally with the model deployed on GCP) When you created the model version, right at the bottom of the setup page (57:02), there was the option to choose a service account which you ended up not specifying at that point (neither later?). Then you created a service account, generated a key for it and saved it locally for the app to use when making a request. I did the same and managed to get it worked but only when I don't explicitly specify the sa. When I do specify the sa (during model version creation) I get "Failed to add IAM policy binding" error and model is not deployed. By playing around, I figured that the credentials for the specific sa don't even matter, GCP apparently has some default sa that it uses when one doesn't specify a custom sa.
Hmmm, I’m not 100% sure of what’s going on here. In my experience, I’ve had to make a SA for each specific service, or adjust an existing one for a new service - I thought GCP by default made all SA’s have as little permissions as possible, hence the requirement for creation. Perhaps I’m wrong or it’s been changed?
Very good video , can i ask which clod platform is better gcp or aws or azure , gcp looks better in your tuitorial though
They all have similar offerings
However, my experience is mostly with Google cloud
So I went with them
Thank you sharing this! Quick question, how should I run tensorboard; I ran %tensorboard --logdir logs/scalar - but I keep getting an error of dataset not active
an error occured when trying to save model1 i think this is because using tf 2.7.0
KeyError: "Failed to add concrete function 'b'__inference_model_layer_call_fn_51753'' to object-based SavedModel as it captures tensor which is unsupported or not reachable from root. One reason could be that a stateful object or a variable that the function depends on is not assigned to an attribute of the serialized trackable object (see SaveTest.test_captures_unreachable_variable)."
Hi @Daniel Bourke, Thank you so much I learnt a lot. I noticed that the training code that you provided is not using GPU when I was training it myself on colab and on my PC . I wonder why? Any ideas?
You can switch to using GPU in Colab’s Runtime menu (when I trained the models I definitely used a GPU)
Hello Daniel! I saw that you have a big interest in sports and even a degree. I am also passionate about sports and ML and if you don't mind I would like to ask some question. Do you think that there are good applications of ML in sports? Have you ever done anything related to that? How much expertise would it take? Do you think that building an app like SwingVision (tennis tracking app for iOS) is possible for one person? And what about sports analytics? Finally, could I make a Saas out of that? Have you ever done a Saas (of any type)? Thank you 😉☺️
SwingVision is definitely possible, check out something like “iOS pose detection” and let your imagination run
I haven’t personally built a Saas but stay tuned
Saas in sports would be same premise as other Saas though: find a problem people have, solve it with software, sell it
47:20 my exact reaction whenever anything goes right
Hahaha I wanted to make it as real as possible
Is there any diff. between ML and AI engineers, does AI engineer(job role) really exist?
How can I use Pytorch model? Do I need a custom container? What container is useful for a BERT model?
You can definitely use PyTorch but it requires a couple different steps, check the documentation on AI Platform for more
awesome video Daniel! In your opinion, should someone getting into data engineering learn GCP or AWS first?
Thank you Benedict! As for AWS vs GCP, I’d choose either, they both have similar offerings (just with different names for the services). AWS is probably more commonly used at different companies though
great talk and demo! how does Google AI compare with other options such as AWS SageMaker?
Thank you! I haven’t compared Google AI and SageMaker but I imagine they’re similar
How to decide the number of hidden layers and nodes in a hidden layer?
hey man im just curious, why did u not study CS since u seem to be doing it as a career now cuz i remember u mentioned u studied nutrition and sports
I didn’t even know CS was an option when I started university. But I’m glad I studied something else because now I’ve still got plenty to learn
try to do videos on kaggle problems and contests. that would be very helpful
That's great video. Thanks you.
---From Viet Nam with love---
Stoked you enjoyed! From Brisbane with love!
Hey daniel, when I run model 1,2,3 on google collab, why it cannot be save like you did. Mine tell there is an error
Yo yo, what error are you getting? Any chance you could post it on the Github for the tutorial (as an issue)?
converting floating points to int16 is giving weird results.
Hey Daniel,
First of all thank you so so much for providing such informative content!! I sincerely appreciate all your efforts and hardwork.
By watching this video, I have gathered plenty of information. I am going to continue watching all your videos in the coming days!!
I am having few doubts. I will be greatful to you if you could guide me and suggest me your thoughts on this.
1. At 1:17:56 you mentioned about one class containing 11 classes while another class with random non-food images. What I understand from here is that you have got 2 main classes, one of them having 11 different classes, which makes it binary classification. How can I train this kind of image directory?
I am having similar use case; I want to classify oral and non-oral images, where a non-oral class contaiins any random images of different categories.
Could you please help me with this problem? How can classify my images?
2. Could you please let me what are the requirements/preparations that I need beforehand to deploy my trained model into GCP to use it in APP development?
Thank you very much once again for such a valuable content!! ❤️ ❤️ ❤️
Keep rising and surprising people with more videos!!!!!
Dan mate are u sing the apple m1 or just a regular mac cus my m1 is having issues installing all this shit
I used a non-M1 Mac for this video (MacBook Pro 16-inch, i9)
@@mrdbourkei can't install all this on my m1 so switched to windows btw loved the zero to mastery on tensorflow any way u can do a tutorial on deployment a little bit more detailed than this cs class plzz mate we are asking for it for a while after we bought the course cheers mate.
Is pytorch equally as good for deployment as tensorflow is?
Yes, however I think currently TensorFlow edges it out with features (eg mobile deployment)
How much will it cost me to deploy my ML model on GCP?
shuold i switch to linux ubantu for machinelearning or windows will work fine'
Windows works fine, however, most cloud systems run some form of Linux (Ubuntu etc)
Excuse me Sir. I know that you have earned the Tensor Flow Developer Certificate . Congratulations on that.
I am also following your instructions that you gave about that Course Course Of Tensor Flow. Unfortunately before that I referred to random video on UA-cam and tried to use some basic commands of Tensor Flow on Jupyter notebook but a lot of problem start coming with the version . Mostly about "....
. some command could not be found in module" .
Also tried to downgrade the version to 1.4 but not much happened. It had became a headache .
Can you give some help so that these things do not restrict me from implementing commands while doing the Coursera Course Of Tensor flow. 🙏🙏🙏🙏
If you’re running into troubles with Coursera’s notebooks, I’d use Colab and practice writing as much TensorFlow code as possible, you will learn it
I would recommend don't go for lower version check once on tensorflow official certification examination page. you can get to know which version you are really want to use and on which version your exam based. happy learning!
nice one
While other people are on Valentine's, I'm busy trying to deploy ml models 😂😂
You and me both! 🌹+💻
Nice ...go!
Thank you!
So if I do something, I will have done it... wow, that's deep
can you shrink the video length for the future? It is too long ..
Does anyone have the link to his twitch channel, can't seem to fnd it anywhere
twitch.tv/mrdbourke
How can I join the course?
Full details on the course here: stanford-cs329s.github.io/
Love the aussie accent bo
👍🏻👍🏻
You using Google instead of duckduckgo? 😐 It's from your videos I started using duckduckgo 😅
Anyway great tutorial...Thanks for making it public🤟
I use both! And thank you for the kind words
How old are you?? Curious to measure your age and my age and where i'm at in my career!
I’m 27
PS1 Malfoy never ages
Hello, Great Video! What do you do for a living? Does this channel pays for your bills? Could you make a video on how much you earn from YT and your courses, please? Thank you
Hey Daniel, thank you for the kind words. This article sheds a bit more on how I make money: www.mrdbourke.com/running-a-business-from-a-bedroom-11-months-in/
@@mrdbourke Thank you
Not pizza :)
Pizza, not pizza!
Hey Man!
You streamed such a great tutorial for free?
Thank you Sir for your community services!