Learn Docker Quickly - Machine Learning Project for Absolute Beginners
Вставка
- Опубліковано 16 чер 2024
- Today we will finally learn how to work with Docker! 🐋🐋🐋
We will focus on understanding the concept of containers, images and Dockerfiles in simple terms with lots of helpful visualizations and hands-on examples! We will focus on the logic behind each Docker component, not only in terms of how it works - but also what problems does it solve and what happens if we do not use it! 🤓
Codewise, will see a step by step workflow of developing an incredibly simple Machine Learning program using the Huggingface Transformers library. We will build our own custom Docker image based on the Jupyter Tensorflow Notebook one. And we will even learn how to deploy our finished project to DokcerHub! 🚀🚀🚀
By the end of this video - you will have your very own video captions translating software as well as a comprehensive understanding of Docker (regardless of your level of experience with programming).
🤖 ML and AI Development with Docker 🤖
---------------------------------------------------------------------
www.docker.com/products/ai-ml...
🐋 Pull Tutorial Image 🐋
---------------------------------------------------------------------
hub.docker.com/repository/doc...
🎥 Related Videos of Mine 🎥
---------------------------------------------------------------------
⭐ MNIST Tutorial - Machine Learning Databases:
• Machine Learning Datab...
⭐ Python For Loops:
• Python For Loops - Pro...
⏰ TIMESTAMPS ⏰
---------------------------------------------------------------------
00:00 - 00:40 | Intro
00:40 - 02:21 | What is Docker? What are containers?
02:21 - 03:06 | Install Docker
03:06 - 04:17 | What are Docker Images?
04:14 - 05:20 | Search and Pull Images
05:20 - 06:08 | Run Container
06:08 - 07:18 | Expose Container Port
07:18 - 08:10 | Load MNIST Dataset with Tensorflow
08:10 - 09:47 | Plot MNIST sample
09:47 - 11:11 | Run Containers with Docker Compose
11:11 - 12:02 | Replace Jupyter Token with Password
12:02 - 13:07 | Mount Drive
13:07 - 13:32 | Build Images with Docker Compose
13:32 - 15:29 | Dockerfile
15:29 - 17:06 | Translate Text with Transformers
17:06 - 19:26 | copy files from system to image
20:52 - 21:14 | create public repository on DockerHub
21:14 - 23:04 | push local image to remote repository
23:04 - 25:11 | clean up containers and images
25:11 - 25:31 | thank you for watching!
💻 Download my SRT Demo Subtitles File 💻
----------------------------------------------------------------
drive.google.com/file/d/16bCS...
(new link coming soon... or you can pull it directly from Docker Hub with "docker pull mariyasha/srt-translator")
🤝 Connect with me 🤝
----------------------------------------------------------------
🔗 Github:
github.com/mariyasha
🔗 Discord:
/ discord
🔗 LinkedIn:
/ mariyasha888
🔗 Twitter:
/ mariyasha888
🔗 Blog:
www.pythonsimplified.org
💳 Credits 💳
----------------------------------------------------------------
⭐ Beautiful titles, transitions, sound FX:
mixkit.co
⭐ Beautiful icons:
flaticon.com
⭐ Beautiful graphics:
freepik.com
#python #pythonprogramming #machinelearning #artificialintelligence #datascience #tensorflow #programming #coding #application #neuralnetworks #ml #ai #technology #computer #computerscience #transformers #huggingface #docker #dockertraining #translation #captions #container #datascience #dockerhub - Наука та технологія
![Docker Crash Course for Absolute Beginners [NEW]](http://i.ytimg.com/vi/pg19Z8LL06w/mqdefault.jpg)
20 years in software engineering and architecture and I've been working with Hugging Face longer than I have Docker containers. Great tutorial and very helpful even for us old dudes!
I so so so love that you first show the steps going wrong, and then how it should be for it to work. And also that you start from the simplest way of doing it and building on top of it. Amazing teacher!
(Member of the Docker DevRel team) - Fantastic job with the video! Great explanations and demos! 🎉
Great tutorial!
Tip: there are some pre-requisites to follow your tutorial flawlessly:
- for people experiencing issues with Docker Desktop not starting up: enable the SVM-option in your BIOS, and also enable Windows feature HyperV.
- NVIDIA CUDA drivers need to be installed to run Tensorflow in the Jupyter notebook (so yes: you need an NVidia graphics card on the hardware on which the container is running on top)
Keep up the wonderful work!
What always strikes me, as well as the concise, efficient and detailed way in which you portray your content, is how incredibly well edited it is! On most content from coding creators online, I find myself scrolling through bookmarks but you are one of the few creators whose content I watch from beginning to end! Engaging, well delivered and very interesting, especially as I am getting more into docker as I develop my Machine Learning skills, especially when developing on multiple platforms. Keep up the fantastic work! :D
Always delivering very detailed and straight forward tutorials
Thank you so much!! It's my new goal in life 💪💪💪 hahaha
@@PythonSimplified And you do it very well.😁
Ladies are natural teachers. They do it way better.
I don't regret a single bit having waited until I see this vid to start with docker 👌🏻👍🏻 Thanks a lot !
I will be using docker soon enough at work, you make the basics very easy to follow. Thank you.
Your videos are so great for me as a someone stuck between being a beginner and intermediate. I appreciate your videos so much.
Excellent video! I have already worked with Docker in the past but your video is so charming that I could watch it to the end. It refreshed the old knowledge. Thank you!
Thanks, Mariya, for the excellent Docker tutorial! Your clear and practical approach made understanding Docker's complexities much easier, especially in a machine learning context.
I am speechless. I can't explain how easily you have explained about docker. Please continue to create such content ! I just love it.
Appreciate the time and effort you spent on making it appear so easy to work with.
Incredible work. Great flow and charisma on your end, time flew and I will now start my own container terminal to ship paintings.
"I have been subscribed to your channel since 2020. You are a great teacher."
Wow! This was the tutorial I was waiting for. Thank you
I’m a 2nd year computer science student. Thank you for helping me in my journey 🙏🏾 ❤️
An an Expert in Devops, this video allowed me to learn a new trick with Jupyter. Thank you so much for sharing your knowledge with us
A perfect presentation on Docker, well done. And a wonderful French accent.
Great intro into docker hands-on with practical UC. Congratulations maryasha !
Excellent walk-through, thank you very much.
Brilliantly explained! Thank you.
I can't thank you enough. How do you know everything and explain them in a very user friendly way. ❤
Rarely seen such a great, well explained video. Hope there will be a video explaining how to use compose for a distributed application such a db in a container and a webapp in another one. In the meantime I'd like to wish all the best.
thanks Great tutorial and very helpful ...send all my love to you work
you are an excellent tutor. keep it up. I can't wait to watch all your videos
Always wanted to learn this dev tool. Amazing! Saludos
Thanks alot! Found the video in my feed at the perfect time.
Winning video for winners. TY Mariya!
Thank you very much. Very detailed and clear explanation.
Impressive tutorial! Big thanks!
That was amazing! Thank you so much.
nice,detailed and simplified explanation. thanks maria
Perfect tutorial. Thanks.
I wait to watch and learn ,thank you
Thank you dear! I hope you like it! 😀
What a wonderful content!! OMG!!! I love it!!!!
This is great timing. Docker always kinda went over my head.
Mostly do local environment Python programming as an Analyst but want more software developer skills.
I always wanted to learn Docker but every time I started - I was struggling with wrapping my head around it. (I started many times given all the viewer requests, I was bombarded with "we need a Docker Simplified tutorial" messages, mostly on Discord).
Most tutorials and articles I read were very technical and assumed you have lots of prior experience. Important things like exposing ports and mounting drives was explained as a "by the way" note, the word "machine" repeated a lot (even though containers are nothing like VMs), and I could never understand what all the ./ and $VARIABLE_NAMES mean in Dockerfiles. Also, not many tutorials explain how to deploy an image to DockerHub, it's a Stack Overflow type of thing.
So I assumed that many folks are in the same situation... we may use it all the time - but it doesn't mean we understand any of it. We can accomplish our specific task - but anything beyond it is a mystery. Hopefully this tutorial will change it 😉
(sorry for the long rant hahaha, I'm very upset with the lack of simple Docker tutorials, it's not right!!! 😅)
@@PythonSimplifiedThank you for the work you put into this video. I definitely agree that the available Docker tutorial videos are much to be desired. My brain would turn off as soon as I saw the yml and Docker files and the new syntax involved with them.
Had a similar issue when I tried to learn Jenkins. Just went completely over my head.
This video was very helpful in demystifying Docker and I appreciate all that you do.
concrete, practical, very nice thank you
I just finished Machine Learning this semester and it’s helpful to learn something new like Docker!
That's awesome! I'm also taking the AI/ML route in uni (it's my last hardcore semester in school, the next one is just working my final project 💪💪💪) My midterms are precisely in a month from now, so I'm releasing one more video next week and then I immediately move on with studying.
The next tutorial will probably be quite useful to you as well! it will show you how to make your Pandas run much much faster (specifically, 30 times faster on both my PCs), so you're definitely in for a treat if ML/DL is something you plan to pursue in the future! 😉
@@PythonSimplified that’s so cool! I completed my final project for my Machine Learning last week on classifying Brain MRI Scan images. Took so long since model kept under fitting 😂.
@@PythonSimplified I subscribed. Cannot wait for more Machine Learning videos!
Such an amazing tutorial!
Simply brilliant!!
Excellent, j'utiliserai plus souvent Docker maintenant !
Hey Mariya.. First of all a very nice video and now my question is.
Is it possible to work on docker with AWS? And also using docker help the most but is it possible to compress the size of docker images.. I mean they have taken too much size.😩
It would be helpful if you add some pros and cons points also.
Thanks for the video.
Great tuto I understand docker applied for ML and DL
WOW !!! me cuesta pero me gusta este contenido....alli voy hasta atras haber que aprendo.
Such a smooth tutorial. Really helpful. Thanks for your commitment to making great content!
I love your tutorials. You have a way of covering all the basics, without treating us like a troop of baboons sharing the same brain cell. Thank you
Great tutorials for real!!!
Great thanksfor sharing knowledge
Just stoped by quickly, haven't seen all of it, but from what I seen, you really made it simple, and when I worked with docker before i did find it confusing, but I like it alot, i would try to put up an app on render through docker soon I hope
I also worked with Docker before (there's even one tutorial on the channel where we use it - ML Inference with Torch Tensor RT), but I never truly understood what I was doing until I started working on this tutorial. I think that many of the resources online fail to explain it properly and that's why it's so confusing for many of us... helpfully my tutorial will change it! 😀
Let me know if it helps! (and please also share your app repo when you are done, would love to see what you came up with! 😉)
@@PythonSimplified it would probably be simple user greeting test app, cause I want to try out java for first time, it would be more introduction for me for some new stuff i haven't try before, instead of app that is really usefull 🙂
Where is ultra mega like button! Thank you! 🤩🤩🤩🤩🤩
God. You are the most beautiful programmer in the world. ❤
Wow! Thank you so much! 😀
@@PythonSimplified Greetings from Colombia. I confess that my ex-girlfriend was jealous of me when I watched your tutorials so I watched you secretly. Advance my career with your help I am now a full stack developer. 😎
Thank you so much
You're absolutely welcome! enjoy! 😀
Thank you.
I enjoy your videos and I've recently looking into docker as well. Not sure i would ever have a use for making my own image, but now i kinda know how they're made. Small little comment , but all i could focus on was any time you said words like Ports. Because you don't have a Pop filter. Your audio in your videos have always been perfect otherwise.
nice video. thanks
Explanatory, good content girl
love the video............... Mariya.......................Great tutorial........................:) bye
Love these videosss
Thank you!! Super happy to hear!! 🙂🙂🙂
Great tutorial. Loved it.
However around minute 15, it seems you didn't refer on the docker composer file to the Dockerfile you created. To make it work I had to add one line in the composer yaml below build: with dockerfile: Dockerfile
Whoa! This was so much to understand in one go. 😢
Sorry dear, I hope that following along with the code example will clarify things 🙏🙏🙏
You do realize you're every tech guy's dream girlfriend, right?
Great tut as always, you rock!
Always good👍
I just started a job in the infrastructure unit of a software development government entity. When developers finish a project I deploy to producción using Docker and kubernetes. I use a not complex Dockerfile, then I do a little optimization to reduce the size. And that's all i need to know to deploy.
3am You're killing me Mariya
Sorry Sandy you live too far 🦘🦘🦘 hahahaha
great video, but we all got to admit Bruce Wayne always has the latest stuff before it even hits market
Agreed!! Though latest doesn't necessarily mean best 😉
Omg it’s coming!!!!!!
See, only 2 years after - the video is ready 😅😅😅 hahahaha
Great dear
Thanks
Спасибо :)
пожалуйста! :)
Hey Mariya nice video, wanted to know if you needed a video editor/thumbnail designer for the channel?
How do you find the directory of the container? When adding the volumes portion in the compose.yml file I also put the directory path to my profile ex: /home/. However when refreshing my jupyter notebook it did not have my compose file in the file tree. I am using ubuntu 22.04.4.
hello, what did you use to create the yaml file?
One question, for developing ML project is it better to use Jupyter notebook this way or by installing Anaconda locally?
It's just a matter of preference... I personally think Docker is cooler (now when I finally understand it 😅 hahaha).
I think the biggest benefit of Docker vs. Conda is when you work in a team and need to ensure maximum consistency. Other than that - both Anaconda and Docker run locally, so there shouldn't be any difference in processing speeds or access to files. Your hardware is not split between Docker and Windows - Docker has 100% access to your system.
Also, if you have a tough time deciding, you can always use the Anaconda Docker image!! 🤪 (docker pull continuumio/miniconda3)
@@PythonSimplified Ok thank you, and can you use 2 docker at the same time, for example using anaconda docker and tensorflow docker insteed of just adding tensorflow to the anaconda docker and creating a new image? If yes, is it a good idea?
you the best :x
Thank you! 😀
@@PythonSimplified lov you ! :*
Very good video 👍👍. But what is the benefits of using Docker??
Docker simplifies development by creating isolated environments, making sure your app works seamlessly in any system. It's great for avoiding the 'works on my machine' issue, ensuring consistency across different machines and team members. Plus, it's super handy for managing dependencies and versions!
@@tenicg7045 Cool thanks, seems a little bit difficult but way better than the virtual envs. And what is Docker good for? Deploying Web apps, Windows or Android or both...?
Super
Thanks for this. Hope you're okay! 22:10
iam unable to add compose file and also transformers are also not installed,I think i wrote wrong directory
I had a comment about using podman instead of the full docker install, I guess I don't understand why it was removed.
Hi, I am learning from you, one question, using docker, can you run a simulation using gpu?
You can pretty much do anything from a container if you set it up right
@@PythonSimplified you are right , I found the correct image : nvidia/cuda thanks
Do u know how to set the default password for jovyan user in docker container? I need to install some in my docker container but it requires root privilege.
New issue: replacing image with build resulted to an error finding the file or directory again.
❤❤
You are so beautiful and intelligent.
please how can I make docker compose using window computer not MAC computer?
❤🤩😍🤩❤🎉
What a lovely lady 🥰😍😘
Docker... my first experience turned out a nightmare... seems most ppl rather than teach software or CS skills.. just confused you.
I've used Docker before, but I can't say that I understood what I was doing. I was just copying and pasting commands based on some Stack Overflow thread, but only when I started working on this tutorial - Docker finally dawned on me! 🙌🙌🙌 (3 days later though hahaha)
And because I knew nothing about it when I started this project - I think I explained it in a way that folks in a similar situation will be able to understand (at least... I hope I did 😅😅😅)
Please let me know if you find it helpful (or confusing hahaha), as I'm quite familiar with type of nightmare you referred to and it would be awesome to see if you were able to turn it into a pleasant experience after a 25 minute video 😉
@@PythonSimplifiednow it's 95% clear as to what I did wrong; thanks to you I'll be better able to create apps from a docker containers static images. 👍 👍 Along his was the your CONDA tutorial, this is the 2nd your tutorials have saved me. Please let me know of you'll ever do a paid Python course to better understand the language + eventually master it. Happy Hollidays 🎄
Is anyone else not having their Transformer.ipynb or captions_english.srt appear in their test directory? I've been able to replicate the tutorial otherwise but this issue is persisting even after redoing the tutorial from scratch.
You need to remove the container or prune all containers before building the final image 😉
Careful with showing 3 separate account names on that login screen. There are some creeps out here.
Great video but it is not really a tutorial on creating a container from scratch, rather more a tutorial on how to create containers with existing images. How about a tutorial on how to create the image itself?
je m'appelle Maria et je suis programmeur 🥰🥰🥰
The patakh patakah patakh is very frustrating.
😮😮😮😮🙌🙌🙌🤝🤝
Mariya, do you sleep at all? 😊
Your accent like an Russian English )
docker on windows is strange
I'm stuck in 22, anyone help