I did my final project for my degree last year using TensorFlow. I'm tearing my hair out now learning about PyTorch, this looks like it would have saved me so much time and suffering 😭
There are actually *very* few differences between the 2. Their use cases may differ, but that really only because of what a company decided to use for their project. You can actually switch from one to the other with little effort.
I agree with the above commenters, but if you are familiar with Numpy, USE PYTORCH. Numpy is extremely similar to PyTorch, and they even share an astounding number of identical functions, where PyTorch’s version just operate on tensors instead of numpy arrays and can use your GPU. Creating an array in numpy can be done identically in PyTorch with the Zeros(), Ones(), and empty() functions. They also connect very well, there’s even a from_numpy() function to get convert between the two
IMO, the less code something has, the better. *Especially* when it's boilerplate code. Sometimes I believe people have a typing fetish... I actually have a coworker that likes typing and he writes a lot of repetitive code and does not recycle the code.
@@SI0AX You mean the less code _you_ have to type the better. We all want complexity abstracted away with nice easy to use APIs we can just chain to get things done, but there's still a bunch of code someone else had to write running in the background to get that thing done.
I did a project with Tensorflow before and was really struggling with Tensorflow and am looking into what to use for my thesis, so i think your comment should be reson enough to check it out 😂😅
MORE DEEP LEARNING STUFF IN 100 SECONDS! I remember going through courses that took literally freaking days... tons of crazy equations and weird explanations... this stuff is gold man.
Thinking of this, Pytorch is trending and why there is no 100 second video from Fireship. Just got into machine learning in pytorch. Absolutely 🔥🔥. Need a comparison with Tensorflow. 5days before the version 2 became stable.
It depends a bit on your use case, pytorch is better for prototyping/research/personal projects but tensorflow is more easily deployable in the real world As an ML researcher I love pytorch personally and can't recommend it enough but tensorflow has its upsides too
@@Imperial_Squid Never tried Tensorflow before. Can I ask you something?, Which is more compatible with mobile devices. Tried pytorch with coreml and onnx. As ML researcher, which one do you prefer in case of Mobile/Edge devices
Tensorflow has been around a lot longer. Its why its used in industry. It recently combined with the Keras library and got a lot of functionality from that. Pytorch itself is much newer and is used today more so as a way to build models. A lot of people, myself included prefer Pytorch for its usability. I personally think Pytorch is going to surpass Tensorflow because the magic of deploying a model has been demystified for awhile now. Its all about applied model accuracy; preventing overtraining etc etc. This is just flat out easier with Pytorch. Integration of a model with an API really is not an issue today.
For deploying I'd had to say Tensorflow... Buf. I'd rather go with Torch. Sometimes not even the toy examples from TF doc works. Too much change from version 1 to 2. I'd stick to Torch
Alright man. Seriously? You have my computer bugged don't you? I swear, every god damn side project I start the next week we get a video with perfect relevance. I love you
But this does not teach any theory or reasoning as to why you would do certain things. And what the effects of these things are. But I guess if your school is trash, then you probably learn more here.
The best video tutorial on PyTorch I have ever seen. All the courses on this topic are so complicated but your video is an amazing one. I learned more than I have in a year. Thank you so much Fireship!!!
Great little intro to CUDA in here! Would like to see a video giving an overview on GPU layers (AMD ROC and whatnot), and maybe the associated hardware situation right now. CUDA/NVIDIA gets way too much press, it seems.
“PyTorch is a world-class machine learning framework. It has been used to build image generation models and highly advanced voice recognition systems. To use it, just import torch, define some tensors et voilà … there‘s your self-driving car.”
Beautiful, thanks, as Einstein said: "You don't really understand something unless you're able to explain it to your grandmother" ... and you have achieved it :)
As a college student who recently got into deep learning with TensorFlow, I can understand and relate to PyTorch. Both are fundamentally pretty similar.
Tensorflow is more for scaling up with other systems, pytorch is most useful for stationary or researching different models. I find tensor flow much easier to learn, whereas pytorch requires more knowledge and memorization of the syntax. Both are useful for separate things, but you can use them in the place of another, except tensor flow since pytorch does not support a lot of the platforms still. It will support mobile in a couple years fully though. TensorFlow is my favourite one
I think you get way better results for an image classifier if you start with a convolutional layer instead of flattening the input instantly. I havn't tested it though.
Install pytorch and optionally CUDA. Getting the right CUDA version and pytorch version and the other things for your GPU to run properly. Was a pain in the ass for me.
you litterally can read my mind. today i said it would be my first day learning python since i wanted to learn a language towards neural netwworks and ai... since javascript doesnt do that 💀
PyTorch is a more advanced version of "Machine Learning". Learning PyTorch without learning ML with scikitlearn is like learning to run without having learned to walk. AI is basically ML but scaled up and with extra algorithms on top, but it still applies ML logic.
>pip install torch...cu117 >pip install thing wtf is version "2.0.0+cu117"? No package management for you >pip uninstall torch >pip install thing The thing is CUDAless >pip uninstall torch >pip install torch...cu117 Please tell me this doesn't only affect me.
The big downside of PyTorch is that creating your own dataset is very very hard. There's practically no documentation online, at least for greyscale images, and 90% of the tutorials you see just import a Torch library. If it weren't so heinous with its datasets, PyTorch would be great.
I did my final project for my degree last year using TensorFlow. I'm tearing my hair out now learning about PyTorch, this looks like it would have saved me so much time and suffering 😭
Is TensorFlow not worth learning than PyTorch?
@@suyashshrestha1099 Just pick one and go with it. Once you understand one of them, you can pick up the other in 2 hours or something.
There are actually *very* few differences between the 2. Their use cases may differ, but that really only because of what a company decided to use for their project. You can actually switch from one to the other with little effort.
I agree with the above commenters, but if you are familiar with Numpy, USE PYTORCH. Numpy is extremely similar to PyTorch, and they even share an astounding number of identical functions, where PyTorch’s version just operate on tensors instead of numpy arrays and can use your GPU. Creating an array in numpy can be done identically in PyTorch with the Zeros(), Ones(), and empty() functions. They also connect very well, there’s even a from_numpy() function to get convert between the two
Pytorch is majorly used in academia and TF in the industry. Personally I found TF easier to learn than pytorch. Both are great in their own ways.
The more I learn about Python, the more it seems like good python code should contain as little code in python as possible.
Try to build a table completely out of glue. Same thing, you want to use as little as possible
Good python code seems to follow the following pattern
import taskDoer
doer = taskDoer
doer.do_task()
IMO, the less code something has, the better. *Especially* when it's boilerplate code. Sometimes I believe people have a typing fetish... I actually have a coworker that likes typing and he writes a lot of repetitive code and does not recycle the code.
@@SI0AX now he can beautify his code using gpt4. Don't show it to him it'll break his heart
@@SI0AX You mean the less code _you_ have to type the better. We all want complexity abstracted away with nice easy to use APIs we can just chain to get things done, but there's still a bunch of code someone else had to write running in the background to get that thing done.
I absolutely have loved your videos for so long. Thank you for the incredible production quality and fast-paced information made simple!
Let's develop a deep neural network to find who made the chicken.
botted subs momenttt
Jaden moment
@@whit3rose A dinosaur made the egg that mutated and made a chicken
@@fahd2372 not really
kinda wish this was PyTorch in 1000 seconds
the best kind of python code is written in c
@@benwright4096Eh?
@@youtubeacc666 leave him. He's just a normie who has just learnt about computer
@@architmishra015 they were prob thinking of CPython
@@architmishra015 Look at me! i know c is faster than python! i'm so clever
I used PyTorch for my thesis and it was really easy to use, I loved the modularity of everything
YoloV8 and Mindsdb is a great thing for us smooth brains. 😊
how did you got to learn pytorch can you tell me. I am interested in learning it but not able to find best source
what was the thesis on?
@@ramandeepkaurbanvat7583 If you finally got a good source, can you also share please
I did a project with Tensorflow before and was really struggling with Tensorflow and am looking into what to use for my thesis, so i think your comment should be reson enough to check it out 😂😅
your 100 second videos seem to come out exactly when I need them. I just started a AI, ML project this week.
And I am starting now
Will you please share details about your AI ML project
@@mujibshaikh7494SHUT up
Such large concept in 100 seconds? Just brilliant work. Thanks!
Meant for those who already understand the concept
Me, a web dev: "Hmm, I know some of those words"
Absolutely brilliant combination of conciseness and coverage.
0:18 it's "scalar" not "scaler"
MORE DEEP LEARNING STUFF IN 100 SECONDS! I remember going through courses that took literally freaking days... tons of crazy equations and weird explanations... this stuff is gold man.
Thinking of this, Pytorch is trending and why there is no 100 second video from Fireship. Just got into machine learning in pytorch. Absolutely 🔥🔥. Need a comparison with Tensorflow. 5days before the version 2 became stable.
It depends a bit on your use case, pytorch is better for prototyping/research/personal projects but tensorflow is more easily deployable in the real world
As an ML researcher I love pytorch personally and can't recommend it enough but tensorflow has its upsides too
@@Imperial_Squid Never tried Tensorflow before. Can I ask you something?, Which is more compatible with mobile devices. Tried pytorch with coreml and onnx. As ML researcher, which one do you prefer in case of Mobile/Edge devices
Tensorflow has been around a lot longer. Its why its used in industry. It recently combined with the Keras library and got a lot of functionality from that. Pytorch itself is much newer and is used today more so as a way to build models. A lot of people, myself included prefer Pytorch for its usability. I personally think Pytorch is going to surpass Tensorflow because the magic of deploying a model has been demystified for awhile now. Its all about applied model accuracy; preventing overtraining etc etc. This is just flat out easier with Pytorch. Integration of a model with an API really is not an issue today.
For deploying I'd had to say Tensorflow... Buf. I'd rather go with Torch. Sometimes not even the toy examples from TF doc works. Too much change from version 1 to 2. I'd stick to Torch
Amazing explanation as always. Short yet concise. I hope you live 100+ more years.
Learning PyTorch currently and it was nice seeing you make a video on this topic.
Book recommendation: "A Primer to the 42 Most commonly used Machine Learning Algorithms (With Code Samples)."
Me clicking in 1 sec the notification drops
Parkour
Here for you🏆
@@dhirajnavale3861 😂😂😂
Script
Me here complaining how my notifications are always 1hr late. Does anyone know why?
Alright man. Seriously? You have my computer bugged don't you? I swear, every god damn side project I start the next week we get a video with perfect relevance. I love you
The timing of this video couldn't be any better because I'm working on some AI project with Pytorch right now :)
Haha me too. I am downloading the ai models for the first time at this time just before the video
Just curious, what are you working on?
@@valentinoedits1963 some analysis about anime music cd sales
now everything have that AI badge. you worked on web3 project before, right?
@@BlueEighthNote i want to get into AI where do I start, already learning from coursera.
The code looks so much easier to understand then I expected. That's what makes me so excited and scared to even try this kind of thing.
It amazes me to how much I can grasp in 100 seconds compared to what I might learn in a semester.
Nah you must be joking lol
@@tropicaldog430 it can be real, education in school don't teach very well especially on relatively new tech like this.
you're not wrong tbh, if you go to a garbage school then yeah, any youtube video is better than your semester at your school.
@@lottexy I go to the toughest school to get into. I go to IIT Kanpur which is like Indian MIT. Where I study statistics and data science
But this does not teach any theory or reasoning as to why you would do certain things. And what the effects of these things are. But I guess if your school is trash, then you probably learn more here.
Now I'm ready to start my Data Science career.
Thank you Fireship!
The best video tutorial on PyTorch I have ever seen. All the courses on this topic are so complicated but your video is an amazing one. I learned more than I have in a year.
Thank you so much Fireship!!!
how the fuck lol
0:18 "... tensors, which are basically just multidimensional arrays" cries in mathematics, hearing computer science
The best two minute and 43 second long video about PyTorch.
Great Video. Amazing demonstration of deep learning in Tesla Autopilot!
Wonderful video!!! I would love to see Scala in 100 seconds next :)
Great little intro to CUDA in here! Would like to see a video giving an overview on GPU layers (AMD ROC and whatnot), and maybe the associated hardware situation right now. CUDA/NVIDIA gets way too much press, it seems.
“PyTorch is a world-class machine learning framework. It has been used to build image generation models and highly advanced voice recognition systems. To use it, just import torch, define some tensors et voilà … there‘s your self-driving car.”
You summarized about 2 hours of Google searching in about 100 seconds. Nice job!
For all both of us out there using Haskell, there is an implementation of Torch being developed for the language called HaskTorch.
Also exist other for Tensorflow.
@0:19 I think it is meant to say scalar rather than scaler
This is the only channel I have the bell 🔔 for notifications because of its pure quality of content 🔥
i really love this feeling of knowledge flowing through my brain, and none leaving after 2 seconds
let me cry a bit
Keep them coming! I love these 100 second videos!
I was just about to request this one! Thanks a lot!
It's Impressive that You Have Knowledge/Intuition in Many Field.
Keep On!
Ok... I did not understand anything
O ye
Go learn math first, not being an asshole just telling.
I don't care
😂
Lmao I know right!
Great video! :) I.think it would be important to add the backforward step in pytorch so people could see the complete cycle of training a NN.
Video Suggestion: Tensorflow vs Pytorch😊
i have no idea what i'm hearing but i'm definitely excited about it
The data you provide is invaluable when it comes to keeping me up to date with the tech around me. As a developer, I can't thank you enough.
When Fireship is less confident about some cs topic he makes the video about it more serious and with less jokes
I just started learning pytorch and here is Fireship!
Thank you for a brief overview, It was so helpful.
We need a full length tutorial on PyTorch!
Well explained, keep it up!
Very good and concise explained, as always ^^
Interesting video. Keep up the good work 👍
You are an amazing teacher♥️
Please don't stop making these kinda videos 🥹♥️♥️
Damn... started learning PyTorch for an interesting faculty, and you are here from the blue. THX for the vid, Torch really deserves more audience.
"what you came here to do though..." is exactly what i came here to do
This helped me understand the topic better
Wow i thought i will learn pytorch but now i have learned neural networks as well as pytorch. Thanks!
Excellent brief explanation at around 150 seconds
Always great info on this channel. Thanks!
Particularly the tensor library is a must have for ML/ Data engineers - totally agree
Pytorch Lightning is what you should use these days. It cleans up the code quite a lot.
How?
The fact that the tesla autopilot example had the car crashing and failing to do it's job is just chefs kiss 😘. (00:53)
This video is a most excellent example of how to summarize!!!
Great video! Very informative
Beautiful, thanks, as Einstein said: "You don't really understand something unless you're able to explain it to your grandmother" ... and you have achieved it :)
woah, got an ad with your voice before this video, really trippy
As a college student who recently got into deep learning with TensorFlow, I can understand and relate to PyTorch. Both are fundamentally pretty similar.
The best way to put is is that TensorFlow is a library, whereas PyTorch is a framework. Also PyTorch is just way more pythonic than TensorFlow.
Tensorflow is more for scaling up with other systems, pytorch is most useful for stationary or researching different models. I find tensor flow much easier to learn, whereas pytorch requires more knowledge and memorization of the syntax. Both are useful for separate things, but you can use them in the place of another, except tensor flow since pytorch does not support a lot of the platforms still. It will support mobile in a couple years fully though. TensorFlow is my favourite one
0:52 I love these satirical inserts :D
Thanks for sharing this content!
I think you get way better results for an image classifier if you start with a convolutional layer instead of flattening the input instantly. I havn't tested it though.
Agree, but this video is just a basic introduction to PyTorch in 100 seconds. Introducing the convolutional layer makes the video even longer.
I’m going to pretend like I understood approximately 1 second in this video
well that was more then 100 seconds more information then any videos!
I have no idea what you just said, but I loved it.
This video basically summarized 75% of my 100hour long applicated-development class into 100 seconds...
Always look forward to these videos
I have no idea what Fireship talked about in this video but he made it look awesome. 😂
the quality of the analogy and abstraction to explain concepts is outstanding, kudos 👏👏👏
especially 0:41 - 0:42
Looking forward to more AI stuffs! Keep up the good work!
I really enjoyed watching this video
My resume can basically say - I am subscribed to Fireship.
Can you make a series on the youtube API? I wanna use it to auto-add technologies to my resume whenever you drop a new video.
Install pytorch and optionally CUDA. Getting the right CUDA version and pytorch version and the other things for your GPU to run properly. Was a pain in the ass for me.
1:26 miss-counted :-)
@0:20 -- *scalar
Finally I can say you read minds and released a video about something I just started learning
you litterally can read my mind. today i said it would be my first day learning python since i wanted to learn a language towards neural netwworks and ai... since javascript doesnt do that 💀
finally torch! be careful though, if you move your model to gpu, be sure to do the same for your data :)
Exciting! I've been meaning to get deeper into pytorch at some point
After learning Pytorch and seeing this vid, it gives every basic info
Thanks for this. Been trying to do more than django/flask with python and this is my next learning step
I always consider that ML/AI/Data is the main usage of Python and web framework like Django/Flask is just "hey we can do web dev using Python too!"
PyTorch is a more advanced version of "Machine Learning". Learning PyTorch without learning ML with scikitlearn is like learning to run without having learned to walk. AI is basically ML but scaled up and with extra algorithms on top, but it still applies ML logic.
@@SI0AX gotcha so go ML first before pytorch. Thanks for the advise
I would have appreciated a little more at the end showing how your neural network was working, perhaps with a simple UI
>pip install torch...cu117
>pip install thing
wtf is version "2.0.0+cu117"? No package management for you
>pip uninstall torch
>pip install thing
The thing is CUDAless
>pip uninstall torch
>pip install torch...cu117
Please tell me this doesn't only affect me.
Hello @fireship,
Can you please make a video about the python framework "flask" ? I am still confused about the functionalities and benefits of flask.
I made a chess playing CNN with PyTorch! It played great opening, and atrocious endgames
I understandthe words you used individually but strung together i got lost, still loved it
Can you make a tutorial on how to pick the right cuda version for use with Docker?
0:21 isn’t it “scalar” instead of “scaler” ?
idk why I was expecting him to write a model that learns to say hello world
This video was a game changer for me
I found this video very helpful
understood everything perfectly, gonna code skyned
The big downside of PyTorch is that creating your own dataset is very very hard. There's practically no documentation online, at least for greyscale images, and 90% of the tutorials you see just import a Torch library. If it weren't so heinous with its datasets, PyTorch would be great.
100s of pytorch, years of statistics and math to understand what's really happening.
I'm dying at the crash at 0:53