How to Create Efficient Training Pipelines with TensorFlow data.Dataset (Tensorflow Datasets)
Вставка
- Опубліковано 21 вер 2024
- The Colab Notebook: colab.research...
TF.data.Dataset Docs: www.tensorflow...
Thank you for watching the video! You can learn Data Science FASTER at mlnow.ai/ :)
Master Python at mlnow.ai/cours...!
Learn SQL & Relational Databases at mlnow.ai/cours...!
Learn NumPy, Pandas, and Python for Data Science at mlnow.ai/cours...!
Become a Machine Learning Expert at mlnow.ai/cours...!
Don't forget to subscribe if you enjoyed the video :D
Take my courses at mlnow.ai/!
F!!! its a functional lazy eval. Argh, was clear as mud before, now crystal clear. Thanks!
the way I understood it, is that on the first epoch, the processed data gets cached. and therefore, subsequent epochs, we don't need to preprocess, since we can now use the cached data instead. since they are the same anyway. no need to repeat it for each epoch.
Yes, that's right. In my phrasing, I may have dumbed it down slightly while still providing what's important to understand
What an awesome tutorial man! Keep up the great work, really learned a lot!
Thanks I really appreciate that!
very well document , I hope you make a video on best practice neural network when it faced overfitting
9:41 Oh so it turns data from uint8 to float32 only when needed and this actually saves a lot of memory I've already preprocessed my data but can now do resizing in Pipeline
Great video Greg, thank you.
OMG this was so fcking useful, really good and deep material. Thanks!
Glad to hear it!!
Hello, and thank you for this great content.
What may happen if you have multi-input models and large datasets? Would you use the for loop to separate the input features and the labels?
Excellent! Clear and helpful
Super glad to hear it!
what would be also cool is to see a video on vision transformer?
Sounds good.
Good stuff
hi greg we need a road map for sql or at least some course suggestions , or a tutorial from you will be great
You might want to check this Specialization out: ua-cam.com/video/V6pZ_-4KPYA/v-deo.html
thank you very much, but how can I print the result from the model and visualization the actual data and prediction data
Please make a video on how to train voice model stem by step in pycharm, please sir make video on this
Wonderful
Thank you 😊
Is there a way to see what you have already included in the pipeline?
That's a great question. I actually don't know the answer.
doesn't cache simply mean, take that data and put it in local memory for reuse again? not sure what point I am missing.
Their caching process is rather complex. I would just think of it as remembering.
Could you make a review on HyperSkill Python course. I’ve heard it’s very good but not sure.
Never heard of it.
@@GregHogg It’s also known as JetBrains Academy. It’s entire structure is project based learning and they have a Python Core track and a new Machine Learning in Python course.
may be PyTorch also has something like this? is it very different?
I'm just learning it now. When I feel I understand everything well enough, I will teach it back :)
it seems like a really unintuitive way to create a pipeline. wouldn't it be better to create a list of first class functions, where each function within the list does a step in the pipeline.
You could make a function where it does a list of those functions
imparator