A Review of Hyperparameter Tuning Techniques for Neural Networks

Curious about deep learning? Start with the Fundamentals of Deep Learning booklet to learn the essentials in 25 pages - misraturp.gumroad.com/l/fdl
👇 Watch my full course on deep learning on UA-cam
• 50 Days of Deep Learning
Let's look into the commonly used hyperparameter tuning techniques for Neural Networks in this video.
We will look into Grid search, Random search, Manually zooming in and some other sophisticated techniques such as Bayesian search, gradient-based search and evolutionary algorithms.
Here are the libraries that implement some of these techniques:
Hyperopt - hyperopt.github.io/hyperopt/
Keras tuner - keras.io/keras_tuner/
Scikit-optimize - scikit-optimize.github.io/sta...
Sklearn-Deap - github.com/rsteca/sklearn-deap
Hyperband - github.com/zygmuntz/hyperband
RESOURCES:
Data Science Kick-starter mini-course: www.misraturp.com/courses/dat...
Pandas cheat sheet: misraturp.gumroad.com/l/pandascs
Streamlit template: misraturp.gumroad.com/l/stemp
NNs hyperparameters cheat sheet: www.misraturp.com/nn-hyperpar...
Fundamentals of Deep Learning in 25 pages: misraturp.gumroad.com/l/fdl
COURSES:
Hands-on Data Science: Complete your first portfolio project: www.misraturp.com/hods
Website - misraturp.com/
Twitter - / misraturp

[@misraturp]

🤔 Curious about deep learning?
Start with the Fundamentals of Deep Learning booklet to learn the essentials in 25 pages
misraturp.gumroad.com/l/fdl

[@secondaryvegetationjuggern781]

Why am I only discovering this now 😢 For non-native English speakers like me, this is very helpful because you speak clearly on each words. In addition, the explanations are easy to understand

[@rafikabenledghem9212]

It just about what I was looking for, thnx a lot you're just amazing

[@danja5512]

Great introduction to hyperparam tuning - thank you! Do you have any tipps or articles about hyperparam tuning in Nuronal Networks for Time Series problems?

[@magedsaeed1710]

Thanks for this talk. I wonder why ray is not mentioned as an industry standard solution for tuning and distributed computing in general.

[@hsoley]

Another great Video Misra! keep them coming!

[@misraturp]

Thanks Hamid!

[@Abdelrahman-nj2pl]

Thanks so much for this amazing video

[@sergiocalvo6410]

Thanks for doing this! Amazing video

[@misraturp]

Thank you!

[@Leo-wk7py]

thanks, great video. when you have time share your knowledge.

[@misraturp]

Thanks Leo!

[@ayenewyihune]

Great vid, thanks

[@misraturp]

You're welcome :)

[@muddassarjilani4637]

very informative video

[@misraturp]

glad you liked it!

[@MrAymaneng]

It is great

[@HasanKarakus]

06:10 Yarattığı etki ua-cam.com/users/shorts5wbrtagi08U?feature=share

[@ericbroun4657]

[@misraturp]

🤗

[@debojitmandal8670]

hi mam your beautiful altough i came to study here but i thought of letting u know this