L11.5 Weight Initialization -- Why Do We Care?

Sebastian's books: sebastianrasch...
Slides: sebastianrasch...
-------
This video is part of my Introduction of Deep Learning course.
Next video: • L11.6 Xavier Glorot an...
The complete playlist: • Intro to Deep Learning...
A handy overview page with links to the materials: sebastianrasch...
-------
If you want to be notified about future videos, please consider subscribing to my channel: / sebastianraschka

[@haochengzhao7483]

Even if we use BN, is initialization still important?

[@SebastianRaschka]

I think it is far less important then. But it's hard to say exactly because in practice most people use the PyTorch defaults (which is currently He initialization I think)