On the Emergence of Invariant Low-Dimensional Subspaces in Gradient Descent for LearningDeepNetworks

[@imrajsingh5561]

Thanks for the great talk. I am trying to get a more inuitive understanding. In my mind's eye by taking a low-rank approximation of a network it is sort of like choosing the initialisation for the subsequent optimisation?