Why Does Deep Learning Work ? If we could get a better handle on this, we could solve some very hard problems in Deep Learning. A
Self-Regularization in Deep Neural Networks: a preview
Why Deep Learning Works: Self Regularization in DNNs An early talk describing details in this paper Implicit Self-Regularization in Deep Neural Networks: Evidence from Random
Rethinking–or Remembering–Generalization in Neural Networks
I just got back from ICLR 2019 and presented 2 posters, (and Michael gave a great talk!) at the Theoretical Physics Workshop on AI. To
Capsule Networks: A video presentation
Please enjoy my video presentation on Geoff Hinton’s Capsule Networks. What they are, why they are important, and how they are implemented (in Keras) …
Free Energies and Variational Inference
My Labor Day Holiday Blog: for those on email, I will add updates, answer questions, and make corrections over the next couple weeks. Thanks for
What is Free Energy: Hinton, Helmholtz, and Legendre
Hinton introduced Free Energies in his 1994 paper, Autoencoders, minimum description length, and Helmholtz Free Energy This paper, along with his wake-sleep algorithm, set the foundations
