Please enjoy my video presentation on Geoff Hinton’s Capsule Networks. What they are, why they are important, and how they are implemented (in Keras) …
Free Energies and Variational Inference
My Labor Day Holiday Blog: for those on email, I will add updates, answer questions, and make corrections over the next couple weeks. Thanks for
What is Free Energy: Hinton, Helmholtz, and Legendre
Hinton introduced Free Energies in his 1994 paper, Autoencoders, minimum description length, and Helmholtz Free Energy This paper, along with his wake-sleep algorithm, set the foundations
Interview with a Data Scientist
It’s always fun to be interviewed. Check out my recent chat with Max Mautner, the Accidental Engineer http://theaccidentalengineer.com/charles-martin-principal-consultant-calculation-consulting/
Normalization in Deep Learning
A few days ago (Jun 2017), a 100 page on Self-Normalizing Networks appeared. An amazing piece of theoretical work, it claims to have solved the
Why Deep Learning Works 3: BackProp minimizes the Free Energy ?
?Deep Learning is presented as Energy-Based Learning Indeed, we train a neural network by running BackProp, thereby minimizing the model error–which is like minimizing an Energy. But
