A few days ago (Jun 2017), a 100 page on Self-Normalizing Networks appeared. An amazing piece of theoretical work, it claims to have solved the
Author: Charles H Martin, PhD
Machine Learning Enthusiast and Consultant
Why Deep Learning Works 3: BackProp minimizes the Free Energy ?
?Deep Learning is presented as Energy-Based Learning Indeed, we train a neural network by running BackProp, thereby minimizing the model error–which is like minimizing an Energy. But
Foundations: Mean Field Boltzmann Machines 1987
A friend from grad school pointed out a great foundational paper on Boltzmann Machines. It is a 1987 paper from complex systems theory A Mean
Improving RBMs with physical chemistry
Restricted Boltzmann Machines (RBMs) are like the H atom of Deep Learning. They are basically a solved problem, and while of academic interest, not really used
MMDS 2016 Video Presentation
Why Deep Learning Works: Perspectives from Theoretical Chemistry:
on Cheap Learning: Partition Functions and RBMs
“Why does deep and cheap learning work so well?“ This is the question posed by a recent article. Deep Learning seems to require knowing the Partition
