Recent Posts

Learning with Backpropagation

Learning with backpropagation is much like the delta rule; sensitivities are used to correct weights proportional to a constant learning rate or step size pa...

Backpropagation Derivation - Delta Rule

I enjoyed writing my background, however the bit I was really surprised to have enjoyed writing up is the derivation of back-propagation. I’ve read many book...

Background Tutorials

Recently I defended by PhD thesis, and was told by my examiners it might be good to share some of the background I wrote (which was honestly a bit excessive!...