http://distill.pub/2017/momentum/ was a really nice read, but oh gosh how heavy this webpage is...
Apart from that, really loved seeing the comparison of gradient descent momentum with physical momentum, and using that to deduce a way to reduce oscillations.