Back-propagation is fundamental to deep learning. Hinton (the inventor) recently said we should “throw it all away and start over”. What should we do? I’ll describe how back-propagation works, how its used in deep learning, then give 7 interesting research directions that could overtake back-propagation in the near term.
Code for this video:
Please Subscribe! And like. And comment.
More learning resources:
A Step by Step Backpropagation Example
Join us in the Wizards Slack channel:
And please support me on Patreon:
Facebook: https://www.facebook.com/sirajology Instagram: https://www.instagram.com/sirajraval/ Instagram: https://www.instagram.com/sirajraval/