A 'Brief' History of Neural Nets and Deep Learning, Part 4 – Andrey Kurenkov

About the mid-2000s neural net comeback, and how deep learning ascended to the tsunami it is today

“When you want a revolution, start with a conspiracy. With the ascent of Support Vector Machines and the failure of backpropagation, the early 2000s were a dark time for neural net research...