Historical trends in deep learning

  • Deep learning has had a long and rich history, but has gone by many names reflecting different philosophical viewpoints, and has waxed and waned in popularity.
  • Deep learning has become more useful as the amount of available training data has increased.
  • Deep learning models have grown in size over time as computer infrastructure (both hardware and software) for deep learning has improved.
  • Deep learning has solved increasingly complicated applications with increasing
    accuracy
    over time.

Goodfellow, Bengio, Courville - «Deep Learning» (2016)