FANDOM


This page contains resources about Deep Learning and Representation Learning .

Subfields and ConceptsEdit

  • Deep Generative Models
    • Deep Directed Networks (directed graphical models)
      • Sigmoid Belief Net
      • Differentiable Generator Net
      • Variational Autoencoder (VAE)
      • Generative Adversarial Network (GAN)
      • Generative Moment Matching Network
      • Convolutional Generative Network
      • Auto-Regressive Network / Fully-visible Bayes Network (FVBN)
      • Deep Latent Gaussian Model (DLGM)
      • Deep AutoRegressive Network (DARN)
    • Deep Boltzmann Machines (undirected graphical models)
    • Deep Belief Networks (mixed graphs)
  • Deep Neural Networks (i.e. more than two hidden layers)
    • Deep Multi-Layer Perceptron (i.e. Stacked RBMs) 
    • Deep Autoencoders
      • DARN 
    • Deep Neural Decision Forests 
    • Convolutional Deep Belief Network (i.e. Stacked CRBMs)  
  • Sparse Coding / Dictionary Learning
    • Sparse Autoencoders
    • Stacked Denoising Autoencoders
  • Bayesian Deep Learning
    • Bayesian Neural Networks

Online CoursesEdit

Video LecturesEdit


Lecture NotesEdit

Books and Book ChaptersEdit

  • Bengio, Y. (2009). Learning Deep Architectures for AI. Foundations and Trends® in Machine Learning, 2(1), 1-127. Now Publishers.
  • Orr, G. B., & Müller, K. R. (2012). Neural Networks: Tricks of the Trade. Springer.
  • Murphy, K. P. (2012). "Chapter 28: Deep Learning". Machine Learning: A Probabilistic Perspective. MIT Press.
  • Bengio, Y.,  & Courville, A. (2013). Deep Learning of Representations. Springer.
  • Deng, L., & Yu, D. (2014). Deep Learning. Foundations and Trends in Signal Processing7, 3-4.
  • Theodoridis, S. (2015). "Chapter 18: Neural Networks and Deep Learning". Machine Learning: A Bayesian and Optimization Perspective. Academic Press.
  • Gibson, A., & Patterson J. (2016). Deep Learning: A Practitioner's Approach. O'Reilly Media.
  • Bengio, Y., Goodfellow, I. J., & Courville, A. (2016). Deep Learning. MIT Press. (draft)
  • Chollet, F. (2017). Deep Learning with Python. Manning Publications.
  • Gulli, A., & Kapoor, A. (2017). TensorFlow 1.x Deep Learning Cookbook. Packt Publishing.

Scholarly ArticlesEdit

See Reading List and Recommended Readings for the complete list.

TutorialsEdit

SoftwareEdit

See Software Links for the complete list.

See alsoEdit

Other ResourcesEdit