Topic 7: Neural Networks and Deep Learning

#Subtopics 5
Associated Papers TBA
etc

AAN Papers

TitleAuthorDateURL

Tutorials

TitleAuthorYearUrl
Deep Learning for NLP Richard Socher, Yoshua Bengio and Chris Manning 2012 http://nlp.stanford.edu/courses/NAACL2013/NAACL2013-Socher-Manning-DeepLearning.pdf
Embedding Methods for NLP Part 1: Unsupervised and Supervised Embeddings Jason Weston, Antoine Bordes 2014 http://emnlp2014.org/tutorials/8_notes.pdf
Deep Learning for Natural Language Processing Ronan Collobert, Jason Weston 2009 http://ronan.collobert.com/pub/matos/2009_tutorial_nips.pdf
Deep Learning & Neural Networks Lecture 1 Kevin Duh 2014 https://cs.jhu.edu/~kevinduh/a/deep2014/140114-ResearchSeminar.pdf
Deep Learning & Neural Networks Lecture 2 Kevin Duh 2014 https://cs.jhu.edu/~kevinduh/a/deep2014/140116-ResearchSeminar.pdf
Deep Learning & Neural Networks Lecture 3 Kevin Duh 2014 https://cs.jhu.edu/~kevinduh/a/deep2014/140121-ResearchSeminar.pdf
Deep Learning & Neural Networks Lecture 4 Kevin Duh 2014 https://cs.jhu.edu/~kevinduh/a/deep2014/140123-ResearchSeminar.pdf
Deep Learning Tutorial Kevin Duh 2015 Unavailable
Deep Learning for Natural Language Processing: Theory and Practice Xiaodong He, Jianfeng Gao, Li Deng 2014 https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/CIKM14_tutorial_HeGaoDeng.pdf
A Course in Machine Learning Hal Daume III 2015 http://ciml.info/dl/v0_8/ciml-v0_8-all.pdf
Using Neural Networks for Modelling and Representing Natural Languages Tomas Mikolov 2014 http://www.coling-2014.org/COLING%202014%20Tutorial-fix%20-%20Tomas%20Mikolov.pdf
Deep Learning Geoff Hinton, Yoshua Bengio & Yann LeCun 2015 https://www.iro.umontreal.ca/~bengioy/talks/DL-Tutorial-NIPS2015.pdf
Dublin School DL4MT: Deep Learning for Machine Translation Hermann Ney, Tamer Alkhouli, Kazuki Irie, Jan-Thorsten Peter 2015 Unavailable
Deep Learning for Natural Language Processing and Related Applications Xiaodong He, Jianfeng Gao, and Li Deng 2014 https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/ICASSP_DeepTextLearning_v07.pdf
Deep Learning Tutorial Yann LeCun, MarcAurelio Ranzato 2013 http://www.cs.nyu.edu/~yann/talks/lecun-ranzato-icml2013.pdf
Neural Machine Translation Thang Luong, Kyunghyun Cho, Christopher Manning 2016 http://nlp.stanford.edu/projects/nmt/Luong-Cho-Manning-NMT-ACL2016-v4.pdf
Semantic Representations of Word Senses and Concepts Josť Camacho Collados, Ignacio Iacobacci, Roberto Navigli, Mohammad Taher Pilehvar 2016 http://wwwusers.di.uniroma1.it/~collados/Slides_ACL16Tutorial_SemanticRepresentation.pdf
Grokking Deep Learning Andrew W. Trask 2016 https://www.manning.com/books/grokking-deep-learning

Non AAN Papers

TitleAuthorDateURL

Lectures

TitleLecturerDateURL
Libraries for Deep Learning Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/731.pdf
Recursive Neural Networks Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/743.pdf
Neural QA QANTA Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/755.pdf
Introduction to Deep Learning(1/3) Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/711.pdf
Introduction to Deep Learning(2/3) Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/712.pdf
Word Embeddings Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/721.pdf
Recurrent Neural Networks Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/741.pdf
Long Short Term Memory Networks(LSTM) Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/742.pdf
Convolutional Neural Networks Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/744.pdf
Neural Generation Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/756.pdf
Neural Parsing Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/752.pdf
Neural Machine Translation Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/753.pdf
Neural Summarization Dragomir Radev 2016 http://clair.eecs.umich.edu/aan/595/754.pdf

Assignments

TitleAuthorDateURL

Corpara

TitleAuthorDateURL

Libraries

TitleAuthorDateURL

Surveys

TitleAuthorDateURL
Representation Learning: A Review and New Perspectives Yoshua Bengio, Aaron Courville, Pascal Vincent 2014 https://arxiv.org/pdf/1206.5538v3.pdf
Natural Language Understanding with Distributed Representation Kyunghyun Cho 2015 https://arxiv.org/pdf/1511.07916v1.pdf
Deep Learning for Natural Language Processing Tianchuan Du, Vijay K. Shanker 2013 https://www.eecis.udel.edu/~vijay/fall13/snlp/lit-survey/DeepLearning.pdf
Deep Learning Methods and Applications Li Deng and Dong Yu 2014 http://www.nowpublishers.com/article/Details/SIG-039
Learning Deep Architectures for AI Yoshua Bengio 2009 http://www.iro.umontreal.ca/~bengioy/papers/ftml.pdf
A Primer on Neural Network Models for Natural Language Processing Yoav Goldberg 2015 http://u.cs.biu.ac.il/~yogo/nnlp.pdf
Vector Space Models of Lexical Meaning Stephen Clark 2014 http://www.cl.cam.ac.uk/~sc609/pubs/sem_handbook.pdf
word2vec Parameter Learning Explained Xin Rong 2015 http://www-personal.umich.edu/~ronxin/pdf/w2vexp.pdf

NACLO Problems

TitleAuthorDateURL
Kings, Queens, and Counts Tom McCoy 2016 http://www.nacloweb.org/resources/problems/2016/N2016-K.pdf

Return to Parent Topic