Schedule and Readings

The Tower of Babel

Schedule is subject to change

Week	Date	Topic	Readings (ⓘ=recommended supplemental)
1	Jan 17	Course overview and required tools	ⓘ Shotts, The Linux Command Line: A Complete Introduction ⓘ Chacon & Straub, Pro Git ⓘ Wikibooks.org, LaTeX ⓘ Oetiker, et al, The Not So Short Introduction to LaTeX 2e
1	Jan 19	Background and motivation	Rojas, Neural Networks: A Systematic Introduction (Ch. 1) YouTube, The Thinking Machine (Artificial Intelligence in the 1960s) YouTube, Perceptron Research from the 50's & 60's
2	Jan 24	Mathematical foundations: binary and threshold logic	Rojas, Neural Networks: A Systematic Introduction (Ch. 2)
2	Jan 26	Perceptron	Rojas, Neural Networks: A Systematic Introduction (Ch. 3)
3	Jan 31	Perceptron learning	Rojas, Neural Networks: A Systematic Introduction (Ch. 4)
3	Feb 02	Basic layered networks	Rojas, Neural Networks: A Systematic Introduction (Ch. 6)
4	Feb 07	Mathematical foundations: differential calculus
4	Feb 09	Mathematical foundations: algorithmic differentiation
5	Feb 14	Backpropogation	Rojas, Neural Networks: A Systematic Introduction (Ch. 7)
5	Feb 16	Mathematical foundations: linear algebra	Goodfellow et al, Deep Learning (Ch. 2)
6	Feb 21	Machine learning basics	Goodfellow et al, Deep Learning (Ch. 5)
6	Feb 23	Feedforward neural networks	Goodfellow et al, Deep Learning (Ch. 6)
7	Feb 28	Feedforward neural network language models
7	Mar 02	Regularization	Goodfellow et al, Deep Learning (Ch. 6)
8	Mar 07	No class
8	Mar 09	Midterm exam
9	Mar 14	Optimization	Goodfellow et al, Deep Learning (Ch. 8)
9	Mar 16	Convolutional neural networks	Goodfellow et al, Deep Learning (Ch. 9)
10	Mar 21	Spring Break
10	Mar 23	Spring Break
11	Mar 28	Recurrent neural networks	Goodfellow et al, Deep Learning (Ch. 10)
11	Mar 30	Autoencoders	Goodfellow et al, Deep Learning (Ch. 14)
12	Apr 04	LSTMs and GRUs	Olah, Understanding LSTM Networks
12	Apr 06	Encoder-decoder	Sutskever et al, Sequence to Sequence Learning with Neural Networks Sutskever et al, Video presentation of "Sequence to Sequence Learning with Neural Networks"
13	Apr 11	Attention mechanism	Bahdanau et al, Neural Machine Translation by Jointly Learning to Align and Translate
13	Apr 13	Multilingual machine translation	Firat et al, Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Johnson et al, Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation
14	Apr 18	Multimodal NNs	Elliott et al, Multilingual Image Description with Neural Sequence Models
14	Apr 20	OCR
15	Apr 25	WMT NMT shared task
15	Apr 27	WMT NMT shared task
16	May 02	Final exam