Fei-Fei Li & Justin Johnson & Serena Yeung
April 18, 2017Lecture 5 -
Lecture 5:
Convolutional Neural Networks
1
Fei-Fei Li & Justin Johnson & Serena Yeung
April 18, 2017Lecture 5 -
Administrative
Assignment 1 due Thursday April 20, 11:59pm on Canvas
Assignment 2 will be released Thursday
2
Fei-Fei Li & Justin Johnson & Serena Yeung
April 18, 2017Lecture 5 -
3
Linear score function:
2-layer Neural Network
Last time: Neural Networks
x
h
W1
s
W2
3072 100
10
3
Fei-Fei Li & Justin Johnson & Serena Yeung
April 18, 2017Lecture 5 -
4
Next: Convolutional Neural Networks
Illustration of LeCun et al. 1998 from CS231n 2017 Lecture 1
4
Fei-Fei Li & Justin Johnson & Serena Yeung
April 18, 2017Lecture 5 -
Fei-Fei Li & Justin Johnson & Serena Yeung
Lecture 5 - April 18, 2017
5
Frank Rosenblatt, ~1957: Perceptron
The Mark I Perceptron machine was the first
implementation of the perceptron algorithm.
The machine was connected to a camera that used
20×20 cadmium sulfide photocells to produce a 400-pixel
image.
recognized
letters of the alphabet
update rule:
A bit of history...
This image by Rocky Acosta is licensed under CC-BY 3.0