Download presentation
Presentation is loading. Please wait.
1
Recurrent Neural Networks
2
Today Recurrent Neural Network Cell
Recurrent Neural Networks (unenrolled) LSTMs, Bi-LSTMs, Stacked Bi-LSTMs
3
Recurrent Neural Network Cell
π
ππ β 0 β 1 π₯ 1
4
Recurrent Neural Network Cell
β 1 =tanhβ‘( π ββ β 0 + π βπ₯ π₯ 1 ) π
ππ β 0 β 1 π₯ 1
5
Recurrent Neural Network Cell
π¦ 1 β 1 π
ππ β 0 β 1 β 1 =tanhβ‘( π ββ β 0 + π βπ₯ π₯ 1 ) π₯ 1 π¦ 1 =softmaxβ‘( π βπ¦ β 1 )
6
Recurrent Neural Network Cell
π¦ 1 β 1 π
ππ β 0 β 1 π₯ 1
7
Recurrent Neural Network Cell
π¦ 1 =[0.1, 0.05, 0.05, 0.1, 0.7] β 1 =[ ] π
ππ β 0 =[ ] π₯ 1 = [ ] a b c d e c
8
Generating Samples from the Recurrent Neural Network Cell
9
LSTM Cell (Long Short-Term Memory)
β 0 β 1 πΏπππ π 0 π 1 π₯ 1
11
Recurrent Neural Network Cell
π¦ 1 β 1 π
ππ β 0 β 1 π₯ 1
12
Recurrent Neural Network Cell
β 1 π
ππ β 0 β 1 π₯ 1
13
(Unrolled) Recurrent Neural Network
<<space>> π¦ 1 β 1 β 2 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 π₯ 1 π₯ 2 π₯ 3 c a t
14
(Unrolled) Recurrent Neural Network
cat likes eating π¦ 1 β 1 β 2 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 π₯ 1 π₯ 1 π₯ 1 the cat likes
15
(Unrolled) Recurrent Neural Network
positive / negative sentiment rating π¦ 1 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 π₯ 1 π₯ 1 π₯ 1 the cat likes
16
(Unrolled) Recurrent Neural Network
π₯ 1 π
ππ β 0 β 1 β 2 β 3 c a t <<space>> π¦ 1
20
Bidirectional Recurrent Neural Network
gato quiere comer π¦ 1 β 1 β 2 β 3 β 0 π΅π
ππ β 1 Bπ
ππ β 2 π΅π
ππ β 3 π₯ 1 π₯ 1 π₯ 1 the cat wants
21
Stacked Recurrent Neural Network
π¦ 1 π¦ 1 π¦ 1 β 1 β 2 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 β 1 β 2 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 π₯ 1 π₯ 1 π₯ 1 c a t
22
Bidirectional Stacked Recurrent Neural Network
π¦ 1 π¦ 1 β 1 β 2 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 β 1 β 2 β 3 β 0 π
ππ β 1 π
ππ β 2 π
ππ β 3 π₯ 1 π₯ 1 π¦ 1 π₯ 1 c a t
24
Questions?
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.