Visualizations of Deep Learning, Recurrent Neural Networks, and Evolutionary Algorithms
Thursday, June 24, 2010
Discretized RNN state-space
Here is a graph of the discretized state space of a recurrent neural network I trained on the
embedded Reber grammar
. Notice that the state space splits at the beginning in order to preserve information about the long-range transitions.
Links to this post