Visualizations of Deep Learning, Recurrent Neural Networks, and Evolutionary Algorithms
Thursday, June 24, 2010
Discretized RNN state-space
Here is a graph of the discretized state space of a recurrent neural network I trained on the embedded Reber grammar. Notice that the state space splits at the beginning in order to preserve information about the long-range transitions.