Evolving Stuff

Visualizations of Deep Learning, Recurrent Neural Networks, and Evolutionary Algorithms

Thursday, June 24, 2010

Discretized RNN state-space



Here is a graph of the discretized state space of a recurrent neural network I trained on the embedded Reber grammar. Notice that the state space splits at the beginning in order to preserve information about the long-range transitions.
Posted by Unknown at 6:10 PM No comments:
Newer Posts Older Posts Home
Subscribe to: Posts (Atom)

About Me

Unknown
View my complete profile

Blog Archive

  • ►  2015 (2)
    • ►  July (1)
    • ►  March (1)
  • ►  2013 (1)
    • ►  August (1)
  • ►  2012 (6)
    • ►  December (4)
    • ►  June (1)
    • ►  April (1)
  • ►  2011 (9)
    • ►  August (1)
    • ►  June (1)
    • ►  March (4)
    • ►  February (2)
    • ►  January (1)
  • ▼  2010 (7)
    • ►  December (1)
    • ►  November (1)
    • ►  July (1)
    • ▼  June (1)
      • Discretized RNN state-space
    • ►  March (2)
    • ►  January (1)
  • ►  2009 (3)
    • ►  November (1)
    • ►  August (1)
    • ►  June (1)
  • ►  2008 (1)
    • ►  July (1)
  • ►  2007 (1)
    • ►  January (1)
  • ►  2006 (7)
    • ►  October (1)
    • ►  July (1)
    • ►  May (2)
    • ►  March (1)
    • ►  January (2)
  • ►  2005 (9)
    • ►  December (1)
    • ►  October (2)
    • ►  September (1)
    • ►  July (1)
    • ►  June (4)
Simple theme. Powered by Blogger.