Evolving Stuff

Visualizations of Deep Learning, Recurrent Neural Networks, and Evolutionary Algorithms

Monday, January 18, 2010

n-grams as finite state machines

I'm going through Foundations of Statistical Natural Language Processing and decided to create some visualizations of n-grams as finite state machines to improve my intuitive understanding of them.

For alphabet {0,1} and n = 3:



For alphabet {0,1} and n = 4:



For alphabet {0,1,2} and n = 3:



I find it fascinating that such a simple concept (the n-gram) can produce such intricate structures.
Posted by Unknown at 2:58 PM

No comments:

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments (Atom)

About Me

Unknown
View my complete profile

Blog Archive

  • ►  2015 (2)
    • ►  July (1)
    • ►  March (1)
  • ►  2013 (1)
    • ►  August (1)
  • ►  2012 (6)
    • ►  December (4)
    • ►  June (1)
    • ►  April (1)
  • ►  2011 (9)
    • ►  August (1)
    • ►  June (1)
    • ►  March (4)
    • ►  February (2)
    • ►  January (1)
  • ▼  2010 (7)
    • ►  December (1)
    • ►  November (1)
    • ►  July (1)
    • ►  June (1)
    • ►  March (2)
    • ▼  January (1)
      • n-grams as finite state machines
  • ►  2009 (3)
    • ►  November (1)
    • ►  August (1)
    • ►  June (1)
  • ►  2008 (1)
    • ►  July (1)
  • ►  2007 (1)
    • ►  January (1)
  • ►  2006 (7)
    • ►  October (1)
    • ►  July (1)
    • ►  May (2)
    • ►  March (1)
    • ►  January (2)
  • ►  2005 (9)
    • ►  December (1)
    • ►  October (2)
    • ►  September (1)
    • ►  July (1)
    • ►  June (4)
Simple theme. Powered by Blogger.