Natural Computation and Self-Organization:
The Physics of Information Processing in Complex Systems

Jim Crutchfield
chaos@cse.ucdavis.edu; http://cse.ucdavis.edu/~chaos

Winter 2008
WWW: http://cse.ucdavis.edu/~chaos/courses/ncaso/

Lecture 13: Information in Processes

Reading: EIT, Sec. 5-5.4 and 8-8.7 and Chapter 4.

Topics:

  1. Review last lecture.
  2. Communication channels
  3. Coding theorems
  4. Entropy rates for Markov chains
  5. Entropies for stochastic processes

Reading for next meeting: CMR article RURO.