Computational Mechanics Group Meetings: 2007

Last update: 26 October 2007


Link to Group Readings

Link to 2006 Group Meetings


January Meetings: 10 Jan.  17 Jan.  24 Jan.  31 Jan.  

February Meetings: 7 Feb.  14 Feb.  21 Feb.  28 Feb. 

March Meetings: 7 Mar.  14 Mar.  21 Mar.  28 Mar. 

April Meetings: 5 Apr.  12 Apr.  19 Apr.  26 Apr. 

May Meetings: 3 May  10 May  17 May  24 May  31 May 

June Meetings: 7 June  14 June  21 June  27 June 

July Meetings: 4 July  11 July  18 July  25 July 

August Meetings: 1 Aug.  8 Aug.  15 Aug.  22 Aug.  29 Aug. 

September Meetings: 5 Sep.  12 Sep.  19 Sep.  26 Sep. 

October Meetings: 3 Oct.  9 Oct.  16 Oct.  23 Oct.  30 Oct. 

November Meetings: 6 Nov.  13 Nov.  20 Nov.  27 Nov. 

December Meetings: 4 Dec.  11 Dec.  18 Dec. 

January

top of page

10 Jan.

top of page
Start-of-quarter organizational meeting
Meetings for this Winter quarter will be Wednesdays, 12 noon until 1:00.
Please bring your lunch if you like.
Following are some potential topics & visitors for group meetings followed by the initials of the group member who will lead or implement. Please tell Benny if there is something you would like to add or if you have a strong preference/affinity for a particular topic:
Topics/Papers:

Historical Readings:

Speakers:

17 Jan.

top of page
Discussion of recent work on Reinforcement Learning
Benny Brown
12 Noon - 1:00, 1106 MSB

This will be a very informal discussion/overview of recent work I've been doing using techniques directly from the Sutton/Barto book.

24 Jan.

top of page
Paper discussion:
"Prediction and Entropy of Printed English"
Claude Shannon
Bell System Technical Journal, 50: 50-64.

» Link to the paper «

31 Jan.

top of page
Continuation of paper discussion:
"Prediction and Entropy of Printed English"
Claude Shannon
Bell System Technical Journal, 50: 50-64.

» Link to the paper «

February

top of page

7 Feb.

top of page
Continuation of paper discussion:
"Prediction and Entropy of Printed English"
Claude Shannon
Bell System Technical Journal, 50: 50-64.

» Link to the paper «

14 Feb.

top of page
An information theoretic approach to behavioral learning
Susanne Still (Dept. of Information and Computer Sciences, University of Hawaii, Manoa)
12 noon - 1pm, 1106 MSB
Abstract:

Consider an active agent that is learning about and behaving in an environment which it can influence by its own actions. Different actions will lead to different future observations, and intuitively, some action strategies should make it easier than others for the agent to construct a model that generalizes well to future observations. We take a novel approach to behavioral learning, based on this intuition. Formally, our approach is based on Shannon's mathematical theory of communication. We develop a theoretical framework that extends rate-distortion theory and the related Information Bottleneck method to a feed-back situation. This framework also allows us to take a fresh look at exploration in reinforcement learning (RL) and, in particular, at curiosity driven RL. One central result is that the optimal action strategies are characterized by a balance between exploration and control. In the case of reinforcement learning, when a goal is specified and optimized, exploration is balanced with exploitation. This balance emerges naturally from the information theoretically motivated principle without the need of extra heuristics.

21 Feb.

top of page
Some studies on disorder and noise in statistical physics
Soumen Roy
12 noon - 1pm, 1106 MSB
Abstract:

Small-world networks have important applications in science and technology. Recent renormalization group results predict non self averaging behaviour at criticality for relevant disorder. However, we find strong self averaging (SA) behaviour in the critical region of a quenched Ising model on an ensemble of small-world networks, despite the relevance of random bonds at the pure critical point.

The Asymmetric exclusion process (ASEP) is one of the paradigms of non-equilibrium statistical physics where the boundary conditions play a non-trivial role in determining the stable phase diagram of open systems, as opposed to equilibrium systems, where conditions in the bulk are paramount. We show that the introduction of disorder in the recent Fermionic generalisation of ASEP markedly changes the phase diagram by introducing an extra phase and changing the the multicritical point.

28 Feb.

top of page
Continuation of Talk: Some studies on disorder and noise in statistical physics
Soumen Roy
12 noon - 1pm, 1106 MSB
Abstract:

Thermal ratchets and Brownian motors are known to have important applications in science, engineering and even in game theory. However, Brownian motors exhibit sub-percentage efficiency. We present a prescription to achieve enhanced thermodynamic efficiency of energy transduction in Brownian motors and show that an efficiency close to the ideal limit can be obtained in the deterministic regime.

Noise-induced transport is inevitably beset with diffusion. This can lead to a loss of the ratcheting effect in systems with finite spatial extensions. We show that the suppression of backward currents can lead to an extremely reliable transport (quantified by the Peclet number) in rocked ratchets. The values of Peclet number so attained are the highest in theoretical studies on Brownian motors till date.

March

top of page

7 Mar.

top of page
Continuation of paper discussion:
"Prediction and Entropy of Printed English"
Claude Shannon
Bell System Technical Journal, 50: 50-64.

» Link to the paper «

14 Mar.

top of page
We will be discussing selected sections of the following paper:
"General Properties of Entropy"
Alfred Wehrl
Rev. Mod. Phys., 50.2 (1978): 221-260.
Sections:

» Link to the paper «

21 Mar.

top of page
» No Meeting This week «

28 Mar.

top of page
» No Meeting This week «

April

top of page

5 Apr.

top of page
Start-of-quarter meeting
We have two things to discuss for this week's meeting:

  1. We need to determine a new meeting time for this quarter.
  2. We will be continuing and adding to our discussion of the paper
  3. "General Properties of Entropy"
    Alfred Wehrl
    Rev. Mod. Phys., 50.2 (1978): 221-260.
    Sections read for last time:

    • Introduction (p. 221)
    • I.A.1-2 (pp. 222-224)
    • II.C (pp. 239-240)
    • II.G (pp. 247-248)

    Additional section for this meeting:

    • IV. Related Concepts (pp. 253-258)

» Link to the paper «


12 Apr.

top of page
Meeting time for this quarter will be Thursdays, 11:00-Noon, 1106 MSB

Rate Distortion Theory and the Information Bottleneck Method
Susanne Still (Dept. of Information and Computer Sciences, University of Hawaii, Manoa)
11:00 - 12 noon, 1106 MSB

19 Apr.

top of page
Continuation of paper discussion:
"General Properties of Entropy"
Alfred Wehrl
Rev. Mod. Phys., 50.2 (1978): 221-260.
We will be focussing primarily on section IV. Related Concepts (pp. 253-258)

» Link to the paper «

26 Apr.

top of page
Paper discussion:
"Communication Theory of Secrecy Systems"
Claude Shannon
Material taken from declassified report, "Mathematical Theory of Cryptography" (1946): 656-715.
We will be discussing primarily section 2 Secrecy Systems (pp. 660-664), although you may want to also read the section 1 introduction for some background and context.

» Link to the paper «

May

top of page

3 May

top of page
>>> Canceled <<<

10 May

top of page
Continuation of paper discussion:
"Communication Theory of Secrecy Systems"
Claude Shannon
Material taken from declassified report, "Mathematical Theory of Cryptography" (1946): 656-715.
We will be discussing chapter 4 onward.

» Link to the paper «

17 May

top of page
Continuation of paper discussion:
"Communication Theory of Secrecy Systems"
Claude Shannon
Material taken from declassified report, "Mathematical Theory of Cryptography" (1946): 656-715.
We will be discussing chapter 7 onward.

» Link to the paper «

24 May

top of page

John Mahoney will be giving a practice talk for his upcoming oral exam on Quantum Finite State Machines.

31 May

top of page
We will be taking a tour of the KeckCAVES.

Time: 11:00am - Noon+
Place: KeckCAVES, Basement of Physics/Geology Building

June

top of page

7 June

top of page
We will be continuing our tour of the KeckCAVES, looking at the dynamics simulators.

Time: 11:00am - Noon+
Place: KeckCAVES, Basement of Physics/Geology Building

14 June

top of page
» No Meeting This week «

21 June

top of page
Continuation of paper discussion:
"Communication Theory of Secrecy Systems"
Claude Shannon
Material taken from declassified report, "Mathematical Theory of Cryptography" (1946): 656-715.
We will be discussing chapter 8 onward.

» Link to the paper «

27 June

top of page
Book Chapter Discussion:
Pattern Recognition and Machine Learning
Christopher M. Bishop
We will be focusing on Chapter 13, sections 13.0 up to and including 13.2.1 (pp.605-618).

» Link to the reading «

This document contains the first half of the chapter, including this week's reading. The second half can be found here.

July

top of page

4 July

top of page
No Meeting — Happy 4th of July!

11 July

top of page
Continuation of Book Chapter Discussion:
Pattern Recognition and Machine Learning
Christopher M. Bishop
We will be focusing on sections 13.2 and 13.2.1 (pp.610-618).

» Link to the reading «

This document contains the first half of the chapter, including this week's reading. The second half can be found here.

18 July

top of page
Continuation of Book Chapter Discussion:
Pattern Recognition and Machine Learning
Christopher M. Bishop
We will be further discussing the EM algorithm in sections 13.2.2 and 13.2.3 and Chris Ellison will provide an example to aid in our understanding.

» Link to the reading «

This document contains the first half of the chapter, including this week's reading. The second half can be found here.

25 July

top of page
Continuation of Book Chapter Discussion:
Pattern Recognition and Machine Learning
Christopher M. Bishop
We will be finishing up our discussion of the chapter with sections 13.2.5 and 13.2.6, possibly moving onto 13.3 (Linear Dynamical Systems) if time permits.

Please note that this reading is in the second half of chapter 13, so you may have to download or print the second PDF (linked below) if you haven't yet done so.

» Link to the reading «

August

top of page

1 Aug.

top of page
Paper discussion:
"Teaching the renormalization group"
Humphrey J. Maris and Leo P. Kadanoff
American Journal of Physics, 46(6): 652-657.

» Link to the paper «

8 Aug.

top of page
Dave Albers will be speaking about time-delay dynamical systems.

Title:

Detection, Discovery, and Analysis of Structure in High-Dimensional, Time-Delay Dynamical Systems: A Survey of Recent Results

Abstract:

Deducing, inferring and understanding the dynamics and geometric structures in high-dimensional, time-dependent systems has been, and will continue to be, a problem of considerable interest and importance to engineers, natural scientists, and mathematicians. The primary goal of this survey is to present various means of deducing geometrical structure and organization in high-dimensional, time-delay, chaotic dynamical systems that cannot be reduced to low-dimensional analogs. In this circumstance, the rescaling of time in conjunction with adding dimensionality can have an effect on both the fundamental properties of the dynamical system and on many common diagnostics used to study such systems. Because of the interaction between rescaling time and adding dimensions, both the effects of time/dimension on the geometric structure of the system (or ensemble of systems) as indicated by the diagnostics, as well as the effects of time rescaling on the diagnostics, will be discussed. General conclusions include: an invariance of the entropy to time-rescaling; persistence of chaotic dynamics as the dimension is increased; dimension calculations may yield deceiving results; and a tendency towards a continuous-LCE-spectrum dynamic as time-delay coordinates are added. Finally, preliminary results regarding the rescaling of LCEs via homogeneous functions is presented.

15 Aug.

top of page
Dave Albers will be continuing his talk from 8 August on time-delay dynamical systems.

22 Aug.

top of page
Rebecca, Kristin, and Benny will be giving an overview of the RoMADS project and demonstrations of progress achieved over the summer.

29 Aug.

top of page
» No Meeting This Week «

September

top of page

5 Sep.

top of page
Book Chapter Discussion:
Reinforcement Learning
Richard Sutton and Andrew Barto
We will be discussing sections 5.1 through 5.3 (pp. 111-121).

» Link to the reading «

12 Sep.

top of page
Continuation of Book Chapter Discussion:
Reinforcement Learning
Richard Sutton and Andrew Barto
We will be discussing sections 5.1 through 5.3 (pp. 111-121).

» Link to the reading «

19 Sep.

top of page
John Mahoney will be giving a practice talk on quantum finite state machines for his upcoming oral exam.

26 Sep.

top of page
For this week's meeting we have a few orders of business to discuss:

October

top of page

3 Oct.

top of page
Chris Ellison will be giving a talk on recent work he has done on measures, probability distributions, simplexes, and perhaps estimating channel capacity.

9 Oct.

top of page

Please note the NEW TIME AND DAY of the group meeting: Tuesdays, 2:00 - 3:00pm, MSB 1106

Paper discussion:
"Automatic Synthesis of Multiple Internal Models Through Active Exploration"
Josh Bongard and Hod Lipson

» Link to the paper «

16 Oct.

top of page
Paper discussion:
"Insects, Trees, and Climate: The Bioacoustic Ecology of Deforestation and Entomogenic Climate Change"
David Dunn and James P. Crutchfield

» Link to the paper «

23 Oct.

top of page
Jesse Singh will be giving a practice talk on Chaotic Crystallography in preparation for the California APS meeting Oct. 26-27 at Lawrence Berkeley National Lab.

30 Oct.

top of page
Paper discussion:
"Shear-Induced Chaos"
Kevin K. Lin and Lai-Sang Young
Because the paper is rather lengthy, we will be focusing on three sections:

» Link to the paper «

November

top of page

6 Nov.

top of page
TBD

13 Nov.

top of page
TBD

20 Nov.

top of page
TBD

27 Nov.

top of page
TBD

December

top of page

4 Dec.

top of page
TBD

11 Dec.

top of page
TBD

18 Dec.

top of page
TBD