This survey demonstrates that the measures of pattern from information theory and computational mechanics differ from known thermodynamic and statistical mechanical functions. Moreover, they capture important structural features that are otherwise missed. In particular, a type of mutual information called the excess entropy---an information theoretic measure of memory---serves to detect ordered, low entropy density patterns. It is superior in many respects to other functions used to probe the structure of a configuration distribution, such as magnetization and structure factors. $\epsilon$-Machines---the main objects of computational mechanics---are seen to be the most direct approach to revealing the (group and semigroup) symmetries possessed by the spatial patterns and to estimating the minimum amount of memory required to reproduce the configuration ensemble, a quantity known as the statistical complexity. Finally, we argue that the information theoretic and computational mechanical analyses of spatial patterns capture the intrinsic computational capabilities in spin systems---how they store, transmit, and manipulate configurational information to produce spatial structure.">

This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Discovering Noncritical Organization: Statistical Mechanical, Information Theoretical, and Computational Views of Patterns in One-Dimensional Spin Systems

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
David P. Feldman
James P. Crutchfield
Abstract

We compare and contrast three different, but complementary views of "structure" and "pattern" in spatial processes. For definiteness and analytical clarity we apply all three approaches to the simplest class of spatial processes: one-dimensional Ising spin systems with finite-range interactions. These noncritical systems are well suited for this study since the change in structure as a function of system parameters is more subtle than that found in critical systems where, at a phase transition, many observables diverge thereby making the detection of change in structure obvious.

This survey demonstrates that the measures of pattern from information theory and computational mechanics differ from known thermodynamic and statistical mechanical functions. Moreover, they capture important structural features that are otherwise missed. In particular, a type of mutual information called the excess entropy---an information theoretic measure of memory---serves to detect ordered, low entropy density patterns. It is superior in many respects to other functions used to probe the structure of a configuration distribution, such as magnetization and structure factors. $\epsilon$-Machines---the main objects of computational mechanics---are seen to be the most direct approach to revealing the (group and semigroup) symmetries possessed by the spatial patterns and to estimating the minimum amount of memory required to reproduce the configuration ensemble, a quantity known as the statistical complexity. Finally, we argue that the information theoretic and computational mechanical analyses of spatial patterns capture the intrinsic computational capabilities in spin systems---how they store, transmit, and manipulate configurational information to produce spatial structure.

Download Info
To our knowledge, this item is not available for download. To find whether it is available, there are three options:
1. Check below under "Related research" whether another version of this item is available online.
2. Check on the provider's web page whether it is in fact available.
3. Perform a search for a similarly titled item that would be available.

Publisher Info
Paper provided by Santa Fe Institute in its series Working Papers with number 98-04-026.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length:
Date of creation: Apr 1998
Date of revision:
Handle: RePEc:wop:safiwp:98-04-026

Contact details of provider:
Postal: 1399 Hyde Park Road, Santa Fe, New Mexico 87501
Web page: http://www.santafe.edu/sfi/publications/working-papers.html
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Thomas Krichel).

Related research
Keywords: Ising spin system information theory structural complexity statistical mechanics computational mechanics entropy

This paper has been announced in the following NEP Reports:

Statistics
Access and download statistics

Did you know? There are over 16000 authors registered on RePEc Author Service.

This page was last updated on 2008-7-29.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.