title: Multiresolution wavelet analysis of heartbeat intervals discriminates healthy patients from those with cardiac pathology

abstract: We applied multiresolution wavelet analysis to the sequence of times between human heartbeats (R-R intervals) and have found a scale window, between 16 and 32 heartbeats, over which the widths of the R-R wavelet coefficients fall into disjoint sets for normal and heart-failure patients. This has enabled us to correctly classify every patient in a standard data set as either belonging to the heart-failure or normal group with 100% accuracy, thereby providing a clinically significant measure of the presence of heart-failure from the R-R intervals alone. Comparison is made with previous approaches, which have provided only statistically significant measures.

categories: adap-org chao-dyn nlin.AO nlin.CD physics.med-ph q-bio


title: Experiences with iterated traffic microsimulations in Dallas

abstract: This paper reports experiences with iterated traffic microsimulations in the context of a Dallas study. ``Iterated microsimulations'' here means that the information generated by a microsimulation is fed back into the route planner so that the simulated individuals can adjust their routes to circumvent congestion. This paper gives an overview over what has been done in the Dallas context to better understand the relaxation process, and how to judge the robustness of the results.


title: Early-time critical dynamics of lattices of coupled chaotic maps

abstract: The early-time critical dynamics of continuous, Ising-like phase transitions is studied numerically for two-dimensional lattices of coupled chaotic maps. Emphasis is laid on obtaining accurate estimates of the dynamic critical exponents \theta' and z. The critical points of five different models are investigated, varying the mode of update, the coupling, and the local map. Our results suggest that the nature of update is a relevant parameter for dynamic universality classes of extended dynamical systems, generalizing results obtained previously for the static properties. They also indicate that the universality observed for the static properties of Ising-like transitions of synchronously-updated systems does not hold for their dynamic critical properties.


title: Cellular automaton rules conserving the number of active sites

abstract: This paper shows how to determine all the unidimensional two-state cellular automaton rules of a given number of inputs which conserve the number of active sites. These rules have to satisfy a necessary and sufficient condition. If the active sites are viewed as cells occupied by identical particles, these cellular automaton rules represent evolution operators of systems of identical interacting particles whose total number is conserved. Some of these rules, which allow motion in both directions, mimic ensembles of one-dimensional pseudo-random walkers. Numerical evidence indicates that the corresponding stochastic processes might be non-Gaussian.


title: Sentient Networks

abstract: In this paper we consider the question whether a distributed network of sensors and data processors can form "perceptions" based on the sensory data. Because sensory data can have exponentially many explanations, the use of a central data processor to analyze the outputs from a large ensemble of sensors will in general introduce unacceptable latencies for responding to dangerous situations. A better idea is to use a distributed "Helmholtz machine" architecture in which the collective state of the network as a whole provides an explanation for the sensory data.


title: Effects of neutral selection on the evolution of molecular species

abstract: We introduce a new model of evolution on a fitness landscape possessing a tunable degree of neutrality. The model allows us to study the general properties of molecular species undergoing neutral evolution. We find that a number of phenomena seen in RNA sequence-structure maps are present also in our general model. Examples are the occurrence of "common" structures which occupy a fraction of the genotype space which tends to unity as the length of the genotype increases, and the formation of percolating neutral networks which cover the genotype space in such a way that a member of such a network can be found within a small radius of any point in the space. We also describe a number of new phenomena which appear to be general properties of neutrally evolving systems. In particular, we show that the maximum fitness attained during the adaptive walk of a population evolving on such a fitness landscape increases with increasing degree of neutrality, and is directly related to the fitness of the most fit percolating network.


title: Adaptive Competition, Market Efficiency, Phase Transitions and Spin-Glasses

abstract: We analyze a simple model of adaptive competition which captures essential features of a variety of adaptive competitive systems in the social and biological sciences. Each of N agents, at each time step of a game, joins one of two groups. The agents in the minority group are awarded a point, while the agents in the majority group get nothing. Each agent has a fixed set of strategies drawn at the beginning of the game from a common pool, and chooses his current best-performing strategy to determine which group to join. For a fixed N, the system exhibits a phase change as a function of the size of the common strategy pool from which the agents initially draw their strategies. For small pool sizes, the system is in an efficient market phase. All information that can be used by the agents' strategies is traded away, no agent can accumulate more points than would an agent making random guesses, and thus the commons suffer,since relatively few points are awarded to the agents in total. For large initial strategy pool sizes, the system is in an inefficient market phase, in which there is predictive information available to the agents' strategies, and some agents can do better than random at accumulating points. In this phase, the total number of points awarded to the agents is greater than in a game in which all agents guess randomly, and so the commons do relatively well. At a critical size of the strategy pool marking the cross-over from the efficient market to the inefficient market phases, the commons do best. This critical size of the pool grows monotonically with N. The behavior of this system has some features reminiscent of a spin-glass.


title: Geometric statistical inference

abstract: Finite sample size corrections to the reparametrization-invariant solution of the inverse problem of probability are computed, and shown to converge uniformly to the correct distribution.


title: Probabilistic Analysis of the Number Partitioning Problem

abstract: Given a sequence of $N$ positive real numbers $\{a_1,a_2,..., a_N \}$, the number partitioning problem consists of partitioning them into two sets such that the absolute value of the difference of the sums of $a_j$ over the two sets is minimized. In the case that the $a_j$'s are statistically independent random variables uniformly distributed in the unit interval, this NP-complete problem is equivalent to the problem of finding the ground state of an infinite-range, random anti-ferromagnetic Ising model. We employ the annealed approximation to derive analytical lower bounds to the average value of the difference for the best constrained and unconstrained partitions in the large $N$ limit. Furthermore, we calculate analytically the fraction of metastable states, i.e. states that are stable against all single spin flips, and found that it vanishes like $N^{-3/2}$.

categories: adap-org cond-mat.stat-mech math-ph math.MP nlin.AO


title: Modelling coevolution in multispecies communities

abstract: We introduce the Webworld model, which links together the ecological modelling of food web structure with the evolutionary modelling of speciation and extinction events. The model describes dynamics of ecological communities on an evolutionary timescale. Species are defined as sets of characteristic features, and these features are used to determine interaction scores between species. A simple rule is used to transfer resources from the external environment through the food web to each of the species, and to determine mean population sizes. A time step in the model represents a speciation event. A new species is added with features similar to those of one of the existing species and a new food web structure is then calculated. The new species may (i) add stably to the web, (ii) become extinct immediately because it is poorly adapted, or (iii) cause one or more other species to become extinct due to competition for resources. We measure various properties of the model webs and compare these with data on real food webs. These properties include the proportions of basal, intermediate and top species, the number of links per species and the number of trophic levels. We also study the evolutionary dynamics of the model ecosystem by following the fluctuations in the total number of species in the web. Extinction avalanches occur when novel organisms arise which are significantly better adapted than existing ones. We discuss these results in relation to the observed extinction events in the fossil record, and to the theory of self-organized criticality.

categories: adap-org cond-mat.stat-mech nlin.AO q-bio


title: Invariant closure for the Fokker-Planck equation

abstract: We develop the principle of dynamic invariance to obtain closed moment equations from the Fokker-Planck kinetic equation. The analysis is carried out to explicit formulae for computation of the lowest eigenvalue and of the corresponding eigenfunction for arbitrary potentials.


title: Conditional exponents, entropies and a measure of dynamical self-organization

abstract: In dynamical systems composed of interacting parts, conditional exponents, conditional exponent entropies and cylindrical entropies are shown to be well defined ergodic invariants which characterize the dynamical selforganization and statitical independence of the constituent parts. An example of interacting Bernoulli units is used to illustrate the nature of these invariants.


title: Emergence of Rules in Cell Society: Differentiation, Hierarchy, and Stability

abstract: A dynamic model for cell differentiation is studied, where cells with internal chemical reaction dynamics interact with each other and replicate. It leads to spontaneous differentiation of cells and determination, as is discussed in the isologous diversification. Following features of the differentiation are obtained: (1)Hierarchical differentiation from a ``stem'' cell to other cell types, with the emergence of the interaction-dependent rules for differentiation; (2)Global stability of an ensemble of cells consisting of several cell types, that is sustained by the emergent, autonomous control on the rate of differentiation; (3)Existence of several cell colonies with different cell-type distributions. The results provide a novel viewpoint on the origin of complex cell society, while relevance to some biological problems, especially to the hemopoietic system, is also discussed.


title: Diversity, Stability, Recursivity, and Rule Generation in Biological System: Intra-inter Dynamics Approach

abstract: Basic problems for the construction of a scenario for the Life are discussed. To study the problems in terms of dynamical systems theory, a scheme of intra-inter dynamics is presented. It consists of internal dynamics of a unit, interaction among the units, and the dynamics to change the dynamics itself, for example by replication (and death) of units according to their internal states. Applying the dynamics to cell differentiation, isologous diversification theory is proposed. According to it, orbital instability leads to diversified cell behaviors first. At the next stage, several cell types are formed, first triggered by clustering of oscillations, and then as attracting states of internal dynamics stabilized by the cell-to-cell interaction. At the third stage, the differentiation is determined as a recursive state by cell division. At the last stage, hierarchical differentiation proceeds, with the emergence of stochastic rule for the differentiation to sub-groups, where regulation of the probability for the differentiation provides the diversity and stability of cell society. Relevance of the theory to cell biology is discussed.


title: Large-scale evolution and extinction in a hierarchically structured environment

abstract: A class of models for large-scale evolution and mass extinctions is presented. These models incorporate environmental changes on all scales, from influences on a single species to global effects. This is a step towards a unified picture of mass extinctions, which enables one to study coevolutionary effects and external abiotic influences with the same means. The generic features of such models are studied in a simple version, in which all environmental changes are generated at random and without feedback from other parts of the system.


title: Generic Emergence of Power Law Distributions and L\'evy-Stable Intermittent Fluctuations in Discrete Logistic Systems

abstract: The dynamics of generic stochastic Lotka-Volterra (discrete logistic) systems of the form \cite{Solomon96a} $w_i (t+1) = \lambda(t) w_i (t) + a {\bar w (t)} - b w_i (t) {\bar w(t)}$ is studied by computer simulations. The variables $w_i$, $i=1,...N$, are the individual system components and ${\bar w (t)} = {1\over N} \sum_i w_i (t)$ is their average. The parameters $a$ and $b$ are constants, while $\lambda(t)$ is randomly chosen at each time step from a given distribution. Models of this type describe the temporal evolution of a large variety of systems such as stock markets and city populations. These systems are characterized by a large number of interacting objects and the dynamics is dominated by multiplicative processes. The instantaneous probability distribution $P(w,t)$ of the system components $w_i$, turns out to fulfill a (truncated) Pareto power-law $P(w,t) \sim w^{-1-\alpha}$. The time evolution of ${\bar w (t)} $ presents intermittent fluctuations parametrized by a truncated L\'evy distribution of index $\alpha$, showing a connection between the distribution of the $w_i$'s at a given time and the temporal fluctuations of their average.


title: Critical Exponent of Species-Size Distribution in Evolution

abstract: We analyze the geometry of the species- and genotype-size distribution in evolving and adapting populations of single-stranded self-replicating genomes: here programs in the Avida world. We find that a scale-free distribution (power law) emerges in complex landscapes that achieve a separation of two fundamental time scales: the relaxation time (time for population to return to equilibrium after a perturbation) and the time between mutations that produce fitter genotypes. The latter can be dialed by changing the mutation rate. In the scaling regime, we determine the critical exponent of the distribution of sizes and strengths of avalanches in a system without coevolution, described by first-order phase transitions in single finite niches.


title: Collective Behaviour and Diversity in Economic Communities: Some Insights from an Evolutionary Game

abstract: Many complex adaptive systems contain a large diversity of specialized components. The specialization at the level of the microscopic degrees of freedom, and diversity at the level of the system as a whole are phenomena that appear during the course of evolution of the system. We present a mathematical model to describe these evolutionary phenomena in economic communities. The model is a generalization of the replicator equation. The economic motivation for the model and its relationship with some other game theoretic models applied to ecology and sociobiology is discussed. Some results about the attractors of this dynamical system are described. We argue that while the microscopic variables -- the agents comprising the community -- act locally and independently, time evolution produces a collective behaviour in the system characterized by individual specialization of the agents as well as global diversity in the community. This occurs for generic values of the parameters and initial conditions provided the community is sufficiently large, and can be viewed as a kind of self-organization in the system. The context dependence of acceptable innovations in the community appears naturally in this framework.


title: Dynamics of Individual Specialization and Global Diversification in Communities

abstract: We discuss a model of an economic community consisting of $N$ interacting agents. The state of each agent at any time is characterized, in general, by a mixed strategy profile drawn from a space of $s$ pure strategies. The community evolves as agents update their strategy profiles in response to payoffs received from other agents. The evolution equation is a generalization of the replicator equation. We argue that when $N$ is sufficiently large and the payoff matrix elements satisfy suitable inequalities, the community evolves to retain the full diversity of available strategies even as individual agents specialize to pure strategies.


title: Statistics of extinction and survival in Lotka-Volterra systems

abstract: We analyze purely competitive many-species Lotka-Volterra systems with random interaction matrices, focusing the attention on statistical properties of their asymptotic states. Generic features of the evolution are outlined from a semiquantitative analysis of the phase-space structure, and extensive numerical simulations are performed to study the statistics of the extinctions. We find that the number of surviving species depends strongly on the statistical properties of the interaction matrix, and that the probability of survival is weakly correlated to specific initial conditions.

categories: adap-org cond-mat.soft nlin.AO physics.bio-ph q-bio


title: Extinction events and species lifetimes in a simple ecological model

abstract: A model for large-scale evolution recently introduced by Amaral and Meyer is studied analytically and numerically. Species are located at different trophic levels and become extinct if their prey becomes extinct. It is proved that this model is self-organized critical in the thermodynamic limit, with an exponent 2 characterizing the size distribution of extinction events. The lifetime distribution of species, cutoffs due to finite-size effects, and other quantities are evaluated. The relevance of this model to biological evolution is critically assessed.


title: Neural network design for J function approximation in dynamic programming

abstract: This paper shows that a new type of artificial neural network (ANN) -- the Simultaneous Recurrent Network (SRN) -- can, if properly trained, solve a difficult function approximation problem which conventional ANNs -- either feedforward or Hebbian -- cannot. This problem, the problem of generalized maze navigation, is typical of problems which arise in building true intelligent control systems using neural networks. (Such systems are discussed in the chapter by Werbos in K.Pribram, Brain and Values, Erlbaum 1998.) The paper provides a general review of other types of recurrent networks and alternative training techniques, including a flowchart of the Error Critic training design, arguable the only plausible approach to explain how the brain adapts time-lagged recurrent systems in real-time. The C code of the test is appended. As in the first tests of backprop, the training here was slow, but there are ways to do better after more experience using this type of network.


title: On the 1/f fluctuations in the nonlinear systems affected by noise

abstract: We investigate a problem of the necessary and sufficient conditions for appearance of the 1/f fluctuations in the simple systems affected by the external random perturbations, i.e. the power spectral density of the flux of particles moving in some contours and perturbed by the external forces. In some cases we observe the 1/f behavior but only in some range of frequencies and parameters of the systems.


title: How fast do structures emerge in hypercycle-systems?

abstract: A general framework for the simulation of reaction-diffusion systems with probabilistic cellular automata is presented. The basic reaction probabilities of the chemical model translate directly into the transition rules of the automaton, thus allowing a clear comparison between simulation results and analytic calculations. This framework is then applied to simulations of hypercycle-systems in up to three dimensions. Furthermore, a new measurement quantity is introduced and applied to the hypercycle-systems in two and three dimensions. It can be shown that this quantity can be interpreted as a measure for the macroscopic order of the hypercycle systems.


title: Simple model of 1/f noise

abstract: Simple analytically solvable model of 1/f noise is proposed. The model consists of one or few particles moving in the closed contour. The drift period of the particle round the contour fluctuates about some average value, e.g. due to the external random perturbations of the system's parameters. The model contains only one relaxation rate, however, the power spectral density of the current of particles reveals an exact 1/f spectrum in any desirable wide range of frequency and can be expressed by the Hooge formula. It is likely that the analysis and the generalizations of the model can strongly influence on the understanding of the origin of 1/f noise.


title: Nondecay probability of a metastable state: almost exact analytical description in wide range of noise intensity

abstract: This paper presents a complete description of noise-induced decay of a metastable state in a wide range of noise intensity. Recurrent formulas of exact moments of decay time valid for arbitrary noise intensity have been obtained. The nondecay probability of a metastable state was found to be really close to the exponent even for the case when the potential barrier height is comparable or smaller than the noise intensity.


title: Coupled Oscillators with Chemotaxis

abstract: A simple coupled oscillator system with chemotaxis is introduced to study morphogenesis of cellular slime molds. The model successfuly explains the migration of pseudoplasmodium which has been experimentally predicted to be lead by cells with higher intrinsic frequencies. Results obtained predict that its velocity attains its maximum value in the interface region between total locking and partial locking and also suggest possible roles played by partial synchrony during multicellular development.


title: Development and Evolution of Neural Networks in an Artificial Chemistry

abstract: We present a model of decentralized growth for Artificial Neural Networks (ANNs) inspired by the development and the physiology of real nervous systems. In this model, each individual artificial neuron is an autonomous unit whose behavior is determined only by the genetic information it harbors and local concentrations of substrates modeled by a simple artificial chemistry. Gene expression is manifested as axon and dendrite growth, cell division and differentiation, substrate production and cell stimulation. We demonstrate the model's power with a hand-written genome that leads to the growth of a simple network which performs classical conditioning. To evolve more complex structures, we implemented a platform-independent, asynchronous, distributed Genetic Algorithm (GA) that allows users to participate in evolutionary experiments via the World Wide Web.


title: Dynamics of Internal Models in Game Players

abstract: A new approach for the study of social games and communications is proposed. Games are simulated between cognitive players who build the opponent's internal model and decide their next strategy from predictions based on the model. In this paper, internal models are constructed by the recurrent neural network (RNN), and the iterated prisoner's dilemma game is performed. The RNN allows us to express the internal model in a geometrical shape. The complicated transients of actions are observed before the stable mutually defecting equilibrium is reached. During the transients, the model shape also becomes complicated and often experiences chaotic changes. These new chaotic dynamics of internal models reflect the dynamical and high-dimensional rugged landscape of the internal model space.


title: A dynamical theory of speciation on holey adaptive landscapes

abstract: The metaphor of holey adaptive landscapes provides a pictorial representation of the process of speciation as a consequence of genetic divergence. In this metaphor, biological populations diverge along connected clusters of well-fit genotypes in a multidimensional adaptive landscape and become reproductively isolated species when they come to be on opposite sides of a ``hole'' in the adaptive landscape. No crossing of any adaptive valleys is required. I formulate and study a series of simple models describing the dynamics of speciation on holey adaptive landscapes driven by mutation and random genetic drift. Unlike most previous models that concentrate only on some stages of speciation, the models studied here describe the complete process of speciation from initiation until completion. The evolutionary factors included are selection (reproductive isolation), random genetic drift, mutation, recombination, and migration. In these models, pre- and post-mating reproductive isolation is a consequence of cumulative genetic change. I study possibilities for speciation according to allopatric, parapatric, peripatric and vicariance scenarios. The analytic theory satisfactorily matches results of individual-based simulations reported by Gavrilets et al. (1998). It is demonstrated that rapid speciation including simultaneous emergence of several new species is a plausible outcome of the evolutionary dynamics of subdivided populations. I consider effects of population size, population subdivision, and local adaptation on the dynamics of speciation. I briefly discuss some implications of the dynamics on holey adaptive landscapes for molecular evolution.


title: Rapid parapatric speciation on holey adaptive landscapes

abstract: A classical view of speciation is that reproductive isolation arises as a by-product of genetic divergence. Here, individual-based simulations are used to evaluate whether the mechanisms implied by this view may result in rapid speciation if the only source of genetic divergence are mutation and random genetic drift. Distinctive features of the simulations are the consideration of the complete process of speciation (from initiation until completion), and of a large number of loci, which was only one order of magnitude smaller than that of bacteria. It is demonstrated that rapid speciation on the time scale of hundreds of generations is plausible without the need for extreme founder events, complete geographic isolation, the existence of distinct adaptive peaks or selection for local adaptation. The plausibility of speciation is enhanced by population subdivision. Simultaneous emergence of more than two new species from a subdivided population is highly probable. Numerical examples relevant to the theory of centrifugal speciation and to the conjectures about the fate of ``ring species'' and ``sexual continuums'' are presented.


title: Life as Complex Systems --- Viewpoint from Intra-Inter Dynamics

abstract: Basic problems in complex systems are surveyed in connection with Life. As a key issue for complex systems, complementarity between syntax/rule/parts and semantics/behavior/whole is stressed. To address the issue, a constructive approach for a biological system is proposed. As a construction in a computer, intra-inter dynamics is presented for cell biology, where the following five general features are drawn from our model experiments; intrinsic diversification, recursive type formation, rule generation, formation of internal representation, and macroscopic robustness. Significance of the constructed logic to the biology of existing organisms is also discussed.


title: Memory Effects and Macroscopic Manifestation of Randomness

abstract: It is shown that due to memory effects the complex behaviour of components in a stochastic system can be transmitted to macroscopic evolution of the system as a whole. Within the Markov approximation widely using in ordinary statistical mechanics, memory effects are neglected. As a result, a time-scale separation between the macroscopic and the microscopic level of description exists, the macroscopic differential picture is no a consequence of microscopic non-differentiable dynamics. On the other hand, the presence of complete memory in a system means that all its components have the same behaviour. If the memory function has no characteristic time scales, the correct description of the macroscopic evolution of such systems have to be in terms of the fractional calculus.


title: Cooperative mechanism of self-regulation in hierarchical living systems

abstract: We study the problem of how a ``living'' system complex in structure can respond perfectly to local changes in the environment. Such a system is assumed to consist of a distributed ``living'' medium and a hierarchical ``supplying'' network that provides this medium with ``nutritious'' products. Because of the hierarchical organization each element of the supplying network has to behave in a self-consistent way for the system can adapt to changes in the environment. We propose a cooperative mechanism of self-regulation by which the system as a whole can react perfectly. This mechanism is based on an individual response of each element to the corresponding small piece of the information on the state of the ``living'' medium. The conservation of flux through the supplying network gives rise to a certain processing of information and the self-consistent behavior of the elements, leading to the perfect self-regulation. The corresponding equations governing the ``living'' medium state are obtained.


title: Wavelet Based Fractal Analysis of Airborne Pollen

abstract: The most abundant biological particles in the atmosphere are pollen grains and spores. Self protection of pollen allergy is possible through the information of future pollen contents in the air. In spite of the importance of airborne pol len concentration forecasting, it has not been possible to predict the pollen concentrations with great accuracy, and about 25% of the daily pollen forecasts have resulted in failures. Previous analysis of the dynamic characteristics of atmospheric pollen time series indicate that the system can be described by a low dimensional chaotic map. We apply the wavelet transform to study the multifractal characteristics of an a irborne pollen time series. We find the persistence behaviour associated to low pollen concentration values and to the most rare events of highest pollen co ncentration values. The information and the correlation dimensions correspond to a chaotic system showing loss of information with time evolution.


title: The Evolutionary Design of Collective Computation in Cellular Automata

abstract: We investigate the ability of a genetic algorithm to design cellular automata that perform computations. The computational strategies of the resulting cellular automata can be understood using a framework in which ``particles'' embedded in space-time configurations carry information and interactions between particles effect information processing. This structural analysis can also be used to explain the evolutionary process by which the strategies were designed by the genetic algorithm. More generally, our goals are to understand how machine-learning processes can design complex decentralized systems with sophisticated collective computational abilities and to develop rigorous frameworks for understanding how the resulting dynamical systems perform computation.

categories: adap-org cond-mat.dis-nn math.DS nlin.AO nlin.PS patt-sol physics.bio-ph


title: Dynamics of clade diversification on the morphological hypercube

abstract: Understanding the relationship between taxonomic and morphological changes is important in identifying the reasons for accelerated morphological diversification early in the history of animal phyla. Here, a simple general model describing the joint dynamics of taxonomic diversity and morphological disparity is presented and applied to the data on the diversification of blastozoans. I show that the observed patterns of deceleration in clade diversification can be explicable in terms of the geometric structure of the morphospace and the effects of extinction and speciation on morphological disparity without invoking major declines in the size of morphological transitions or taxonomic turnover rates. The model allows testing of hypotheses about patterns of diversification and estimation of rates of morphological evolution. In the case of blastozoans, I find no evidence that major changes in evolutionary rates and mechanisms are responsible for the deceleration of morphological diversification seen during the period of this clade's expansion. At the same time, there is evidence for a moderate decline in overall rates of morphological diversification concordant with a major change (from positive to negative values) in the clade's growth rate.


title: Autocatalytic Sets and the Growth of Complexity in an Evolutionary Model

abstract: A model of $s$ interacting species is considered with two types of dynamical variables. The fast variables are the populations of the species and slow variables the links of a directed graph that defines the catalytic interactions among them. The graph evolves via mutations of the least fit species. Starting from a sparse random graph, we find that an autocatalytic set (ACS) inevitably appears and triggers a cascade of exponentially increasing connectivity until it spans the whole graph. The connectivity subsequently saturates in a statistical steady state. The time scales for the appearance of an ACS in the graph and its growth have a power law dependence on $s$ and the catalytic probability. At the end of the growth period the network is highly non-random, being localized on an exponentially small region of graph space for large $s$.


title: Decline in extinction rates and scale invariance in the fossil record

abstract: We show that the decline in the extinction rate during the Phanerozoic can be accurately parameterized by a logarithmic fit to the cumulative total extinction. This implies that extinction intensity is falling off approximately as the reciprocal of time. We demonstrate that this observation alone is sufficient to explain the existence of the proposed power-law forms in the distribution of the sizes of extinction events and in the power spectrum of Phanerozoic extinction, results which previously have been explained by appealing to self-organized critical theories of evolutionary dynamics.


title: Stable Adaptive Control Using New Critic Designs

abstract: Classical adaptive control proves total-system stability for control of linear plants, but only for plants meeting very restrictive assumptions. Approximate Dynamic Programming (ADP) has the potential, in principle, to ensure stability without such tight restrictions. It also offers nonlinear and neural extensions for optimal control, with empirically supported links to what is seen in the brain. However, the relevant ADP methods in use today -- TD, HDP, DHP, GDHP -- and the Galerkin-based versions of these all have serious limitations when used here as parallel distributed real-time learning systems; either they do not possess quadratic unconditional stability (to be defined) or they lead to incorrect results in the stochastic case. (ADAC or Q-learning designs do not help.) After explaining these conclusions, this paper describes new ADP designs which overcome these limitations. It also addresses the Generalized Moving Target problem, a common family of static optimization problems, and describes a way to stabilize large-scale economic equilibrium models, such as the old long-term energy model of DOE.


title: Nonlinear theory of autooscillations of quasiplanar interface during directional solidification

abstract: Within the framework of the frozen temperature approximation we develop a strongly-nonlinear theory of one-dimensional pattern formation during directional solidification of binary mixture under nonequilibrium segregation. In the case of small partition coefficient the full problem is reduced to the system of two ordinary differential equations describing the interface motion in terms of its velocity and position coordinate. The type of the oscillatory instability bifurcation is studied in detail in different limits. For the subcrytical bifurcaton relaxation interface oscillations are analyzed analytically and numerically. We show that these oscillation exibit a number of anomalous properies. In particular, such oscillations can be weakly- or strongly-dissipative depending on the physical parameters and the amplitude of the strongly-dissipative oscillations is determined not only by the form of the corresponding nullcline but also by the behavior of the system for small values of the interface velocity. Characteristic parameters of the superlattice occuring in the growing crystal are estimated.


title: Optimizing Epochal Evolutionary Search: Population-Size Independent Theory

abstract: Epochal dynamics, in which long periods of stasis in population fitness are punctuated by sudden innovations, is a common behavior in both natural and artificial evolutionary processes. We use a recent quantitative mathematical analysis of epochal evolution to estimate, as a function of population size and mutation rate, the average number of fitness function evaluations to reach the global optimum. This is then used to derive estimates of and bounds on evolutionary parameters that minimize search effort.


title: Optimizing Epochal Evolutionary Search: Population-Size Dependent Theory

abstract: Epochal dynamics, in which long periods of stasis in an evolving population are punctuated by a sudden burst of change, is a common behavior in both natural and artificial evolutionary processes. We analyze the population dynamics for a class of fitness functions that exhibit epochal behavior using a mathematical framework developed recently. In the latter the approximations employed led to a population-size independent theory that allowed us to determine optimal mutation rates. Here we extend this approach to include the destabilization of epochs due to finite-population fluctuations and show that this dynamical behavior often occurs around the optimal parameter settings for efficient search. The resulting, more accurate theory predicts the total number of fitness function evaluations to reach the global optimum as a function of mutation rate, population size, and the parameters specifying the fitness function. We further identify a generalized error threshold, smoothly bounding the two-dimensional regime of mutation rates and population sizes for which evolutionary search operates efficiently.


title: Emergence and Growth of Complex Networks in Adaptive Systems

abstract: We consider the population dynamics of a set of species whose network of catalytic interactions is described by a directed graph. The relationship between the attractors of this dynamics and the underlying graph theoretic structures like cycles and autocatalytic sets is discussed. It is shown that when the population dynamics is suitably coupled to a slow dynamics of the graph itself, the network evolves towards increasing complexity driven by autocatalytic sets. Some quantitative measures of network complexity are described.


title: One Dimensional $n$ary Density Classification Using Two Cellular Automaton Rules

abstract: Suppose each site on a one-dimensional chain with periodic boundary condition may take on any one of the states $0,1,..., n-1$, can you find out the most frequently occurring state using cellular automaton? Here, we prove that while the above density classification task cannot be resolved by a single cellular automaton, this task can be performed efficiently by applying two cellular automaton rules in succession.


title: Coherence and synchronization in diode-laser arrays with delayed global coupling

abstract: The dynamics of a semiconductor-laser array whose individual elements are coupled in a global way through an external mirror is numerically analysed. A coherent in-phase solution is seen to be preferred by the system at intermediate values of the feedback coupling strength. At low values of this parameter, a strong amplification of the spontaneous emission noise is observed. A tendency towards chaos synchronization is also observed at large values of the feedback strength.

categories: adap-org cond-mat nlin.AO physics.optics


title: Distributed Self-regulation Induced by Negative Feedbacks in Ecological and Economic Systems

abstract: We consider an ecological system governed by Lotka-Volterra dynamics and an example of an economic system as a mesomarket with perfect competition. We propose a mechanism for cooperative self-regulation that enables the system under consideration to respond properly to changes in the environment. This mechanism is based on (1) active individual behavior of the system elements at each hierarchical level and (2) self-processing of information caused by the hierarchical organization. It is shown how the proposed mechanism suppresses nonlocal interaction of elements belonging to a particular level as mediated by higher levels.


abstract: A simple model for the formation of a complex organism is introduced. Individuals can communicate and specialize, leading to an increase in productivity. If there are limits to the capacity of individuals to communicate with other individuals, the individuals form groups that interact with each other, leading to a complex organism that has interacting units on all scales.


title: Extinction, diversity and survivorship of taxa in the fossil record

abstract: Using data drawn from large-scale databases, a number of interesting trends in the fossil record have been observed in recent years. These include the average decline in extinction rates throughout the Phanerozoic, the average increase in standing diversity, correlations between rates of origination and extinction, and simple laws governing the form of survivorship curves and the distribution of the lifetimes of taxa. In this paper we derive mathematically a number of relations between these quantities and show how these different trends are inter-related. We also derive a variety of constraints on the possible forms of these trends, such as limits on the rate at which extinction may decline and limits on the allowed difference between extinction and origination rates at any given time.


title: Time evolution of averages in dynamical systems driven by noise

abstract: This paper presents description of time evolution of averages of Markov process in wide range of noise intensity. Exact expression of time scale of average evolution has been obtained. It has been demonstrated numerically that for purely noise-induced transitions (transitions over potential barriers) the time evolution of mean coordinate is a simple exponent with a good precision even for the case when the potential barrier height is comparable or smaller than the noise intensity. Also it has been demonstrated that nonlinear system may be "linearized" by a strong noise.


title: The Structure of Adaptive Competition in Minority Games

abstract: In this paper we present results and analyses of a class of games in which heterogeneous agents are rewarded for being in a minority group. Each agent possesses a number of fixed strategies each of which are predictors of the next minority group. The strategies use a set of aggregate, publicly available information (reflecting the agents' collective previous decisions) to make their predictions. An agent chooses which group to join at a given moment by using one of his strategies. These games are adaptive in that agents can choose, at different points of the game, to exercise different strategies in making their choice of which group to join. We find, rather generally, that such systems evidence a phase change from a maladaptive, informationally efficient phase in which the system performs poorly at generating resources, to an inefficient phase in which there is an emergent cooperation among the agents, and the system more effectively generates resources. The best emergent coordination is achieved in a transition region between these two phases. This transition occurs when the dimension of the strategy space is of the order of the number of agents playing the game. We present explanations for this general behavior, based in part on an information theoretic analysis of the system and its publicly available information. We also propose a mean-field like model of the game which is most accurate in the maladaptive, efficient phase. In addition, we show that the best individual agent performance in the two different phases is achieved by sets of strategies with markedly different characteristics. We discuss implications of our results for various aspects of the study of complex adaptive systems.


title: Power spectra of extinction in the fossil record

abstract: Recent Fourier analyses of fossil extinction data have indicated that the power spectrum of extinction during the Phanerozoic may take the form of 1/f noise, a result which, it has been suggested, could be indicative of the presence of "critical dynamics" in the processes giving rise to extinction. In this paper we examine extinction power spectra in some detail, using family-level data from a variety of different sources. We find that although the average form of the power spectrum roughly obeys the 1/f law, the spectrum can be represented more accurately by dividing it into two regimes: a low-frequency one which is well fit by an exponential, and a high-frequency one in which it follows a power law with a 1/f^2 form. We give explanations for the occurrence of each of these behaviours and for the position of the cross-over between them.


title: Reproductive Tradeoffs In Uncertain Environments: Explaining The Evolution Of Cultural Elaboration

abstract: Dunnell's (1989) explanation for cultural elaboration proposed that elaboration could be a consequence of selection within uncertain environments. He developed the theory to the extent that it performed well explaining the distribution of elaboration at regional scales within eastern North America. More detailed studies require more detailed development of the theory, so that additional hypotheses and implications can be deduced. We draw upon theories of selection in fluctuating environments and portions of life history theory to propose a formal model of selection for "waste" in uncertain environments. We use agent-based simulation to explore the sufficiency of the theory for explaining the maintenance of high levels of elaboration within populations, and deduce novel implications for archaeological evidence usable by others to test the utility of Dunnell's model in specific localities.


title: Modeling 1/f noise

abstract: The noise of signals or currents consisting from a sequence of pulses, elementary events or moving discrete objects (particles) is analyzed. A simple analytically solvable model is investigated in detail both analytically and numerically. It is shown that 1/f noise may result from the statistics of the pulses transit times with random increments of the time intervals between the pulses. The model also serves as a basis for revealing parameter dependences of 1/f noise and allows one to make some generalizations. As a result the intensity of 1/f noise is expressed through the distribution and characteristic functions of the time intervals between the subsequent transit times of the pulses. The conclusion that 1/f noise may result from the clustering of the signal pulses, elementary events or particles can be drawn from the analysis of the model systems.

categories: adap-org cond-mat.stat-mech cond-mat.str-el math.DS math.SP nlin.AO


title: Clustering and synchronization with positive Lyapunov exponents

abstract: Clustering and correlation effects are frequently observed in chaotic systems in situations where, because of the positivity of the Lyapunov exponents, no dimension reduction is to be expected. In this paper, using a globally coupled network of Bernoulli units, one finds a general mechanism by which strong correlations and slow structures are obtained at the synchronization edge. A structure index is defined, which diverges at the transition points. Some conclusions are drawn concerning the construction of an ergodic theory of self-organization.


title: Market force, ecology and evolution

abstract: Markets have internal dynamics leading to excess volatility and other phenomena that are difficult to explain using rational expectations models. This paper studies these using a nonequilibrium price formation rule, developed in the context of trading with market orders. Because this is so much simpler than a standard inter-temporal equilibrium model, it is possible to study multi-period markets analytically. There price dynamics have second order oscillatory terms. Value investing does not necessarily cause prices to track values. Trend following causes short term trends in prices, but also causes longer-term oscillations. When value investing and trend following are combined, even though there is little linear structure, there can be boom-bust cycles,excess and temporally correlated volatility, and fat tails in price fluctuations. The long term evolution of markets can be studied in terms of flows of money. Profits can be decomposed in terms of aggregate pairwise correlations. Under reinvestment of profits this leads to a capital allocation model that is equivalent to a standard model in population biology. An investigation of market efficiency shows that patterns created by trend followers are more resistant to efficiency than those created by value investors, and that profit maximizing behavior slows the progression to efficiency. Order of magnitude estimates suggest that the timescale for efficiency is years to decades.


title: The Evolutionary Biology of Ourselves: Unit Requirements and Organizational Change in United States History

abstract: Researchers have proposed that the distinction between so-called "simple" and "complex" societies can be expressed by an increase in the number of levels at which functional organization, interaction, and thus selection, operate. In spite of the obvious links between this suggestion and research into complex social organization amongst insects and other social animals, the levels of selection model has seen little use among anthropologists. We suggest that the primary reason for lack of research into the evolutionary causes of social complexity has been the lack of descriptive units with which we can examine phenotypic variation and heritability of social organization above the level of the organism. The goal of our paper, therefore, is to begin constructing descriptive units which map to meaningful models of multi-level selection. In order to demonstrate how these units are useful in a real dataset, we examine the functional changes involved in the United States economy over the last 100 years, a period of time characterized, we believe, by significant changes in the number and kinds of social aggregates functioning as "individuals" with respect to selection. Our preliminary analysis suggests that it is possible to measure changes in the scale at which functional integration occurs through published data, and that the multilevel selection model for complex society may possess considerable power for describing how selection of culturally transmitted variation occurs in complex societies.


title: Autocatalytic closure in a cognitive system: A tentative scenario for the origin of culture

abstract: This paper presents a speculative model of the cognitive mechanisms underlying the transition from episodic to mimetic (or memetic) culture with the arrival of Homo erectus, which Donald [1991] claims paved the way for the unique features of human culture. The model draws on Kauffman's [1993] theory of how an information-evolving system emerges through the formation of an autocatalytic network. Though originally formulated to explain the origin of life, this theory also provides a plausible account of how discrete episodic memories become woven into an internal model of the world, or worldview, that both structures, and is structured by, self-triggered streams of thought. Social interaction plays a role in (and may be critical to) this process. Implications for cognitive development are explored.


title: Towards Behaviorly Realistic Simulations of the Stock Market (Traders with a Soul)

abstract: The price fluctuations in the financial markets are the result of the individual operations by many individual investors. However for many decades the finacial theory did not use directly this "microscopic representation". The difficulties preventing it were multiple but the main two are being solved recently with the advent of modern computer technology: - massive detailed data on the individual market operations became available. - "microscopic simulations" of the stock markets in terms of their individual participating agents allow a very realistic treatment of the problem. Consequently, we are now able to confront real market data with the results of simulating "microscopic" realistic models which include any desired features in the investors behavior: departures from rationality, herding effects, heterogenous investor-specific trading strategies etc. In this way we propose to understand, explain and may be predict the macroscopic market behavior.


title: Stochastic group selection model for the evolution of altruism

abstract: We study numerically and analytically a stochastic group selection model in which a population of asexually reproducing individuals, each of which can be either altruist or non-altruist, is subdivided into $M$ reproductively isolated groups (demes) of size $N$. The cost associated with being altruistic is modelled by assigning the fitness $1- \tau$, with $\tau \in [0,1]$, to the altruists and the fitness 1 to the non-altruists. In the case that the altruistic disadvantage $\tau$ is not too large, we show that the finite $M$ fluctuations are small and practically do not alter the deterministic results obtained for $M \to \infty$. However, for large $\tau$ these fluctuations greatly increase the instability of the altruistic demes to mutations. These results may be relevant to the dynamics of parasite-host systems and, in particular, to explain the importance of mutation in the evolution of parasite virulence.


title: A Mathematical Model with Modified Logistic Approach for Singly-Peaked Population Processes

abstract: When a small number of individuals of organism of single species is confined in a closed space with limited amount of indispensable resources, their breading may start initially under suitable conditions, and after peaking, the population should go extinct as the resources are exhausted. Starting with the logistic equation and assuming that the carrying capacity of the environment is a function of the amount of resources, a mathematical model describing such pattern of population change is obtained. An application of this model to typical population records, that of deer herds by Scheffer (1951) and O'Roke and Hamerstrome (1948), yields estimations of the initial amount of indispensable food and its availability or nutritional efficiency which were previously unspecified.


title: The Hamming Distance in the Minority Game

abstract: We investigate different versions of the minority game, a toy model for agents buying and selling a commodity. The Hamming distance between the strategies used by agents to take decisions is introduced as an analytical tool to determine several properties of these models. The success rate of the agents in an adaptive version of the game is compared with the rate from a stochastic version. It is shown numerically and analytically that the adaptive process is inefficient, increasing the success rate of the unused strategies while decreasing the success rate of the strategies used by the agents. The agents do not do as well as if they were forced to use only one strategy permanently. A version of the game in which the agents strategies evolve is also analyzed using the notion of distance. The agents evolve into a state in which they are all using one strategy, which is again the state that yields the maximum success rate.


title: A General Approach to the Modelling of Trophic Chains

abstract: Based on the law of mass action (and its microscopic foundation) and mass conservation, we present here a method to derive consistent dynamic models for the time evolution of systems with an arbitrary number of species. Equations are derived through a mechanistic description, ensuring that all parameters have ecological meaning. After discussing the biological mechanisms associated to the logistic and Lotka-Volterra equations, we show how to derive general models for trophic chains, including the effects of internal states at fast time scales. We show that conformity with the mass action law leads to different functional forms for the Lotka-Volterra and trophic chain models. We use mass conservation to recover the concept of carrying capacity for an arbitrary food chain.

categories: adap-org chao-dyn cond-mat.stat-mech math.DS nlin.AO nlin.CD physics.bio-ph physics.chem-ph q-bio.PE


title: The Evolutionary Unfolding of Complexity

abstract: We analyze the population dynamics of a broad class of fitness functions that exhibit epochal evolution---a dynamical behavior, commonly observed in both natural and artificial evolutionary processes, in which long periods of stasis in an evolving population are punctuated by sudden bursts of change. Our approach---statistical dynamics---combines methods from both statistical mechanics and dynamical systems theory in a way that offers an alternative to current ``landscape'' models of evolutionary optimization. We describe the population dynamics on the macroscopic level of fitness classes or phenotype subbasins, while averaging out the genotypic variation that is consistent with a macroscopic state. Metastability in epochal evolution occurs solely at the macroscopic level of the fitness distribution. While a balance between selection and mutation maintains a quasistationary distribution of fitness, individuals diffuse randomly through selectively neutral subbasins in genotype space. Sudden innovations occur when, through this diffusion, a genotypic portal is discovered that connects to a new subbasin of higher fitness genotypes. In this way, we identify innovations with the unfolding and stabilization of a new dimension in the macroscopic state space. The architectural view of subbasins and portals in genotype space clarifies how frozen accidents and the resulting phenotypic constraints guide the evolution to higher complexity.


title: The Origin of the RNA World: a Kinetic Model

abstract: The aims of this paper are to propose, construct and analyse microscopic kinetic models for the emergence of long chains of RNA from monomeric beta-D-ribonucleotide precursors in prebiotic circumstances. Our theory starts out from similar but more general chemical assumptions to those of Eigen, namely that catalytic replication can lead to a large population of long chains. In particular, our models incorporate the possibility of (i) direct chain growth, (ii) template-assisted synthesis and (iii) catalysis by RNA replicase ribozymes, all with varying degrees of efficiency. However, in our models the reaction mechanisms are kept `open'; we do not assume the existence of closed hypercycles which sustain a population of long chains. Rather it is the feasibility of the initial emergence of a self-sustaining set of RNA chains from monomeric nucleotides which is our prime concern. We confront directly the central nonlinear features of the problem, which have often been overlooked in previous studies. Our detailed microscopic kinetic models lead to kinetic equations which are generalisations of the Becker-Doring system (BD) for the step-wise growth of clusters or polymer chains; they lie within a general theoretical framework which has recently been successfully applied to a wide range of complex chemical problems. In fact, the most accurate model we consider has BD aggregation terms, together with a general Smoluchowski fragmentation term to model the competing hydrolysis of RNA polymer chains. We conclude that, starting from reasonable initial conditions of monomeric nucleotide concentrations within a prebiotic soup and in an acceptable timescale, it is possible for a self-replicating subset of polyribonucleotide chains to be selected, while less efficient replicators become extinct.


title: Evolution of genetic organization in digital organisms

abstract: We examine the evolution of expression patterns and the organization of genetic information in populations of self-replicating digital organisms. Seeding the experiments with a linearly expressed ancestor, we witness the development of complex, parallel secondary expression patterns. Using principles from information theory, we demonstrate an evolutionary pressure towards overlapping expressions causing variation (and hence further evolution) to sharply drop. Finally, we compare the overlapping sections of dominant genomes to those portions which are singly expressed and observe a significant difference in the entropy of their encoding.


title: Mechanism of Self-regulation in a Simple Model of Hierarchically Organized Market

abstract: We propose a model for a market which structure is of the tree form. Each branch of the tree is composed by identical firms, its root (the branch of the first level) is formed by the firms producing raw material, and the branches of the last level are the retail outlets. The branching points (tree nodes) are micromarkets for firms forming branches connected with a given node. The prices and the production rate are controlled by the ballance in supply and demand, the competition is assumed to be perfect. We show that such a market functions perfectly: the prices are specified by the production expense only, whereas demand determines the production rate. We construct an efficiency functional which extremal gives the governing equations for the market. It turns out that this ideal market is degenerated with respect to its structure. It is shown, that such market functions ideally: the prices are determined by the costs on production of the goods, and the level of production of the goods of any kind defined only by demand for the goods of this sort.


title: Replication Error and Time Evolution of a Self-Replicating System

abstract: A self-replicating system where the elements belonging to a solution category can replicate themselves by copying their own informations, is considered. The information carried by each element is defined by an element of all the n multiple tensor product of a base space that consists of m different base elements. We assume that in the replication the processes of copying each base information are the same and independent from one another and that the copying error distribution in each process is characterized by a small variation with a quite small mean value. Concentrating on the number fluctuation of the informations in the copying process, we analyze the time evolution of the system. We illustrate the change of averaged number of informations carried by system objects and the variation of the number distribution as a function of time. Especially, it is shown that the averaged number of information grows in general after large number of generations.


title: Neutral Evolution of Mutational Robustness

abstract: We introduce and analyze a general model of a population evolving over a network of selectively neutral genotypes. We show that the population's limit distribution on the neutral network is solely determined by the network topology and given by the principal eigenvector of the network's adjacency matrix. Moreover, the average number of neutral mutant neighbors per individual is given by the matrix spectral radius. This quantifies the extent to which populations evolve mutational robustness: the insensitivity of the phenotype to mutations. Since the average neutrality is independent of evolutionary parameters---such as, mutation rate, population size, and selective advantage---one can infer global statistics of neutral network topology using simple population data available from {\it in vitro} or {\it in vivo} evolution. Populations evolving on neutral networks of RNA secondary structures show excellent agreement with our theoretical predictions.


title: Characterizing self-organization and coevolution by ergodic invariants

abstract: In addition to the emergent complexity of patterns that appears when many agents come in interaction, it is also useful to characterize the dynamical processes that lead to their self-organization. A set of ergodic invariants is identified for this purpose, which is computed in several examples, namely a Bernoulli network with either global or nearest-neighbor coupling, a generalized Bak-Sneppen model and a continuous minority model.


title: Evolution in Minority Games I. Games with a Fixed Strategy Space

abstract: In this paper we study the minority game in the presence of evolution. In particular, we examine the behavior in games in which the dimension of the strategy space, m, is the same for all agents and fixed for all time. We find that for all values of m, not too large, evolution results in a substantial improvement in overall system performance. We also show that after evolution, results obey a scaling relation among games played with different values of m and different numbers of agents, analogous to that found in the non-evolutionary, adaptive games. Best system performance still occurs, for a given number of agents, at m_c, the same value of the dimension of the strategy space as in the non-evolutionary case, but system performance is now nearly an order of magnitude better than the non- evolutionary result. For m<m_c, the system evolves to states in which average agent wealth is better than in the random choice game,despite (and in some sense because of) the persistence of maladaptive behavior by some agents. As m gets large, overall systems performance approaches that of the random choice game.


title: Correlated random walks with a finite memory range

abstract: We study a family of correlated one-dimensional random walks with a finite memory range M.These walks are extensions of the Taylor's walk as investigated by Goldstein, which has a memory range equal to one. At each step, with a probability p, the random walker moves either to the right or to the left with equal probabilities, or with a probability q=1-p performs a move, which is a stochastic Boolean function of the M previous steps. We first derive the most general form of this stochastic Boolean function, and study some typical cases which ensure that the average value <R_n> of the walker's location after n steps is zero for all values of n. In each case, using a matrix technique, we provide a general method for constructing the generating function of the probability distribution of R_n; we also establish directly an exact analytic expression for the step-step correlations and the variance <R_n^2> of the walk. From the expression of <R_n^2>, which is not straightforward to derive from the probability distribution, we show that, for n going to infinity, the variance of any of these walks behaves as n, provided p>0. Moreover, in many cases, for a very small fixed value of p, the variance exhibits a crossover phenomenon as $n$ increases from a not too large value. The crossover takes place for values of $n$ around 1/p. This feature may mimic the existence of a non-trivial Hurst exponent, and induce a misleading analysis of numerical data issued from mathematical or natural sciences experiments.


title: Totalistic two-dimensional cellular automata exhibiting global periodic behavior

abstract: We have determined families of two-dimensional deterministic totalistic cellular automaton rules whose stationary density of active sites exhibits a period two in time. Each family of deterministic rules is characterized by an ``average probabilistic totalistic rule'' exhibiting the same periodic behavior.


title: Three sided complex adaptative systems

abstract: We introduce two three sided adaptative systems as toy models to mimic the exchange of commodities between buyers and sellers. These models are simple extensions of the minority game, exhibiting similar behaviour as well as some new features. The main difference between our two models is that in the first the three sides are equivalent while in the second, one choice appears as a compromise between the two other sides. Both models are investigated numerically and compared with the original minority game.


title: Evolution dynamics in terraced NK landscapes

abstract: We study populations of agents evolving in fitness landscapes constructed according to the rules of a modified NK model with a tunable amount of neutral paths. In the `punctuated equilibrium' regime evolutionary events are identified as jumps in the mean population fitness, and the statistics of these jumps in an ensemble of independently evolving populations is analyzed. We show that, for a wide range of landscapes parameters, the number of events in time t is Poisson distributed, with the time parameter replaced by the logarithm of time. This simple log-Poisson statistics likewise describes the number n of records in any sequence of t independently generated random numbers. The implications of this behavior for evolution dynamics are discussed.


title: Lattice three-species models of the spatial spread of rabies among foxes

abstract: Lattice models describing the spatial spread of rabies among foxes are studied. In these models, the fox population is divided into three-species: susceptible, infected or incubating, and infectious or rabid. They are based on the fact that susceptible and incubating foxes are territorial while rabid foxes have lost their sense of direction and move erratically. Two different models are investigated: a one-dimensional coupled-map lattice model, and a two-dimensional automata network model. Both models take into account the short-range character of the infection process and the diffusive motion of rabid foxes. Numerical simulations show how the spatial distribution of rabies, and the speed of propagation of the epizootic front depend upon the carrying capacity of the environment and diffusion of rabid foxes out of their territory.


title: Extremal Coupled Map Lattices

abstract: We propose a model for co-evolving ecosystems that takes into account two levels of description of an organism, for instance genotype and phenotype. Performance at the macroscopic level forces mutations at the microscopic level. These, in turn, affect the dynamics of the macroscopic variables. In some regions of parameter space, the system self-organises into a state with localised activity and power law distributions.


title: Model of self-replicating cell capable of self-maintenance

abstract: We construct a simple model of a proto-cell that simulates a stochastic dynamics of abstract chemicals on a two-dimensional lattice. We assume that chemicals catalyze their reproduction through interaction with each other, and that between some chemicals repulsion occurs. We have shown that chemicals organize themselves into a cell-like structure that maintains its membranes dynamically. Further, we have obtained cells that can divide themselves automatically into daughter cells.


title: Noise-induced memory in extended excitable systems

abstract: We describe a form of memory exhibited by extended excitable systems driven by stochastic fluctuations. Under such conditions, the system self-organizes into a state characterized by power-law correlations thus retaining long-term memory of previous states. The exponents are robust and model-independent. We discuss novel implications of these results for the functioning of cortical neurons as well as for networks of neurons.


title: Number-conserving cellular automaton rules

abstract: A necessary and sufficient condition for a one-dimensional q-state n-input cellular automaton rule to be number-conserving is established. Two different forms of simpler and more visual representations of these rules are given, and their flow diagrams are determined. Various examples are presented and applications to car traffic are indicated. Two nontrivial three-state three-input self-conjugate rules have been found. They can be used to model the dynamics of random walkers.


title: A microsimulation of traders activity in the stock market: the role of heterogeneity, agents' interactions and trade frictions

abstract: We propose a model with heterogeneous interacting traders which can explain some of the stylized facts of stock market returns. In the model synchronization effects, which generate large fluctuations in returns, can arise either from an aggregate exogenous shock or, even in its absence, purely from communication and imitation among traders. A trade friction is introduced which, by responding to price movements, creates a feedback mechanism on future trading and generates volatility clustering.


title: Globally coupled bistable elements as a model of group decision making

abstract: A simple mathematical model is proposed to study the effect of the average trend of a population on the opinion of each individual, when a group decision has to be made by voting. It is shown that if such effect is strong enough a transition to coherent behavior occurs, in which the whole population converges to a single opinion. This transition has the character of a first-order critical phenomenon.


title: Evolution in Minority Games II. Games with Variable Strategy Spaces

abstract: We continue our study of evolution in minority games by examining games in which agents with poorly performing strategies can trade in their strategies for new ones from a different strategy space. In the context of the games discussed in this paper, this means allowing for strategies that use information from different numbers of time lags, m. We find, in all the games we study, that after evolution, wealth per agent is high for agents with strategies drawn from small strategy spaces (small m), and low for agents with strategies drawn from large strategy spaces (large m). In the game played with N agents, wealth per agent as a function of m is very nearly a step function. The transition is at m=mt, where mt~mc-1. Here mc is the critical value of m at which N agents playing the game with a fixed strategy space (fixed m) have the best emergent coordination and the best utilization of resources. We also find that overall system-wide utilization of resources is independent of N. Furthermore, although overall system-wide utilization of resources after evolution varies somewhat depending on some other aspects of the evolutionary dynamics, in the best cases, utilization of resources is on the order of the best results achieved in evolutionary games with fixed strategy spaces. Simple explanations are presented for some of our main results.


title: Minimum Energy Information Fusion in Sensor Networks

abstract: In this paper we consider how to organize the sharing of information in a distributed network of sensors and data processors so as to provide explanations for sensor readings with minimal expenditure of energy. We point out that the Minimum Description Length principle provides an approach to information fusion that is more naturally suited to energy minimization than traditional Bayesian approaches. In addition we show that for networks consisting of a large number of identical sensors Kohonen self-organization provides an exact solution to the problem of combining the sensor outputs into minimal description length explanations.


title: An Exactly Soluble Hierarchical Clustering Model: Inverse Cascades, Self-Similarity, and Scaling

abstract: We show how clustering as a general hierarchical dynamical process proceeds via a sequence of inverse cascades to produce self-similar scaling, as an intermediate asymptotic, which then truncates at the largest spatial scales. We show how this model can provide a general explanation for the behavior of several models that has been described as ``self-organized critical,'' including forest-fire, sandpile, and slider-block models.


title: Noise-induced breakdown of coherent collective motion in swarms

abstract: We consider swarms formed by populations of self-propelled particles with attractive long-range interactions. These swarms represent multistable dynamical systems and can be found either in coherent traveling states or in an incoherent oscillatory state where translational motion of the entire swarm is absent. Under increasing the noise intensity, the coherent traveling state of the swarms is destroyed and an abrupt transition to the oscillatory state takes place.


title: Lyapunov Exponents in Random Boolean Networks

abstract: A new order parameter approximation to Random Boolean Networks (RBN) is introduced, based on the concept of Boolean derivative. A statistical argument involving an annealed approximation is used, allowing to measure the order parameter in terms of the statistical properties of a random matrix. Using the same formalism, a Lyapunov exponent is calculated, allowing to provide the onset of damage spreading through the network and how sensitive it is to minimal perturbations. Finally, the Lyapunov exponents are obtained by means of different approximations: through distance method and a discrete variant of the Wolf's method for continuous systems.


title: Metastable Evolutionary Dynamics: Crossing Fitness Barriers or Escaping via Neutral Paths?

abstract: We analytically study the dynamics of evolving populations that exhibit metastability on the level of phenotype or fitness. In constant selective environments, such metastable behavior is caused by two qualitatively different mechanisms. One the one hand, populations may become pinned at a local fitness optimum, being separated from higher-fitness genotypes by a {\em fitness barrier} of low-fitness genotypes. On the other hand, the population may only be metastable on the level of phenotype or fitness while, at the same time, diffusing over {\em neutral networks} of selectively neutral genotypes. Metastability occurs in this case because the population is separated from higher-fitness genotypes by an {\em entropy barrier}: The population must explore large portions of these neutral networks before it discovers a rare connection to fitter phenotypes. We derive analytical expressions for the barrier crossing times in both the fitness barrier and entropy barrier regime. In contrast with ``landscape'' evolutionary models, we show that the waiting times to reach higher fitness depend strongly on the width of a fitness barrier and much less on its height. The analysis further shows that crossing entropy barriers is faster by orders of magnitude than fitness barrier crossing. Thus, when populations are trapped in a metastable phenotypic state, they are most likely to escape by crossing an entropy barrier, along a neutral path in genotype space. If no such escape route along a neutral path exists, a population is most likely to cross a fitness barrier where the barrier is {\em narrowest}, rather than where the barrier is shallowest.


title: Strategy Selection in the Minority Game

abstract: We investigate the dynamics of the choice of an active strategy in the minority game. A history distribution is introduced as an analytical tool to study the asymmetry between the two choices offered to the agents. Its properties are studied numerically. It allows us to show that the departure from uniformity in the initial attribution of strategies to the agents is important even in the efficient market. Also, an approximate expression for the variance of the number of agents at one side in the efficient phase is proposed. All the analytical propositions are supported by numerical simulations of the system.


title: A dynamical model of non regulated markets

abstract: The main focus of this work is to understand the dynamics of non regulated markets. The present model can describe the dynamics of any market where the pricing is based on supply and demand. It will be applied here, as an example, for the German stock market presented by the Deutscher Aktienindex (DAX), which is a measure for the market status. The duality of the present model consists of the superposition of the two components - the long and the short term behaviour of the market. The long term behaviour is characterised by a stable development which is following a trend for time periods of years or even decades. This long term growth (or decline) is based on the development of fundamental market figures. The short term behaviour is described as a dynamical evaluation (trading) of the market by the participants. The trading process is described as an exchange between supply and demand. In the framework of this model there the trading is modelled by a system of nonlinear differential equations. The model also allows to explain the chaotic behaviour of the market as well as periods of growth or crashes.


title: Functional Dynamics II : Syntactic Structure

abstract: Functional dynamics, introduced in a previous paper, is analyzed, focusing on the formation of a hierarchical rule to determine the dynamics of the functional value. To study the periodic (or non-fixed) solution, the functional dynamics is separated into fixed and non-fixed parts. It is shown that the fixed parts generate a 1-dimensional map by which the dynamics of the functional values of some other parts are determined. Piecewise-linear maps with multiple branches are generally created, while an arbitrary one-dimensional map can be embedded into this functional dynamics if the initial function coincides with the identity function over a finite interval. Next, the dynamics determined by the one-dimensional map can again generate a `meta-map', which determines the dynamics of the generated map. This hierarchy of meta-rules can continue recursively. It is also shown that the dynamics can produce `meta-chaos' with an orbital instability that is stronger than exponential. The relevance of the generated hierarchy to biological and language systems is discussed, in relation with the formation of syntax of a network.


title: Functional Dynamics I : Articulation Process

abstract: The articulation process of dynamical networks is studied with a functional map, a minimal model for the dynamic change of relationships through iteration. The model is a dynamical system of a function $f$, not of variables, having a self-reference term $f \circ f$, introduced by recalling that operation in a biological system is often applied to itself, as is typically seen in rules in the natural language or genes. Starting from an inarticulate network, two types of fixed points are formed as an invariant structure with iterations. The function is folded with time, until it has finite or infinite piecewise-flat segments of fixed points, regarded as articulation. For an initial logistic map, attracted functions are classified into step, folded step, fractal, and random phases, according to the degree of folding. Oscillatory dynamics are also found, where function values are mapped to several fixed points periodically. The significance of our results to prototype categorization in language is discussed.


title: Resource Sharing and Coevolution in Evolving Cellular Automata

abstract: Evolving one-dimensional cellular automata (CAs) with genetic algorithms has provided insight into how improved performance on a task requiring global coordination emerges when only local interactions are possible. Two approaches that can affect the search efficiency of the genetic algorithm are coevolution, in which a population of problems---in our case, initial configurations of the CA lattice---evolves along with the population of CAs; and resource sharing, in which a greater proportion of a limited fitness resource is assigned to those CAs which correctly solve problems that fewer other CAs in the population can solve. Here we present evidence that, in contrast to what has been suggested elsewhere, the improvements observed when both techniques are used together depend largely on resource sharing alone.


title: Autoregressive model of 1/f noise

abstract: An analytically solvable model is proposed exhibiting 1/f spectrum in any desirably wide range of frequency (but excluding the point f=0). The model consists of pulses whose recurrence times obey an autoregressive process with very small damping.


title: Cumulant Dynamics of a Population under Multiplicative Selection, Mutation and Drift

abstract: We revisit the classical population genetics model of a population evolving under multiplicative selection, mutation and drift. The number of beneficial alleles in a multi-locus system can be considered a trait under exponential selection. Equations of motion are derived for the cumulants of the trait distribution in the diffusion limit and under the assumption of linkage equilibrium. Because of the additive nature of cumulants, this reduces to the problem of determining equations of motion for the expected allele distribution cumulants at each locus. The cumulant equations form an infinite dimensional linear system and in an authored appendix Adam Prugel-Bennett provides a closed form expression for these equations. We derive approximate solutions which are shown to describe the dynamics well for a broad range of parameters. In particular, we introduce two approximate analytical solutions: (1) Perturbation theory is used to solve the dynamics for weak selection and arbitrary mutation rate. The resulting expansion for the system's eigenvalues reduces to the known diffusion theory results for the limiting cases with either mutation or selection absent. (2) For low mutation rates we observe a separation of time-scales between the slowest mode and the rest which allows us to develop an approximate analytical solution for the dominant slow mode. The solution is consistent with the perturbation theory result and provides a good approximation for much stronger selection intensities.


title: Scaling in a Multispecies Network Model Ecosystem

abstract: A new model ecosystem consisting of many interacting species is introduced. The species are connected through a random matrix with a given connectivity. It is shown that the system is organized close to a boundary of marginal stability in such a way that fluctuations follow power law distributions both in species abundance and their lifetimes for some slow-driving (immigration) regime. The connectivity and the number of species are linked through a scaling relation which is the one observed in real ecosystems. These results suggest that the basic macroscopic features of real, species-rich ecologies might be linked with a critical state. A natural link between lognormal and power law distributions of species abundances is suggested.


title: Phase Transition in Random Networks with Multiple States

abstract: The critical boundaries separating ordered from chaotic behavior in randomly wired S-state networks are calculated. These networks are a natural generalization of random Boolean nets and are proposed as on extended approach to genetic regulatory systems, sets of cells in different states or collectives of agents engaged into a set of S possible tasks. A order parameter for the transition is computed and analysed. The relevance of these networks to biology, their relationships with standard cellular automata and possible extensions are outlined.


title: A Complete Enumeration and Classification of Two-Locus Disease Models

abstract: There are 512 two-locus, two-allele, two-phenotype, fully-penetrant disease models. Using the permutation between two alleles, between two loci, and between being affected and unaffected, one model can be considered to be equivalent to another model under the corresponding permutation. These permutations greatly reduce the number of two-locus models in the analysis of complex diseases. This paper determines the number of non-redundant two-locus models (which can be 102, 100, 96, 51, 50, or 48, depending on which permutations are used, and depending on whether zero-locus and single-locus models are excluded). Whenever possible, these non-redundant two-locus models are classified by their property. Besides the familiar features of multiplicative models (logical AND), heterogeneity models (logical OR), and threshold models, new classifications are added or expanded: modifying-effect models, logical XOR models, interference and negative interference models (neither dominant nor recessive), conditionally dominant/recessive models, missing lethal genotype models, and highly symmetric models. The following aspects of two-locus models are studied: the marginal penetrance tables at both loci, the expected joint identity-by-descent probabilities, and the correlation between marginal identity-by-descent probabilities at the two loci. These studies are useful for linkage analyses using single-locus models while the underlying disease model is two-locus, and for correlation analyses using the linkage signals at different locations obtained by a single-locus model.


title: Models of Extinction: A Review

abstract: We review recent work aimed at modeling species extinction over geological time. We discuss a number of models which, rather than dealing with the direct causes of particular extinction events, attempt to predict overall statistical trends, such as the relative frequencies of large and small extinctions, or the distribution of the lifetimes of species, genera or higher taxa. We also describe the available fossil and other data, and compare the trends visible in these data with the predictions of the models.


title: Colective Effects from Induced Behaviour

abstract: We present a solvable model for describing quantitatively situations where the individual behaviour of agents in a group "percolates" to collective behaviour of the group as a whole as a result of mutual influence between the agents.


title: Social Percolation

abstract: We introduce the simplest model which relates the emergence of collective social/economic phenomena to the existence of a (possibly self-organized) percolation transition. We suggest a series of extensions to financial, economic, political systems.


title: Statistical measures of complexity for strongly interacting systems

abstract: In recent studies, new measures of complexity for nonlinear systems have been proposed based on probabilistic grounds, as the LMC measure (Phys. Lett. A {\bf 209} (1995) 321) or the SDL measure (Phys. Rev. E {\bf 59} (1999) 2). All these measures share an intuitive consideration: complexity seems to emerge in nature close to instability points, as for example the phase transition points characteristic of critical phenomena. Here we discuss these measures and their reliability for detecting complexity close to critical points in complex systems composed of many interacting units. Both a two-dimensional spatially extended problem (the 2D Ising model) and a $\infty$-dimensional (random graph) model (random Boolean networks) are analysed. It is shown that the LMC and the SDL measures can be easily generalized to extended systems but fails to detect real complexity.


title: Analysis of the optimality principles responsible for vascular network architectonics

abstract: The equivalence of two optimality principles leading to Murray's law has been discussed. The first approach is based on minimization of biological work needed for maintaining the blood flow through the vessels at required level. The second one is the principle of minimal drag and lumen volume. Characteristic features of these principles are considered. An alternative approach leading to Murray's law has been proposed. For that we model the microcirculatory bed in terms of delivering vascular network with symmetrical bifurcation nodes, embedded uniformly into the cellular tissue. It was shown that Murray's law can be regarded as a direct consequence of the organism capacity for controlling the blood flow redistribution over the microcirculatory beds.


title: Measuring Mutual Information in Random Boolean Networks

abstract: During the last few years an area of active research in the field of complex systems is that of their information storing and processing abilities. Common opinion has it that the most interesting beaviour of these systems is found ``at the edge of chaos'', which would seem to suggest that complex systems may have inherently non-trivial information proccesing abilities in the vicinity of sharp phase transitions. A comprenhensive, quantitative understanding of why this is the case is however still lacking. Indeed, even ``experimental'' (i.e., often numerical) evidence that this is so has been questioned for a number of systems. In this paper we will investigate, both numerically and analitically, the behavior of Random Boolean Networks (RBN's) as they undergo their order-disorder phase transition. We will use a simple mean field approximation to treat the problem, and without lack of generality we will concentrate on a particular value for the connectivity of the system. In spite of the simplicity of our arguments, we will be able to reproduce analitically the amount of mutual information contained in the system as measured from numerical simulations.


title: Beyond Hebb: Exclusive-OR and Biological Learning

abstract: A learning algorithm for multilayer neural networks based on biologically plausible mechanisms is studied. Motivated by findings in experimental neurobiology, we consider synaptic averaging in the induction of plasticity changes, which happen on a slower time scale than firing dynamics. This mechanism is shown to enable learning of the exclusive-OR (XOR) problem without the aid of error back-propagation, as well as to increase robustness of learning in the presence of noise.

categories: adap-org cond-mat.dis-nn cond-mat.stat-mech nlin.AO physics.bio-ph q-bio.NC


title: Performance of data networks with random links

abstract: We investigate simplified models of computer data networks and examine how the introduction of additional random links influences the performance of these net works. In general, the impact of additional random links on the performance of the network strongly depends on the routing algorithm used in the network. Significant performance gains can be achieved if the routing is based on "geometrical distance" or shortest path reduced table routing. With shortest path full table routing degradation of performance is observed.


title: Self-Organized Criticality: Self-Organized Complexity? The Disorder and ``Simple Complexity'' of Power Law Distributions

abstract: The disorder and a simple convex measure of complexity are studied for rank ordered power law distributions, indicative of criticality, in the case where the total number of ranks is large. It is found that a power law distribution may produce a high level of complexity only for a restricted range of system size (as measured by the total number of ranks), with the range depending on the exponent of the distribution. Similar results are found for disorder. Self-organized criticality thus does not guarantee a high level of complexity, and when complexity does arise, it is self-organized itself only if self-organized criticality is reached at an appropriate system size.


title: Fractal Analysis for Social Systems

abstract: This is a brief introduction to fractals, multifractals and wavelets in an accessible way, in order that the founding ideas of those strange and intriguing newcomers to science as fractals may be communicated to a wider public. Fractals are the geometry of the wildness of nature, where the euclidian geometry fails. The structures of nonlinear dynamics associated with chaos are fractal. Fractals may also be used as the geometry of social systems. Wavelets are introduced as a tool for fractal analysis. As an example of its application on a social system, we use wavelet fractal analysis to compare electrical power demand of two different places, a touristic city and a whole country.


title: A Simple Model of the Evolution of Simple Models of Evolution

abstract: In the spirit of the many recent simple models of evolution inspired by statistical physics, we put forward a simple model of the evolution of such models. Like its objects of study, it is (one supposes) in principle testable and capable of making predictions, and gives qualitative insights into a hitherto mysterious process.


title: Simple models of evolution and extinction

abstract: This article gives a brief introduction to the mathematical modeling of large-scale biological evolution and extinction. We give three examples of simple models in this field: the coevolutionary avalanche model of Bak and Sneppen, the environmental stress model of Newman, and the increasing fitness model of Sibani, Schmidt, and Alstrom. We describe the features of real evolution which these models are intended to explain and compare the results of simulations against data drawn from the fossil record.