Mandelbrot Set

(Jonathan Coulton)

Pathological monsters! cried the terrified mathematician
Every one of them is a splinter in my eye
I hate the Peano Space and the Koch Curve
I fear the Cantor Ternary Set And the Sierpinski Gasket makes me want to cry
And a million miles away a butterfly flapped its wings
On a cold November day a man named Benoit Mandelbrot was born

His disdain for pure mathematics and his unique geometrical insights
Left him well equipped to face those demons down
He saw that infinite complexity could be described by simple rules
He used his giant brain to turn the game around
And he looked below the storm and saw a vision in his head
A bulbous pointy form
He picked his pencil up and he wrote his secret down

Take a point called Z in the complex plane
Let Z1 be Z squared plus C
And Z2 is Z1 squared plus C
And Z3 is Z2 squared plus C and so on
If the series of Z’s should always stay
Close to Z and never trend away
That point is in the Mandelbrot Set

Mandelbrot Set you’re a Rorschach Test on fire
You’re a day-glo pterodactyl
You’re a heart-shaped box of springs and wire
You’re one badass fucking fractal
And you’re just in time to save the day
Sweeping all our fears away
You can change the world in a tiny way

Mandelbrot’s in heaven, at least he will be when he’s dead
Right now he’s still alive and teaching math at Yale
He gave us order out of chaos, he gave us hope where there was none
And his geometry succeeds where others fail
If you ever lose your way, a butterfly will flap its wings
From a million miles away, a little miracle will come to take you home

Just take a point called Z in the complex plane
Let Z1 be Z squared plus C
And Z2 is Z1 squared plus C
And Z3 is Z2 squared plus C and so on
If the series of Z’s should always stay
Close to Z and never trend away
That point is in the Mandelbrot Set
Mandelbrot Set you’re a Rorschach Test on fire
You’re a day-glo pterodactyl
You’re a heart-shaped box of springs and wire
You’re one badass fucking fractal
And you’re just in time to save the day
Sweeping all our fears away
You can change the world in a tiny way
And you’re just in time to save the day
Sweeping all our fears away
You can change the world in a tiny way
Go on change the world in a tiny way
Come on change the world in a tiny way

“Pop” explanations of emerging behavior (or emergence) usually begin with stories of insect colonies, flights of birds, hurricanes, stock exchanges and ecology.

All is meant to illustrate the fact that systems sometimes show properties that cannot be justified on the grounds of the properties of their components.

This fact is, in pop complexity literature and in the Wikipedias of sort, attributed to mysterious and capricious nature deviations. Exotic concepts such as “dissipative structures” are soon brought up, and the reader, often as long with her author, is lost.

What pop literature systematically fails to tell you is that properties that cannot be explained on the grounds of the laws that govern the components emerge from nonlinear interactions between the components themselves [1].

How it happens

The properties of a linear system are additive: the effect of a collection of elements is the sum of the effects when considered separately, and overall there appear no new properties that are not already present in the individual elements.

But if there are elements/parts that are combined, depending on one another’s, then the complex is different (not necessarily larger, as you will often read in pop literature) from the sum of the parts and new effects start to appear[2].

Although emerging behavior is easier to encounter in systems made of living organisms or in economic and social systems, it is important to realize that emergence appears in far more elementary contexts as well, such as particle or atomic physics, as Nobel laureate Philip Warren Anderson started to show in the late ’60’s[3].

This very fact attests the importance of emergence at the epistemological level: on its grounds, a radical critique of reductionism can be developed, showing that the laws of particle physics are insufficient to explain the behavior of aggregates of electrons (like in superconductivity) or atoms, and that at each geometrical level (quark, neutron, nucleus, atom, molecule, virus, cell, etc.) new sets of laws may appear that, while compatible with the lower-level ones, introduce new knowledge.

The observation and study of emerging phenomena can get extraordinarily complex, especially when living organisms and populations are involved, and fascinating.

Clearly, mastery of the elementary foundations of emergence are needed if one is to analyze such phenomena of daunting complexity.

Ordinary examples

  • The particles that make up atoms do not have a colour. Protons or electrons aren’t green or yellow or red, because they do not absorb or emit visible light. Groups of atoms though, i.e. aggregates of those particles, do have colours
  • Many properties of condensed matter (ordinary matter), such as viscosity, friction or elasticity, are extraneous to the composing atoms and molecules. They emerge as properties of large aggregates of molecules
  • Real Madrid, Inter or Manchester United are ranked with fantastic players, but not always do they win. A powerful, worldwide acclaimed soccer team can sometime lose to a minor provincial one. This happens because the behavior of the team as a system is not the mere sum of the potential of its parts, nor their isolated behaviors. Teamwork, strategy, tactics, group psychology (and luck) are all factors in winning a game. The problem is complex

[1] P.W.Anderson, “More Is Different”, Science, New Series, Vol. 177, No. 4047, August 4, 1972

[2] P.Bridgman, The Logic of Modern Physics, The MacMillan Company, New York 1927, pag. 42

[3] P.W.Anderson, ibid

One recurring myth in “pop” complexity is the notion of circular causality.

This is a dramatically poor expression: because it overlaps with the term feedback; because of the (implied) wrong meaning assigned to the term linear; because of the confusion it creates around the word causality; and because of the unprecise use of the adjective circular, since what is actually meant here is recursion/iteration and not circularity.

Unfortunately, the expression was used in the title of one the Macy’s Conferences that contributed to launch the cybernetics (a.k.a. systems science) approach. Heinz von Foerster, who was learning English, was nominated secretary of the eighth conference and assigned as curator of the minutes, which were eventually published as Cybernetics: Circular Causal and Feedback Mechanisms in Biological and Social Systems: Transactions of the Eighth Conference. Edited by Heinz von Foerster.  New York: Josiah Macy, Jr. Foundation, 1952.

The “circular causality” contained in this unfortunate title hasn’t had much success in the scientific field: to date, it only sticks in a few minor and rather naive psychology and neurology publications. But it has enjoyed a great fortune in “pop” complexity literature, where it is employed as a synonym of feedback, with an added cheap “philosophical” spin.

Feedback

Feedback is what occurs when the temperature in the room falls below a certain value and a thermostat orders your air conditioner to stop cooling:  information concerning the output of the system or its environment (room temperature) is fed back to the the system itself (the conditioner) in order to modify its behavior.

In other occasions, it is not just information being fed back, but a piece of the output signal itself: in electronics, for example, a portion of the output signal is extracted and then subtracted from the input signal before it reaches the system/processor. This is done for output stabilization purposes.

From Encyclopedia Britannica, [feedback]:

In biology, a response within a system (molecule, cell, organism, or population) that influences the continued activity or productivity of that system. In essence, it is the control of a biological reaction by the end products of that reaction. Similar usage prevails in mathematics, particularly in several areas of communications theory. In every instance, part of the output is fed back as new input to modify and improve the subsequent output of a system. See also cybernetics.”

Feedback was studied systematically for the first time in the 1920’s, in both living organisms and electric circuits. In the latter field, the pioneers were physicist Harry Nyquist and electronic engineer Harold Black, of Bell Labs. In biology, pyschology, neurophysiology and economics feedback was addressed, among others, by A. Bogdanov, P.Anokhin, S. Odobleja, I.P.Pavlov and A.R.Wagner.

In 1943 A.Rosenblueth and N.Wiener argued that feedback in technological systems was analogous to that in living systems: in both cases feedback is a strategy employed for stabilization, self-regulation and ultimately survival. Cybernetics, the science they were founding, was to study feedback processes in nature in order to abstract ideas and strategies to be employed in artificial systems as well.

Feedback brings recursion and self-regulation in the affected processes. Think of the air conditioning case: the system interacts with its enviroment and adjusts to it, because information about the environment is fed as input into the system which is meant to regulate the environment itself. In the electronic amplifier case, the input signal to be processed depends somehow on the output signal (the result of the processing) as well, since a portion of the output is fed in as input.

This recursion, known as feedback loop in engineering circles, is what gets the minds of cheap philosophers excited, and makes them talk about circular causality.
 
Linear and circular
 
People who use the expression circular casuality to refer to the feedback loop are misusing the “linear” and “circular” adjectives and are confused about system evolution over time.
 
As explained elsewhere, the term linear in [systems] science has little to do with the colloquial meaning, as it stands for processes/systems that obey the principle of superposition: a system is linear if it responds with direct proportionality to inputs.
 
Colloquially, instead, people say linear to imply a rectilinear, straight line between two points. Therefore, by saying circular casuality, what the naive writer is trying to imply is that between event A and event B there isn’t a simple, straight cause-effect relationship, but rather a more convoluted one, of the kind: A affects B but is also affected by it.
 
This situation is more appropriately labeled by terms such as recursion or iteration, to preserve the progressive aspects of the process.  If the process were “circular”, it would endlessly loop with no further progress, as it is implied by the notion of a closed line, the circle.
 
As an example, the curve produced by an ideal pendulum in phase space is indeed a circumference. But a system that changes dramatically over time, as opposed to just bounce back and forth between the same states over and over like an idealized pendulum, produces open curves in phase space: the real pendulum, whose energy is declining due to attrition, produces a spiral in phase space, not a circle.
 
In general, a [non trivial] process with feedback proceeds from a state to a different one and, as the accurate Britannica definition clarifies, feedback occurs after feedforward: [...] part of the output is fed back as new input to modify and improve the subsequent output of a system. (The boldface is mine). Graphically, this situation is more accurately described by a cycloid, which is a loop with progress.
 
Crippled feedback and causality
 
In psychoneurology, a variant of the circular causality expression has made its way in minor portions of the literature, in more or less the following form:
 
Feedback is one form of nonlinear causation. A second form, termed circular causality [...], describes bidirectional causation between different levels of a system. A coherent, higher-order form or function causes a particular pattern of coupling among lower-order elements, while this pattern simultaneously causes the higher-order form. The top-down flow of causation may be considered an emergent constraint (by the system as a whole) on the actions of the parts.”
 
This definition, taking us in the realm of feedback between a whole system and some of its parts, is severely flawed and expresses great confusion around the notion of system, the term causality and the term linear. I will not waste my precious time :-)  in a confutation; just see for example Bakker.
 
Also notice that this definition preserves the logical confusion I was referring to in the preceeding section: a confusion between system states at different times. It is true that output may affect input (or that whole may affect components, if you so wish), but it does that in a subsequent iteration of the process. I.e., state A affects state B and may be affected by it, but the latter happens at a subsequent iteration. B–>A means that state A(t+1) is influenced by state B(t).
 
(NB: In particle physics, situations have been observed where causality seems violated in the sense that effect E happens in time before its cause B, and information is transmitted at a speed greater than light’s. However, this is not the kind of situation to which “pop” complexity authors are referring to when they speak of circular causality.)
 
Circularity and Francisco Varela
 
Perhaps it is not surprising that the only scientific fields where the expression “circular causality” is still used (although not much) be areas of life sciences, such as psychology and neurophysiology.
 
These are fields where “hard” scientific methods and terminology have started to penetrate only in the past decades (thanks to cybernetics, by the way) and where their application is tougher, given the complexity of the subject matter.
 
It is therefore simply natural that, in these fields, some mathematical terminology may be imperfect or that systems science concepts may be slightly abused.
 
varela_photoOne notable exponent of the use of “circularity” in human sciences was Francisco Varela (F.Varela, “The Creative Circle: Sketches on the Natural History of Circularity”, in The Invented Reality, edited by P. Watzlavick, Norton Publishing, New York 1984), the creator of autopoiesis, of which I will write in a separate piece.
 
Varela was a great man and a valued thinker, although with a pronounced tendency to fall in the traps of his own beautiful and elegant metaphors. Witness his application of the liar paradox to the dynamical context of molecular biology. The circle vs. the cycloid…

Complexity (or complexity theory) is a rich and consequently ambiguous term.

It emerged in the past decades mainly as a reference to the increasing propension, in science and technology, to relax the linearity assumptions in dynamical systems in order to get a deeper understanding of their behavior. This propension was cultivated by early scholars such as Henri Poincaré (1854-1912) or Aleksandr Lyapunov (1857-1918), but made practical by the use of computers starting in the 1960’s.

The use of the term complexity today most often refers to domains such as chaos theory, the “emerging behavior” of a system, the behavior of systems when they are far from thermodynamic equilibrium or to the self-organization features that sometimes emerge from these conditions, since all these phenomena ultimately are manifestations of non-linearity.

Other science and technology meanings of complexity that are somehow connected to the above are computational complexity and complex networks. (In science, the word complexity is used in many other contexts that are unrelated to non-linearity; one notable example: complex numbers).

Developments in all those fields are rich and fast and are producing effects at the technological, philosophical (Edgar Morin has been the main developer of an epistemology of complexity) and even popular-culture levels.

pop techIn this latter field, the use of the term complexity often escapes its original scientific core and tends to assume the colloquial meaning; in other instances it is used as a synonym to systems theory or cybernetics or interdisciplinarity.

In general, the non-academic (or “pop“) literature about complexity is unreliable when it comes to the scientific foundations of the concept, which most authors fail to grasp.

The academic literature, on the other hand, tends by its nature to be narrow and specialistic, and even its more remarkable works leave out (most often deliberately) many aspects of complexity. This is bad, as complexity is essentially an interdisciplinary concept.

This blog (comments included!) is meant to help the curious reader navigate the maze of the complexity literature, whether pop or scientific.

To achieve the goal, when posting we’ll use a maieutic approach: starting from the most common myths that are to be found in pop culture, by debunking them we will point to the most promising paths.