Structural Information Theory - SIT Versus Connectionism and Dynamic Systems Theory

SIT Versus Connectionism and Dynamic Systems Theory

On the one hand, a representational theory like SIT seems opposite to dynamic systems theory (DST). On the other hand, connectionism can be seen as something in between, that is, it flirts with DST when it comes to the usage of differential equations and it flirts with theories like SIT when it comes to the representation of information. In fact, the analyses provided by SIT, connectionism, and DST, correspond to what Marr called the computational, the algorithmic, and the implementational levels of description, respectively. According to Marr, such analyses are complementary rather than opposite.

What SIT, connectionism, and DST have in common is that they describe nonlinear system behavior, that is, a minor change in the input may yield a major change in the output. Their complementarity expresses itself in that they focus on different aspects:

  • First, DST focuses primarily on how the state of a physical system as a whole (in this case, the brain) develops over time, whereas both SIT and connectionism focus primarily on what a system does in terms of information processing (which, in this case, can be said to constitute cognition).
  • Second, according to both SIT and connectionism, this information processing relies on interactions between pieces of information in distributed representations, that is, in networks of connected pieces of information. In this respect, however, connectionism focuses on concrete interaction mechanisms (i.c., activation spreading) in a prefixed network that is assumed to be suited for any input, whereas SIT focuses on the nature of the outcome of the interactions which are assumed to take place in transient, input-dependent, networks.

Read more about this topic:  Structural Information Theory

Famous quotes containing the words sit, dynamic, systems and/or theory:

    Busy people begrudge the days being short.
    I can no longer sit back and allow Communist infiltration, Communist indoctrination, Communist subversion, and the international Communist conspiracy to sap and impurify all of our precious bodily fluids.
    Stanley Kubrick (b. 1928)

    Imagination is always the fabric of social life and the dynamic of history. The influence of real needs and compulsions, of real interests and materials, is indirect because the crowd is never conscious of it.
    Simone Weil (1909–1943)

    We have done scant justice to the reasonableness of cannibalism. There are in fact so many and such excellent motives possible to it that mankind has never been able to fit all of them into one universal scheme, and has accordingly contrived various diverse and contradictory systems the better to display its virtues.
    Ruth Benedict (1887–1948)

    If my theory of relativity is proven correct, Germany will claim me as a German and France will declare that I am a citizen of the world. Should my theory prove untrue, France will say that I am a German and Germany will declare that I am a Jew.
    Albert Einstein (1879–1955)