SIT Versus Connectionism and Dynamic Systems Theory
On the one hand, a representational theory like SIT seems opposite to dynamic systems theory (DST). On the other hand, connectionism can be seen as something in between, that is, it flirts with DST when it comes to the usage of differential equations and it flirts with theories like SIT when it comes to the representation of information. In fact, the analyses provided by SIT, connectionism, and DST, correspond to what Marr called the computational, the algorithmic, and the implementational levels of description, respectively. According to Marr, such analyses are complementary rather than opposite.
What SIT, connectionism, and DST have in common is that they describe nonlinear system behavior, that is, a minor change in the input may yield a major change in the output. Their complementarity expresses itself in that they focus on different aspects:
- First, DST focuses primarily on how the state of a physical system as a whole (in this case, the brain) develops over time, whereas both SIT and connectionism focus primarily on what a system does in terms of information processing (which, in this case, can be said to constitute cognition).
- Second, according to both SIT and connectionism, this information processing relies on interactions between pieces of information in distributed representations, that is, in networks of connected pieces of information. In this respect, however, connectionism focuses on concrete interaction mechanisms (i.c., activation spreading) in a prefixed network that is assumed to be suited for any input, whereas SIT focuses on the nature of the outcome of the interactions which are assumed to take place in transient, input-dependent, networks.
Read more about this topic: Structural Information Theory
Famous quotes containing the words sit, dynamic, systems and/or theory:
“I want to celebrate these elms which have been spared by the plague, these survivors of a once flourishing tribe commemorated by all the Elm Streets in America. But to celebrate them is to be silent about the people who sit and sleep underneath them, the homeless poor who are hauled away by the city like trash, except it has no place to dump them. To speak of one thing is to suppress another.”
—Lisel Mueller (b. 1924)
“Knowledge about life is one thing; effective occupation of a place in life, with its dynamic currents passing through your being, is another.”
—William James (1842–1910)
“People stress the violence. That’s the smallest part of it. Football is brutal only from a distance. In the middle of it there’s a calm, a tranquility. The players accept pain. There’s a sense of order even at the end of a running play with bodies stewn everywhere. When the systems interlock, there’s a satisfaction to the game that can’t be duplicated. There’s a harmony.”
—Don Delillo (b. 1926)
“The struggle for existence holds as much in the intellectual as in the physical world. A theory is a species of thinking, and its right to exist is coextensive with its power of resisting extinction by its rivals.”
—Thomas Henry Huxley (1825–95)