Action Selection - Characteristics of The Action Selection Problem

Characteristics of The Action Selection Problem

The main problem for action selection is complexity. Since all computation takes both time and space (in memory), agents cannot possibly consider every option available to them at every instant in time. Consequently, they must be biased, and constrain their search in some way. For AI, the question of action selection is what is the best way to constrain this search? For biology and ethology, the question is how do various types of animals constrain their search? Do all animals use the same approaches? Why do they use the ones they do?

One fundamental question about action selection is whether it is really a problem at all for an agent, or whether it is just a description of an emergent property of an intelligent agent's behaviour. However, if we consider how we are going to build an intelligent agent, then it becomes apparent there must be some mechanism for action selection. This mechanism may be highly distributed (as in the case of distributed organisms such as social insect colonies or slime mold) or it may be a special-purpose module.

The action selection mechanism (ASM) determines not only the agent’s actions in terms of impact on the world, but also directs its perceptual attention, and updates its memory. These egocentric sorts of actions may in turn result in modifying the agents basic behavioural capacities, particularly in that updating memory implies some form of learning is possible. Ideally, action selection itself should also be able to learn and adapt, but there are many problems of combinatorial complexity and computational tractability that may require restricting the search space for learning.

In AI, an ASM is also sometimes either referred to as an agent architecture or thought of as a substantial part of one.

Read more about this topic:  Action Selection

Famous quotes containing the words characteristics of the, characteristics of, action, selection and/or problem:

    One of the characteristics of the dream is that nothing surprises us in it. With no regret, we agree to live in it with strangers, completely cut off from our habits and friends.
    Jean Cocteau (1889–1963)

    “What are the characteristics of today’s world so that one may recognize it by them?” It pays pensions and borrows money: credit and monuments.
    Franz Grillparzer (1791–1872)

    Do you suppose that sacrifice is the hallmark of moral action?—Just stop to consider whether sacrifice is not involved in every action that is done with deliberation, the worst as well as the best.
    Friedrich Nietzsche (1844–1900)

    Judge Ginsburg’s selection should be a model—chosen on merit and not ideology, despite some naysaying, with little advance publicity. Her treatment could begin to overturn a terrible precedent: that is, that the most terrifying sentence among the accomplished in America has become, “Honey—the White House is on the phone.”
    Anna Quindlen (b. 1952)

    From cradle to grave this problem of running order through chaos, direction through space, discipline through freedom, unity through multiplicity, has always been, and must always be, the task of education, as it is the moral of religion, philosophy, science, art, politics and economy; but a boy’s will is his life, and he dies when it is broken, as the colt dies in harness, taking a new nature in becoming tame.
    Henry Brooks Adams (1838–1918)