Relation To Law of Diminishing Returns
Amdahl's law is often conflated with the law of diminishing returns, whereas only a special case of applying Amdahl's law demonstrates 'law of diminishing returns'. If one picks optimally (in terms of the achieved speed-up) what to improve, then one will see monotonically decreasing improvements as one improves. If, however, one picks non-optimally, after improving a sub-optimal component and moving on to improve a more optimal component, one can see an increase in return. Note that it is often rational to improve a system in an order that is "non-optimal" in this sense, given that some improvements are more difficult or consuming of development time than others.
Amdahl's law does represent the law of diminishing returns if you are considering what sort of return you get by adding more processors to a machine, if you are running a fixed-size computation that will use all available processors to their capacity. Each new processor you add to the system will add less usable power than the previous one. Each time you double the number of processors the speedup ratio will diminish, as the total throughput heads toward the limit of .
This analysis neglects other potential bottlenecks such as memory bandwidth and I/O bandwidth, if they do not scale with the number of processors; however, taking into account such bottlenecks would tend to further demonstrate the diminishing returns of only adding processors.
Read more about this topic: Amdahl's Law
Famous quotes containing the words diminishing returns, relation to, relation, law, diminishing and/or returns:
“If the Russians have gone too far in subjecting the child and his peer group to conformity to a single set of values imposed by the adult society, perhaps we have reached the point of diminishing returns in allowing excessive autonomy and in failing to utilize the constructive potential of the peer group in developing social responsibility and consideration for others.”
—Urie Bronfenbrenner (b. 1917)
“The psychoanalysis of individual human beings, however, teaches us with quite special insistence that the god of each of them is formed in the likeness of his father, that his personal relation to God depends on his relation to his father in the flesh and oscillates and changes along with that relation, and that at bottom God is nothing other than an exalted father.”
—Sigmund Freud (1856–1939)
“When needs and means become abstract in quality, abstraction is also a character of the reciprocal relation of individuals to one another. This abstract character, universality, is the character of being recognized and is the moment which makes concrete, i.e. social, the isolated and abstract needs and their ways and means of satisfaction.”
—Georg Wilhelm Friedrich Hegel (1770–1831)
“The only law was that enforced by the Creek Lighthorsemen and the U.S. deputy marshals who paid rare and brief visits; or the “two volumes of common law” that every man carried strapped to his thighs.”
—State of Oklahoma, U.S. relief program (1935-1943)
“An amoeba is a formless thing which takes many shapes. It moves by thrusting out an arm, and flowing into the arm. It multiplies by pulling itself in two, without permanently diminishing the original. So with words. A meaning may develop on the periphery of the body of meanings associated with a word, and shortly this tentacle-meaning has grown to such proportions that it dwarfs all other meanings.”
—Charlton Laird (b. 1901)
“A man’s labour is not only his capital but his life. When it passes it returns never more. To utilise it, to prevent its wasteful squandering, to enable the poor man to bank it up for use hereafter, this surely is one of the most urgent tasks before civilisation.”
—William Booth (1829–1912)