Relation To Law of Diminishing Returns
Amdahl's law is often conflated with the law of diminishing returns, whereas only a special case of applying Amdahl's law demonstrates 'law of diminishing returns'. If one picks optimally (in terms of the achieved speed-up) what to improve, then one will see monotonically decreasing improvements as one improves. If, however, one picks non-optimally, after improving a sub-optimal component and moving on to improve a more optimal component, one can see an increase in return. Note that it is often rational to improve a system in an order that is "non-optimal" in this sense, given that some improvements are more difficult or consuming of development time than others.
Amdahl's law does represent the law of diminishing returns if you are considering what sort of return you get by adding more processors to a machine, if you are running a fixed-size computation that will use all available processors to their capacity. Each new processor you add to the system will add less usable power than the previous one. Each time you double the number of processors the speedup ratio will diminish, as the total throughput heads toward the limit of .
This analysis neglects other potential bottlenecks such as memory bandwidth and I/O bandwidth, if they do not scale with the number of processors; however, taking into account such bottlenecks would tend to further demonstrate the diminishing returns of only adding processors.
Read more about this topic: Amdahl's Law
Famous quotes containing the words diminishing returns, relation to, relation, law, diminishing and/or returns:
“If the Russians have gone too far in subjecting the child and his peer group to conformity to a single set of values imposed by the adult society, perhaps we have reached the point of diminishing returns in allowing excessive autonomy and in failing to utilize the constructive potential of the peer group in developing social responsibility and consideration for others.”
—Urie Bronfenbrenner (b. 1917)
“Among the most valuable but least appreciated experiences parenthood can provide are the opportunities it offers for exploring, reliving, and resolving one’s own childhood problems in the context of one’s relation to one’s child.”
—Bruno Bettelheim (20th century)
“[Man’s] life consists in a relation with all things: stone, earth, trees, flowers, water, insects, fishes, birds, creatures, sun, rainbow, children, women, other men. But his greatest and final relation is with the sun.”
—D.H. (David Herbert)
“Who does not know history’s first law to be that an author must not dare to tell anything but the truth? And its second that he must make bold to tell the whole truth? That there must be no suggestion of partiality anywhere in his writings? Nor of malice?”
—Marcus Tullius Cicero (106–43 B.C.)
“Our domestic problems are for the most part economic. We have our enormous debt to pay, and we are paying it. We have the high cost of government to diminish, and we are diminishing it. We have a heavy burden of taxation to reduce, and we are reducing it. But while remarkable progress has been made in these directions, the work is yet far from accomplished.”
—Calvin Coolidge (1872–1933)
“Under the spell of moonlight, music, flowers or the cut and smell of good tweeds, I sometimes feel the divine urge for an hour, a day or maybe a week. Then it is gone an my interest returns to corn pone and mustard greens, or rubbing a paragraph with a soft cloth.”
—Zora Neale Hurston (1891–1960)