Relation To Law of Diminishing Returns
Amdahl's law is often conflated with the law of diminishing returns, whereas only a special case of applying Amdahl's law demonstrates 'law of diminishing returns'. If one picks optimally (in terms of the achieved speed-up) what to improve, then one will see monotonically decreasing improvements as one improves. If, however, one picks non-optimally, after improving a sub-optimal component and moving on to improve a more optimal component, one can see an increase in return. Note that it is often rational to improve a system in an order that is "non-optimal" in this sense, given that some improvements are more difficult or consuming of development time than others.
Amdahl's law does represent the law of diminishing returns if you are considering what sort of return you get by adding more processors to a machine, if you are running a fixed-size computation that will use all available processors to their capacity. Each new processor you add to the system will add less usable power than the previous one. Each time you double the number of processors the speedup ratio will diminish, as the total throughput heads toward the limit of .
This analysis neglects other potential bottlenecks such as memory bandwidth and I/O bandwidth, if they do not scale with the number of processors; however, taking into account such bottlenecks would tend to further demonstrate the diminishing returns of only adding processors.
Read more about this topic: Amdahl's Law
Famous quotes containing the words diminishing returns, relation to, relation, law, diminishing and/or returns:
“If the Russians have gone too far in subjecting the child and his peer group to conformity to a single set of values imposed by the adult society, perhaps we have reached the point of diminishing returns in allowing excessive autonomy and in failing to utilize the constructive potential of the peer group in developing social responsibility and consideration for others.”
—Urie Bronfenbrenner (b. 1917)
“Much poetry seems to be aware of its situation in time and of its relation to the metronome, the clock, and the calendar. ... The season or month is there to be felt; the day is there to be seized. Poems beginning “When” are much more numerous than those beginning “Where” of “If.” As the meter is running, the recurrent message tapped out by the passing of measured time is mortality.”
—William Harmon (b. 1938)
“The adolescent does not develop her identity and individuality by moving outside her family. She is not triggered by some magic unconscious dynamic whereby she rejects her family in favour of her peers or of a larger society.... She continues to develop in relation to her parents. Her mother continues to have more influence over her than either her father or her friends.”
—Terri Apter (20th century)
“From the war of nature, from famine and death, the most exalted object which we are capable of conceiving, namely, the production of the higher animals, directly follows. There is grandeur in this view of life, with its several powers, having been breathed into a few forms or into one; and that, whilst this planet has gone cycling on according to the fixed law of gravity, from so simple a beginning endless forms most beautiful and most wonderful have been, and are being, evolved.”
—Charles Darwin (1809–1882)
“Back from that great-grandfather I have come
to puzzle a bending gravestone for his sake,
to question this diminishing and feed a minimum
of children their careful slice of suburban cake.”
—Anne Sexton (1928–1974)
“The insolence of base minds in success is boundless; and would scarce admit of a comparison, did not they themselves furnish us with one in the degrees of their abjection when evil returns upon them.”
—Laurence Sterne (1713–1768)