Comparison To Prior Parallel Paradigms
Basic computers started from a sequential execution paradigm. Traditional CPUs are SISD based, which means they conceptually perform only one operation at a time. As the computing needs of the world evolved, the amount of data to be managed increased very quickly. It was obvious that the sequential programming model could not cope with the increased need for processing power. Various efforts have been spent on finding alternative ways to perform massive amounts of computations but the only solution was to exploit some level of parallel execution. The result of those efforts was SIMD, a programming paradigm which allowed applying one instruction to multiple instances of (different) data. Most of the time, SIMD was being used in a SWAR environment. By using more complicated structures, one could also have MIMD parallelism.
Although those two paradigms were efficient, real-world implementations were plagued with limitations from memory alignment problems to synchronization issues and limited parallelism. Only few SIMD processors survived as stand-alone components; most were embedded in standard CPUs.
Consider a simple program adding up two arrays containing 100 4-component vectors (i.e. 400 numbers in total).
Read more about this topic: Stream Processing
Famous quotes containing the words comparison to, comparison, prior, parallel and/or paradigms:
“It is very important not to become hard. The artist must always have one skin too few in comparison to other people, so you feel the slightest wind.”
—Shusha Guppy (b. 1938)
“When we reflect on our past sentiments and affections, our thought is a faithful mirror, and copies its objects truly; but the colours which it employs are faint and dull, in comparison of those in which our original perceptions were clothed.”
—David Hume (1711–1776)
“Less smooth than her Skin and less white than her breast
Was this pollisht stone beneath which she lyes prest
Stop, Reader, and Sigh while thou thinkst on the rest
With a just trim of Virtue her Soul was endu’d
Not affectedly Pious nor secretly lewd,
She cut even between the Cocquet and the Prude.”
—Matthew Prior (1664–1721)
“There isn’t a Parallel of Latitude but thinks it would have been the Equator if it had had its rights.”
—Mark Twain [Samuel Langhorne Clemens] (1835–1910)
“All poetry, as discriminated from the various paradigms of prosody, is prayer.”
—Samuel Beckett (1906–1989)