Formal Definition of Extractors
When defining an extractor, we need a measurement of how well it extracts. In other words, we need to define the level of randomness it produces. A measure of the level of randomness of a distribution defined on is provided by the min-entropy (denoted by ), which measures the amount of randomness in the worst case. This is not to be confused with the average case randomness described by Shannon-entropy. The min-entropy is used to define an extractor as follows:
Definition (Extractor): A (k, ε)-extractor is a function
such that for every distribution on {0, 1}n with the distribution is ε-close (measured by statistical distance) to the uniform distribution on {0, 1}m (denoted by and similarly denotes the distribution of the random seed of dimension d).
Again, the length of the weakly random input must be longer than the length of the output. The aim is to have a short as possible seed (low d), and an output that is as long as possible (high m), while keeping the min-entropy over a certain limit. In short we will have: n > m and we aim for d<< m.
Read more about this topic: Randomness Extractor
Famous quotes containing the words formal and/or definition:
“That anger can be expressed through words and non-destructive activities; that promises are intended to be kept; that cleanliness and good eating habits are aspects of self-esteem; that compassion is an attribute to be prized—all these lessons are ones children can learn far more readily through the living example of their parents than they ever can through formal instruction.”
—Fred Rogers (20th century)
“Beauty, like all other qualities presented to human experience, is relative; and the definition of it becomes unmeaning and useless in proportion to its abstractness. To define beauty not in the most abstract, but in the most concrete terms possible, not to find a universal formula for it, but the formula which expresses most adequately this or that special manifestation of it, is the aim of the true student of aesthetics.”
—Walter Pater (1839–1894)