Asymptotic Equipartition Property - AEP For Certain Continuous-time Stationary Ergodic Sources

AEP For Certain Continuous-time Stationary Ergodic Sources

Discrete-time functions can be interpolated to continuous-time functions. If such interpolation is measurable, we may define the continuous-time stationary process accordingly as . If AEP holds for the discrete-time process, as in the i.i.d. or finite-valued stationary ergodic cases shown above, it automatically holds for the continuous-time stationary process derived from it by some measurable interpolation. i.e. 
-\frac{1}{n} \log p(\tilde{X}_0^\tau) \to H(X)
where corresponds to the degree of freedom in time . and are the entropy per unit time and per degree of freedom respectively, defined by Shannon.

An important class of such continuous-time stationary process is the bandlimited stationary ergodic process with the sample space being a subset of the continuous functions. AEP holds if the process is white, in which case the time samples are i.i.d., or there exists, where is the nominal bandwidth, such that the -spaced time samples take values in a finite set, in which case we have the discrete-time finite-valued stationary ergodic process.

Any time-invariant operations also preserves AEP, stationarity and ergodicity and we may easily turn a stationary process to non-stationary without losing AEP by nulling out a finite number of time samples in the process.

Read more about this topic:  Asymptotic Equipartition Property

Famous quotes containing the words stationary and/or sources:

    It is the dissenter, the theorist, the aspirant, who is quitting this ancient domain to embark on seas of adventure, who engages our interest. Omitting then for the present all notice of the stationary class, we shall find that the movement party divides itself into two classes, the actors, and the students.
    Ralph Waldo Emerson (1803–1882)

    The American grips himself, at the very sources of his consciousness, in a grip of care: and then, to so much of the rest of life, is indifferent. Whereas, the European hasn’t got so much care in him, so he cares much more for life and living.
    —D.H. (David Herbert)