Kraft's Inequality - Formal Statement

Formal Statement

Let each source symbol from the alphabet

be encoded into a uniquely decodable code over an alphabet of size with codeword lengths

Then

Conversely, for a given set of natural numbers satisfying the above inequality, there exists a uniquely decodable code over an alphabet of size with those codeword lengths.

A commonly occurring special case of a uniquely decodable code is a prefix code. Kraft's inequality therefore also holds for any prefix code.

Read more about this topic:  Kraft's Inequality

Famous quotes containing the words formal and/or statement:

    There must be a profound recognition that parents are the first teachers and that education begins before formal schooling and is deeply rooted in the values, traditions, and norms of family and culture.
    Sara Lawrence Lightfoot (20th century)

    Children should know there are limits to family finances or they will confuse “we can’t afford that” with “they don’t want me to have it.” The first statement is a realistic and objective assessment of a situation, while the other carries an emotional message.
    Jean Ross Peterson (20th century)