Online NMF - Mathematical Framework

Mathematical Framework

We begin with the initial factorization at timestamp t

V = W*H + E

For simplicity we claim V ~ W*H

We then add the additional data U to matrix V resulting in V'

V' = ( V ) over ( U )

V' = W'*H

V' = ( W1' )*H' over ( W2' )

Also, for previously processed data:

W' = ( W*Λ−1*W1' ) over ( W2' )

H' = W1'−1*Λ*H

Where Λ is a diagonal matrix were Λii equals weight factor hi

For unprocessed data we need to perform the optimization problem of minimizing J. We have:

J = 1/2 ||V - W*H|| + a*R*H*HT

Where a is a positive integer and R is a symmetry non-negative matrix. This can be done using the following iterative algorithm

wij <-- wij (V*HT)ij over (W*H*HT)ij

hij <-- hij (WT*V)ij over (WT*W*H + a*R*H)ij

Read more about this topic:  Online NMF

Famous quotes containing the words mathematical and/or framework:

    All science requires mathematics. The knowledge of mathematical things is almost innate in us.... This is the easiest of sciences, a fact which is obvious in that no one’s brain rejects it; for laymen and people who are utterly illiterate know how to count and reckon.
    Roger Bacon (c. 1214–c. 1294)

    The city is a fact in nature, like a cave, a run of mackerel or an ant-heap. But it is also a conscious work of art, and it holds within its communal framework many simpler and more personal forms of art. Mind takes form in the city; and in turn, urban forms condition mind.
    Lewis Mumford (1895–1990)