Online NMF - Mathematical Framework

Mathematical Framework

We begin with the initial factorization at timestamp t

V = W*H + E

For simplicity we claim V ~ W*H

We then add the additional data U to matrix V resulting in V'

V' = ( V ) over ( U )

V' = W'*H

V' = ( W1' )*H' over ( W2' )

Also, for previously processed data:

W' = ( W*Λ−1*W1' ) over ( W2' )

H' = W1'−1*Λ*H

Where Λ is a diagonal matrix were Λii equals weight factor hi

For unprocessed data we need to perform the optimization problem of minimizing J. We have:

J = 1/2 ||V - W*H|| + a*R*H*HT

Where a is a positive integer and R is a symmetry non-negative matrix. This can be done using the following iterative algorithm

wij <-- wij (V*HT)ij over (W*H*HT)ij

hij <-- hij (WT*V)ij over (WT*W*H + a*R*H)ij

Read more about this topic:  Online NMF

Famous quotes containing the words mathematical and/or framework:

    As we speak of poetical beauty, so ought we to speak of mathematical beauty and medical beauty. But we do not do so; and that reason is that we know well what is the object of mathematics, and that it consists in proofs, and what is the object of medicine, and that it consists in healing. But we do not know in what grace consists, which is the object of poetry.
    Blaise Pascal (1623–1662)

    The city is a fact in nature, like a cave, a run of mackerel or an ant-heap. But it is also a conscious work of art, and it holds within its communal framework many simpler and more personal forms of art. Mind takes form in the city; and in turn, urban forms condition mind.
    Lewis Mumford (1895–1990)