Let us now assume that is fixed and optimise and . Assuming that everything else is fixed, the cost function can be written as a functional of , up to an additive constant

where .

As before, the optimal is of the form . The update rule for the parameters of is thus

Similar reasoning for gives the update rule

Antti Honkela 2001-05-30