SwiLA's choices:
① Function class: a mixture of J linear regressions; each value coordinate picks one, with a learned prior.
② Optimizer: online SGD on the likelihood-based loss; each regressor takes a delta-rule step weighted by its responsibility.
J = 1 recovers DeltaNet.
もっと見る
