General Partner at Andreessen Horowitz Anish Acharya (@illscience) says using AI to edit the weights of other models is a bigger deal than people realise and could unlock continuous learning: "There's actually two huge breakthroughs that have happened in the last few months that I think are under discussed... [One is] the paper that was released on Monday about having models edit the weights of other models, which gives you the sort of continuous learning opportunity." "It was released and there was enthusiasm and then it was criticised, but I think it's a bigger deal than people appreciate." "The smartest people I've been talking to have been able to not just replicate, but extend it." "Now look, there may be some constraints, like there may be opposing ideas and models can't hold both of them in their head. You can't be highly conscientious and highly open, right? Because that sort of implies that the same weights are pointed in different directions." "But you may be able to do things like get models that are able to have high entropy in non-verifiable domains, like beautiful art and prose, but then high precision in verifiable domains where they can also write great code and be mathematical." "And we've never been able to reconcile those trade-offs before."