the most excitement meta-question in ai as we scale swarms & ultra long horizon persistent agents
“will agents discover a fundamentally better approach to solving these (class of) problems than our human designed algorithms with decades to centuries of priors”
imo the most interesting bit of weight space programming was seeing if/how models can discover better ways to transfer information from data to weights edit than our human designed algorithms like gradient descent
swarms themselves are our current pass for a good “agent topology” that lets us scale compute to scale discovery
a good target for swarms is to discover what a swarm should actually look like
there’s tons of algorithms & methods in the shadows waiting for a compute allocator to see if they’re actually viable
and that’s awesome