Igor Kotenkov(@stalkermustang):I appreciate all the people who bring research on Looped Transformer that I missed, but I doubt the open research is the same as OpenAI's research. Yesterday I was thinking that Looped at THIS scale (Astra is clearly supposed to be bigger than anything open-sourced, >3T total) means that OpenAI has run countless ablations and scaling studies and decided to go with it. They wouldn't have spent >$100M w/o doing that. It should've scaled well, maybe not loss-wise but on downstream (though I doubt, most likely on both).

2026.09.03 10:54

I appreciate all the people who bring research on Looped Transformer that I missed, but I doubt the open research is the same as OpenAI's research. Yesterday I was thinking that Looped at THIS scale (Astra is clearly supposed to be bigger than anything open-sourced, >3T total) means that OpenAI has run countless ablations and scaling studies and decided to go with it. They wouldn't have spent >$100M w/o doing that. It should've scaled well, maybe not loss-wise but on downstream (though I doubt, most likely on both).