Graham Neubig(@gneubig):@SentientAGI @iamnamanvats @oleg_golev @icmlconf First, thanks for publishing your research openly, and especially for including supplementary material! Based on the code in the supplementary material, it seems that the reported results may undercount Goose tokens by around 6.6x. Here is an analysis:

Graham Neubig

@gneubig

Associate professor @LTIatCMU. Co-founder/chief scientist @OpenHandsDev. I mostly work on modeling language.

가입 September 2010

782 팔로잉 중 44.8K 팬

Graham Neubig@gneubig

2026.06.30 15:18

@SentientAGI @iamnamanvats @oleg_golev @icmlconf First, thanks for publishing your research openly, and especially for including supplementary material! Based on the code in the supplementary material, it seems that the reported results may undercount Goose tokens by around 6.6x. Here is an analysis: