Josh Tobin (@josh_tobin_)

2026.10.28 03:48

thanks for trying Flint! it was cool to see it trending #2# on @huggingface. glad also to hear so many people enjoying it. we're working on improving tool calling, broadening harnesses / inference support, and reducing thinking. anything else you'd like to see?

Forward to community

Josh Tobin@josh_tobin_

2026.08.27 22:46

A fun small win for automated research: We found and helped fix some edge cases that could affect inference performance in vLLM and SGLang. In our last blog post, we described a reward hacking judge we developed for performance optimization tasks. While applying the judge to some new autoresearch work, it discovered that some FlashInfer (a library underpinning vLLM and SGLang) kernels used a hard coded value of -50,000 as a masked-attention sentinel -- even though valid QK values can be smaller. Corner cases like this that are numerically wrong but silent can cause a huge amount of headache to find and fix, e.g., the historical debate around flash attention ( Great use case for AI.