Tom Mann
@TomasMann1878
Research agents @meta 🇬🇧
3x hack winner + Codex ambassador
2.1K Following 2.7K Followers
Wait till you see what we been up at @Meta :)
And that was @aiDotEngineer NY!
First time volunteering but I've found it's the best way to make friends and meet great people!
My main takeaway is that the industry is maturing. Engineers from @monzo to @AnthropicAI are opinionated about what works and have built systems which are no longer "experimental"
Agent factories are also a major topic and I feel like that with 5% adoption in technical circles is truly the most innovative topic of the conference
The most interesting talk was defienetely @evanjconrad's "How compute markers work" about the backlog of compute and how does financing of GPUs works
@SaineeshE @ryancarson @swyx @grmcameron @andrey_rybka @katrinasanzi @BHolmesDev @swyx and many others!
Show more
Day 71 of building in public!
I've been testing out EXL3 as per @0xSero's suggestion yesterday using
Quick RTX 3090 test: same Qwen2.5-1.5B checkpoint, BF16 vs EXL3.
BF16: 27 tok/s, 2,945 MiB
EXL3 4.0 BPW: 157 tok/s, 929 MiB
EXL3 3.0 BPW: 141 tok/s, 764 MiB
4.0 BPW decoded 5.8x faster.
Deep dive coming soon
Show more
