Zain
@zainhas
I build and teach AI • AI/ML @togethercompute • EngSci ℕΨ/PhD @UofT • Previously: vector DBs, data scientist, lecturer & health tech founder • 🇺🇸🇨🇦🇵🇰
Joined August 2012
2.1K Following 8.3K Followers
harness choice impacts the cost alot more than it does the quality
> Quality delta is about 3-4%
> Cost delta is 2-4x
True for swebench lite i wonder how this behaves for non hillclimbed domains outside code.
Show more
