Martian
@withmartian
Understanding Intelligence.
Measurement. Explanation. Application. That's how we're tackling AI interpretability: the greatest scientific problem of our age.
14 Following 3.8K Followers
We got 46% fewer errors than the single best LLM across the 16 most used benchmarks (TerminalBench, LiveCodeBench, etc).
Here's how that's possible and what each model can achieve when used optimally (every benchmarks misses the majority of model capabilities) 👇
Interactive Site:
Academic Paper:
Show more
Announcing Ship: an endpoint with the highest intelligence per dollar of any frontier model.
Today, Ship makes using Opus and GPT 5.6 Sol 50% cheaper guaranteed by a quality SLA.
Show more
