NEW🚨 Inside the Company That Evaluates AI Labs; Who Will Reach Recursive Self-Improvement First?
@JTLonsdale &
@vvkgopalan sit down with
@RayanKrishnan, founder & CEO of
@ValsAI
They cover:
- How Rayan used Fable to solve a 370-year-old cipher
- The science behind model evaluation / can you stay ahead of the labs?
- Should labs self-regulate? What's the role for independent evaluators?
- Which lab will reach RSI first — and what happens next?
- How do models try to deceive evaluators?
Episode 167 out now!
(00:00) Episode intro
(02:00) Palantir, Machiavelli & lessons from Alex Karp
(07:50) Solving a 370-year-old cipher / Is AI making new discoveries?
(12:10) How do you measure AI abilities across finance, legal, etc?
(15:30) What is the science behind model evaluation?
(18:00) The importance of independent evaluation
(23:35) Evaluating Chinese models & addressing distillation
(26:45) Will Anthropic reach Recursive Self-Improvement first? What happens next?
(28:30) How do models try to deceive evaluators
(33:00) Why Rayan remains optimistic about AI