Claude can't see Reddit, b/c Reddit blocks all LLMs except Gemini, b/c they have a Google contract. I ask Gemini for posts matching criteria, but Google blocks direct quotes. So I ask Claude to use a headless browser, which it refuses for 'safety'. Fuck everything about this.
Astra just found a bug in Anthropic's formal verification example, their "specification" doesn't actually check output bytes match input bytes. The irony is thick.
So many confused and incorrect answers to this. There is absolutely no reason you can't have a deterministic LLM. Also many people are confused by what "determinism" means in this context. Let's go over everything people are confused about 🧵