Paolo Rosson(@redp314):can @typesafeai Jev count the r's in strawberry? no. 47% says 3, 47% says 2. a coin flip, same as every LLM. On 70% on 168 test words, it undercounts doubled letters like everyone then I gave it the letters instead of the word: ["s","t","r","a","w","b","e","r","r","y"] 168/168. same model, same question, 260ms @CompleteSkeptic is this expected?

Paolo Rosson

@redp314

Head of Applied AI at Dext. Building | Quantum physics PhD from Oxford | Former Italian blindfolded Rubik’s cube record holder

가입 May 2015

2.3K 팔로잉 중 1.7K 팬

Paolo Rosson@redp314

2026.09.21 07:24

can @typesafeai Jev count the r's in strawberry? no. 47% says 3, 47% says 2. a coin flip, same as every LLM. On 70% on 168 test words, it undercounts doubled letters like everyone then I gave it the letters instead of the word: ["s","t","r","a","w","b","e","r","r","y"] 168/168. same model, same question, 260ms @CompleteSkeptic is this expected?