Paolo Rosson
@redp314
Head of Applied AI at Dext. Building | Quantum physics PhD from Oxford | Former Italian blindfolded Rubik’s cube record holder
2.3K Following 1.7K Followers
can @typesafeai Jev count the r's in strawberry?
no.
47% says 3, 47% says 2. a coin flip, same as every LLM.
On 70% on 168 test words, it undercounts doubled letters like everyone
then I gave it the letters instead of the word: ["s","t","r","a","w","b","e","r","r","y"]
168/168. same model, same question, 260ms
@CompleteSkeptic is this expected?
Show more
Got native direction-of-arrival running on the @EvenRealities glasses: I can now identify where sound is coming from, turning as I turn my head. No phone involved, straight through my MacBook!
Testing while watching a @digitalix video on the @NVIDIAAI DGX Spark!
Show more
Dentist did a 3D X-ray of my jaw before a root canal and said I wouldn't be able to open the raw data, it needs specialized software. It's 800 DICOM files. Asked Claude Code to make me a viewer. Two prompts later... this is nicer than what he showed me on his screen.
Show more
Got Meta's new Muse Glimmer 30B running on my MacBook (M3 Max, 96GG) and tested the serving options available so far.
Fastest right now: Ollama's MLX engine (DFlash included) at ~29 tok/s.
Tuned llama.cpp: ~21. Raw mlx-vlm: ~10, not optimized yet.
Numbers below if you're setting it up 👇
Show more
Got full-screen images painting fast on the @EvenRealities glasses: a whole frame, over Bluetooth, in under half a second!
Before: 9.4 seconds per full screen. After: 449 ms. Same glasses, same Bluetooth, same firmware!
Show more
