Register and share your invite link to earn from video plays and referrals.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
Joined May 2026
279 Following    408 Followers
LLMs now beat humans on math accuracy. But does that mean they're actually building understanding on top of the right foundations? Title: Do LLMs Exhibit Coherent Knowledge Structures in Mathematical Reasoning? A Perspective from Knowledge Space Theory URL: โ“ Do LLMs actually build on prerequisite knowledge to get answers right? ๐Ÿ’ก Accuracy favors LLMs (92.5% for the best model, Qwen3-80B, vs. 79.6% for humans), but "perfect prerequisite satisfaction" tells a different story: 72.7% for humans vs. only 48.16% for the best LLM. Lots of correct answers rest on shaky foundations. โ“ Does giving them prerequisite hints help? ๐Ÿ’ก Surprisingly, prerequisite-grounded context barely outperformed unrelated examples. That points to surface-level pattern matching rather than genuine structured reasoning over prerequisites. โ“ Do strong models at least share a consistent knowledge structure with each other? ๐Ÿ’ก Human learner groups overlap at 0.9+ in their knowledge structure, but LLM pairs only overlap 0.38-0.6 โ€” and stronger models diverge even further from humans. โ“ So what's the takeaway? ๐Ÿ’ก Accuracy alone hides how differently LLMs "understand" math. Knowledge Space Theory offers a lens that exposes the fragmented structure lurking behind impressive scores. #LLMEval# #MathReasoning#
Show more