登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

How To Prompt
@HowToPrompt__
Trustworthy AI education.
参加 January 2022
84 フォロー中    36.8K ファン
Apple argues that AI models cannot do math.. not even the grade school math. For years, labs like OpenAI and Google have bragged about near-perfect scores on benchmarks like GSM8K. They claimed AI had mastered logical problem-solving. Apple decided to test if that was true. They built a new benchmark called GSM-Symbolic. Instead of static questions, it uses templates to dynamically change names, numbers, and variables. The results exposed a devastating truth. When Apple changed the simple numbers inside a basic word problem, model accuracy plummeted. The AI wasn't solving the math. It was relying on pattern matching from its training data. It was guessing based on familiarity, not reasoning. Then they ran the test that exposed the illusion entirely. They added a single, irrelevant clause to a math problem. Just a sentence of background text that looked important, but had zero impact on the actual calculation. Every single frontier model, from ChaTGPT to Claude, suffered massive performance drops. Some crashed by up to 65%. Just by adding a piece of noise that a seven-year-old child could easily ignore. The conclusion is blunt. Current AI models do not possess genuine logical reasoning. They do not understand math. They are sophisticated mimicry engines replicating the shape of human logic without actually thinking. When the pattern is clean, they look like geniuses. The moment you introduce a minor twist, a variable change, or a distraction, the illusion shatters.
もっと見る