I asked GPT-live what's the square root of 1,258,963,547 fully expecting it would use a calculator as (I assume) it is out of distribution.
No, it just gave me the answer: 35,481.8763.
I then asked the log of it. Again correct.
Transformers are built differently.