@emilymbender imagine being trained on the near totality of humanity's knowledge, and struggling to perform grade school mathematics.
We build accidental calculators all the time, if anything it's remarkable how much this approach struggles with being one.