They're also good for any time when the output is easily tested/verified. I've used GPT for little scripts in unfamiliar languages for example.

They're good for manipulating information you give them, but can't be trusted to go out and find it in the first place.