@TheEntity @scottjenson @molly0xfff
The protection is that it's bad with numbers. So people will ask it what your finances are, but it will confabulate different numbers.
OK, I'm just kidding, and it's pretty darned dark humor, but it raises another key issue: We sometimes analyze the risk today by saying "well, there's no way to make use of that now" but then someone makes an unrelated change that means there is a way, and then we don't go back and re-review the things we've let through.
So if we did stupidly rely on how bad these LLMs are with numbers and decide it was OK to see our financials, and then someone fixed its math, we'd have a danger we'd already let through. And it might not be obvious that the thing creating the danger was "We fixed math."
@kentpitman i read this three times and have no idea what you're saying or how it's a reply to me