@aeva I really should've done that first 😅 I'll leave my post up so others can learn from my unknowingness.

(Spoiler alert: it's all explained here https://not-just-memorization.github.io/extracting-training-data-from-chatgpt.html#how-do-we-know-its-training-data)