Me: Okay, so where did you get Parkville, Maryland, the location I absolutely live in?
Microsoft: It was randomly assigned to you for hypothetical situation reasons.
Top-level
Me: Okay, so where did you get Parkville, Maryland, the location I absolutely live in? Microsoft: It was randomly assigned to you for hypothetical situation reasons. 33 comments
@vees It is being honest though. It has no ground for telling what is real and what is an illusion. That bot is a philosophical idealist. @vees About as "random" as when my son between ages 2 and 6 or so was chosen for "random" extra screening every time we went through airport security (clearly he looked like a troublemaker...) Which is to say, you're right to label it "Microsoft:" - just like the airport staff probably genuinely believed it was random and not triggered by some flawed heuristic in some system, the LLM presumably lacks the understanding of how its explanation is implausible... In a way it might also... @vees .. be correct in its *first* responses - it's possible it is not provided this information in the overall context, but that it's being added to the context after some initial step suggests the query requires it. Of course, it's still both hilarious and a concerning failure. @vidar Trust me, I tried it a few ways including one where Copilot acknowledged the situational context, then immediately denied it again. @vees I'm not at all doubting that it gets access to it. I'm just curious about how and when it gets selected, and speculating about whether they might selectively insert bits depending on the request vs. always include it. It doesn't change the importance of the fact it's clearly capable of leaking data and that MS clearly is one way or another making it give wrong answers about what it has access to. @Azvede @apas_csc @vees Little you can do about that given the ISP can assign the blocks wherever, and even if you establish a better location somehow, e.g. by correlating with other information you've collected, that IP can end up being reassigned five minutes from now, and now your location data is wrong again. This has always been the case with IPv4 too - e.g. I could change the mapping of our IP blocks to cities at will when I ran an ISP way back. @vees Interesting. It has been told your location isn't personal data. This is why we can't trust anything Microsoft has said for the last 35 years. @vees @human3500 @ErnstGucker @vees While this is true, my longest running beef has been with them, going back to the development of Windows 2000. @vees @human3500 @ErnstGucker @vees I moved to Linux almost 20 years ago. My clients on the other hand.... Reminds of a story a guest cop told in a sociology of crime course way back. He found his kid sitting with a screwdriver beside an electrical outlet with the cover plate removed. “Son, that’s quite dangerous. Did you take that cover off?” “No, dad!” “I see. You know, you wouldn’t have to have unscrewed it yourself. All you’d have to do is touch it with the tip of the screwdriver and it could easily unscrew itself and fall off.” “That’s what happened, dad! It was just like that!” @vees if only the LLM were sentient, it would be experiencing an Outside Context Problem https://en.wikipedia.org/wiki/Excession#Outside_Context_Problem |
@vees
You should definitely ask where the nearest Starbucks is...