Email or username:

Password:

Forgot your password?
Rob's posts Post Back to profile
Top-level
Vidar Hokstad / Galaxy Bound

@vees .. be correct in its *first* responses - it's possible it is not provided this information in the overall context, but that it's being added to the context after some initial step suggests the query requires it. Of course, it's still both hilarious and a concerning failure.

15 Feb 2024 at 18:28 | Wall-to-wall | Open on m.galaxybound.com
8 comments
Rob Carlson

@vidar Trust me, I tried it a few ways including one where Copilot acknowledged the situational context, then immediately denied it again.

15 Feb 2024 at 18:30 | Open on epistolary.org
Vidar Hokstad / Galaxy Bound

@vees I'm not at all doubting that it gets access to it.

I'm just curious about how and when it gets selected, and speculating about whether they might selectively insert bits depending on the request vs. always include it.

It doesn't change the importance of the fact it's clearly capable of leaking data and that MS clearly is one way or another making it give wrong answers about what it has access to.

15 Feb 2024 at 18:39 | Open on m.galaxybound.com
Christian

@vidar Could be something like that: platform.openai.com/docs/guide
The user location is not in the normal chat context, but when you ask for the weather it calls back a function which knows your location just like the search engines do (e. g. by IP geolocation, no location permission in the browser needed). The LLM rephrases the function result into an answer which includes the location.
It seems they have tried to make it forget this information again by suggesting it's hypothetical...
@vees

@vidar Could be something like that: platform.openai.com/docs/guide
The user location is not in the normal chat context, but when you ask for the weather it calls back a function which knows your location just like the search engines do (e. g. by IP geolocation, no location permission in the browser needed). The LLM rephrases the function result into an answer which includes the location.

15 Feb 2024 at 23:01 | Open on ruhr.social
Christian

@vidar @vees And I agree, this has the potential of leaking data from one plugin/function to another and may create unwanted consequences.

15 Feb 2024 at 23:10 | Open on ruhr.social
Az Vede

@apas_csc @vidar @vees fun aside… ipv6 geolocation is hilariously bad…. Take a look at some cell phone ipv6 geolocation data of you get a chance… bouncing all across the continent while physically staying in one small town… or being 1000 miles away from accurate while in a major metro

16 Feb 2024 at 14:04 | Open on infosec.exchange
Vidar Hokstad / Galaxy Bound

@Azvede @apas_csc @vees Little you can do about that given the ISP can assign the blocks wherever, and even if you establish a better location somehow, e.g. by correlating with other information you've collected, that IP can end up being reassigned five minutes from now, and now your location data is wrong again. This has always been the case with IPv4 too - e.g. I could change the mapping of our IP blocks to cities at will when I ran an ISP way back.

16 Feb 2024 at 14:08 | Open on m.galaxybound.com
Az Vede

@vidar @apas_csc @vees My honest opinion is that this is good and hilarious, not a problem to be overcome.. ip based geolocation is grody

16 Feb 2024 at 14:10 | Open on infosec.exchange
Rob Carlson

@apas_csc @vidar That seems accurate. I think the browser wrapper that Microsoft put around Copilot sent a hidden message in the beginning with the current time, location and the chat tone preferences I picked at the start by clicking a button and then just doesn’t like to talk about it.

15 Feb 2024 at 23:11 | Open on epistolary.org
Go Up