Email or username:

Password:

Forgot your password?
Top-level
Michael Gemar

@cabel How does this kind of thing not get tested?!

4 comments
Deuchnord

@michaelgemar @cabel that's the problem with AIs: by definition, they can't be tested entirely, because nobody really knows what they will reply to a given request. They only give replies based on some probabilities ("predictions") that have been computed from data before.

Michael Gemar

@Deuchnord @cabel Right, but these issues crop up *so* quickly after their release — are they not testing at all, or at least some obvious edge cases? I feel like no one is internally “red teaming” these models.

Deuchnord

@michaelgemar @cabel well, at least, we're speaking about a feature expected to be available for iOS 15.1, in October-November 2024. I suppose Apple will try to fix that, even though it will be hard...

Michael Gemar

@Deuchnord @cabel I would have hoped these highly-publicized features would be more fully baked before even releasing them as betas.

Go Up