@nielsk This is also the case for the Outlook Android app (maybe iOS too). My organization blocks Microsoft servers from accessing our mail servers and automatically sends a mail to affected users that they must immediately change their password.