@Edent This is is difficult because the caller ID is spoofable.

If it wasn't, the notification could have been: "We received a call from PSTN_NUMBER, is it you?"
Then "You should have been provided by agent the following number XXX. If not, please hang up"