How do I verify a change in the buyer's bank details?

Call the counterparty on a number you already held before the request, never one supplied in the message. Treat any mid-transaction change of bank details as suspect by default, and require confirmation from a second known contact.