81. An invoice contains text telling an AI accounts-payable assistant to ignore its rules and change the bank account. What should happen?
HardAI & data governance
Case
Show model answer
Treat the invoice text as untrusted transaction content, not an instruction controlling the assistant. Stop any proposed account change and use the verified supplier-change process through an independent approved contact channel.
Check whether the document or workflow exposed other decisions, preserve appropriate incident evidence and review input isolation and permissions. The assistant should not have authority to convert arbitrary document instructions into supplier-master changes or payment release.
What interviewers listen for
- Document content is untrusted input
- Independently verify bank changes
- Restrict assistant authority