✦ AI Explained
Emerging area 15 min lesson

Security boundaries for agentic systems

Treat model input as untrusted, tool authority as sensitive and every integration as a supply-chain decision. Security is enforced by systems, not by asking a model to behave.

The model reads untrusted content

A ticket, web page, document or tool result can contain instructions aimed at the model. That is prompt injection. It becomes dangerous when the system lets untrusted content influence tool selection, permissions or data disclosure.

The mitigation is architectural: separate instructions from data, constrain tools, validate arguments, enforce authorization in the runtime and require approval for consequential effects. Telling the model to ignore malicious text helps, but it is not a security control.

Least privilege all the way down

Give the user, application, model provider integration, tool server and workload separate identities where practical. Give each the smallest useful permission. Use short-lived credentials, managed secrets and audited authorization decisions. A read-only investigation assistant should not possess a production deployment token “just in case.”

Protect data and dependencies

Classify data before it enters prompts, retrieval stores or telemetry. Know provider retention and training settings. Redact what is unnecessary. Review MCP servers, plugins, containers and packages as dependencies with code, permissions and update risk. Log actions without logging the secrets needed to perform them.

Try it

Run workbench a2a-server, then in another terminal run workbench a2a-review. The peer accepts only named synthetic scenarios and advertised evidence sources; an unknown source becomes a rejected task. That is an example boundary, not a complete security programme. Use this short threat-model prompt: who can influence the model’s input; what data could leave the boundary; which tool causes the most harm; which identity can call it; and what evidence would show misuse?

Keep this with you

The safest prompt is not a substitute for a safe permission boundary.

Check the source

These are the primary sources behind the moving parts of this lesson. Check them again when you make an implementation decision.

✏ Suggest an edit on GitHub

Security boundaries for agentic systems

Question 1: What is the architectural response to prompt injection?
Question 2: Which principle should govern an agentic tool's credentials?