ArticleArchitecture

AI agents are becoming a new security boundary

Agents with tool access and provider routing expand the boundary surface of a system. Security review has to follow them, not just the API perimeter.

Evgeniy MedvedevFeb 11, 20267 min read
Architecture
AI agents are becoming a new security boundary - editorial illustration
asset · v1article cover

Security teams are used to thinking about users, roles, services, databases, APIs, and devices. AI agents add another boundary.

An agent can read data, call tools, generate instructions, trigger workflows, and sometimes act faster than a human operator. If it has excessive access, unclear permissions, or weak guardrails, it can become a security risk even when the underlying model appears useful.

Why Agents Change The Risk Model

A chatbot that only answers questions is one thing. An agent that can call tools is different. It may:

  • read customer records;
  • query internal data;
  • create tickets;
  • send messages;
  • update CRM fields;
  • call APIs;
  • trigger automation;
  • write code;
  • change configuration.

Every one of those actions needs a security model.

Least Privilege Applies To Agents Too

An agent should not receive broad permissions because "it might need them." It should receive the minimum access required for the job:

  • specific tools;
  • scoped API permissions;
  • constrained data views;
  • role-based access;
  • rate limits;
  • action approval rules;
  • environment boundaries.

This is basic security discipline, but it becomes more important when an AI system can chain steps together.

Prompt Injection And Tool Misuse

OWASP highlights prompt injection and other LLM application risks as important categories for generative AI systems. For agentic systems, untrusted input can become dangerous when the model has tools. A malicious document, message, or web page can try to influence the agent's behavior.

Practical mitigations include:

  • separating instructions from untrusted content;
  • validating tool inputs;
  • limiting actions available from each context;
  • requiring confirmation for high-impact operations;
  • logging tool calls;
  • testing adversarial scenarios.

Auditability Is Part Of The Product

If an agent acts, the system should be able to answer: what did it see? what did it decide? what tool did it call? what data did it access? what output did it produce? who approved the action if approval was required? This is not only a security concern. It is also a product trust concern.

Human Review Is A Design Choice

Human-in-the-loop should not be a vague statement. Define exactly:

  • which actions are automatic;
  • which actions are drafted but not executed;
  • which actions need approval;
  • which actions are forbidden;
  • which failures escalate to a person.

This makes the agent safer and easier to explain to stakeholders.

ITNeuroNet's Position

ITNeuroNet treats agent architecture as a security and workflow design problem. The design should include: job definition, tool inventory, permission model, data boundary, review model, logging and audit trail, failure modes, and test scenarios.