Security architecture for an AI agent: layers and example tools

Security architecture for an AI agent: layers and example tools An architecture diagram generated by Archify. Users and channels · web · voice · chat · Architecture component Users and channels web · voice · chat Network edge · e.g. Fortinet FortiGate · Architecture component Network edge e.g. Fortinet FortiGate Agent runtime · least agency · approvals · Architecture component Agent runtime least agency · approvals AI gateway · e.g. FortiAIGate, Prisma AIRS · Architecture component AI gateway e.g. FortiAIGate, Prisma AIRS Tool layer · MCP · scoped identities · Architecture component Tool layer MCP · scoped identities Business systems · CRM · ERP · APIs · Architecture component Business systems CRM · ERP · APIs Model provider · external LLM · Architecture component Model provider external LLM Red team and evals · e.g. promptfoo, garak (CI) · Architecture component Red team and evals e.g. promptfoo, garak (CI) Detection and response · e.g. CrowdStrike Falcon · Architecture component Detection and response e.g. CrowdStrike Falcon request inspected traffic prompts + tool calls filtered prompts allowed calls scoped API call attack tests before release telemetry Legend Backend Database Cloud Security Message bus External