AI Security Has Moved Beyond the Chatbot

Ask many executives what comes to mind when they hear AI security, and two risks often dominate the conversation:

Prompt injection.

and

Sensitive data leakage.

Both remain important.

But enterprise AI has evolved considerably beyond a user typing prompts into a standalone chatbot. Hence the relevance of OWASP LLM Top 10 2026.

Organizations are now deploying:

  • AI copilots
  • retrieval-augmented generation systems
  • internal AI applications
  • AI-enabled SaaS platforms
  • coding assistants
  • AI agents
  • Model Context Protocol integrations
  • APIs connected to foundation models
  • autonomous and semi-autonomous workflows

As those systems gain access to enterprise identities, data and applications, the attack surface expands with them.

The OWASP GenAI Security Project released its Top 10 for LLM Applications 2026 in August 2026. OWASP describes this edition as an updated, community-driven guide informed by hundreds of AI security contributors and research drawn from thousands of real-world AI security incidents. It also expands alignment with frameworks including NIST, MITRE ATLAS, CWE, and OWASP’s own Top 10 for Agentic Applications. OWASP Gen AI Security Project

For security leaders, the most important takeaway is not simply that the list has changed.

It is that AI security is becoming an enterprise-security problem rather than a narrow application-security problem.

Prompt Injection Still Matters

Prompt injection remains one of the defining security challenges of LLM-based applications.

An attacker may attempt to manipulate an AI system by introducing instructions designed to override its intended behavior.

Those instructions may appear directly in a user prompt.

But they may also arrive indirectly through content the AI consumes, such as:

  • web pages
  • documents
  • emails
  • databases
  • uploaded files
  • third-party data
  • tool responses

This becomes particularly important when AI applications are connected to external information sources.

A system designed only to identify malicious user prompts may miss instructions embedded elsewhere in the workflow.

OWASP’s own incident analysis in 2026 illustrates how prompt injection can combine with sensitive-information exposure and unsafe output handling, rather than existing as an isolated vulnerability. OWASP Gen AI Security Project

The security lesson is straightforward:

Do not rely on prompts alone as a trust boundary.

Prompt filtering can help, but organizations also need architectural controls limiting what the model can access and what it can do.

Sensitive Data Exposure Is an Enterprise Data Problem

Generative AI systems interact with enormous amounts of information.

Depending on the application, that may include:

  • customer records
  • contracts
  • employee information
  • proprietary source code
  • intellectual property
  • healthcare information
  • financial information
  • internal communications
  • authentication data

The risk is not limited to a model accidentally revealing something in its response.

Sensitive information may be exposed through:

  • prompts
  • retrieval systems
  • embeddings
  • context windows
  • logs
  • training or fine-tuning data
  • integrated tools
  • third-party AI platforms

OWASP’s 2026 data-security guidance emphasizes that GenAI creates new risks across the full data lifecycle—from training and fine-tuning through prompts, model outputs and production operation—and recommends continuous testing, validation and monitoring rather than treating data security as a one-time design activity. OWASP Gen AI Security Project

Security teams therefore need to ask:

What information can this AI system access?

Should it have access to that information?

Where does the information go after the AI receives it?

That makes AI security inseparable from data classification, DLP, encryption, access control and governance.

Excessive Privileges to Agents Change the Risk Model

This is where AI security begins to look significantly different from traditional chatbot security.

A chatbot may primarily generate text.

An AI agent may be able to:

  • retrieve a file
  • send an email
  • modify a database record
  • create a support ticket
  • execute code
  • call an API
  • access cloud infrastructure
  • initiate a workflow

The more authority the system receives, the greater the potential impact when something goes wrong.

That problem may result from:

  • excessive permissions
  • poor identity design
  • compromised tools
  • malicious instructions
  • incorrect reasoning
  • weak approval mechanisms

OWASP’s agentic-security work highlights risks including tool misuse, identity and privilege abuse, memory/context poisoning, supply-chain weaknesses and excessive autonomy across agentic workflows. OWASP Gen AI Security Project

For security leaders, this introduces a crucial principle:

AI capability should be constrained by business need, not technical possibility.

If an agent only needs to read data, it should not receive write access.

If it only needs to query one system, it should not receive broad enterprise permissions.

AI agents should be governed according to the same Zero Trust principles organizations apply elsewhere:

least privilege, explicit authorization and continuous verification.


AI Identity Is Becoming a Major Security Issue

The conversation around enterprise identity has traditionally focused on:

  • employees
  • administrators
  • contractors
  • service accounts
  • applications
  • workloads

AI agents now introduce another category.

An agent may act:

  • using a user’s identity
  • under a service account
  • through delegated permissions
  • with API credentials
  • using OAuth tokens
  • through machine identities

That raises important questions:

Whose authority is the agent operating under?

Can the agent’s actions be attributed?

Can its access be revoked?

Does it have more privilege than necessary?

Are its credentials securely managed?

Recent OWASP agentic-security analysis explicitly identifies identity and privilege abuse as a major risk area and emphasizes the need for runtime controls, agent identity visibility and architectural monitoring. OWASP Gen AI Security Project

This is one reason AI security increasingly intersects with:

–– > IAM

— > PAM

— > machine identity

— > Zero Trust

— > SOC monitoring


Insecure Output Handling Still Creates Real Risk

AI-generated output should not automatically be trusted simply because it came from an internal AI system.

LLM output may contain:

  • code
  • SQL
  • scripts
  • HTML
  • URLs
  • commands
  • configuration changes

If downstream applications automatically execute or render that output without validation, an attacker may be able to turn manipulated AI responses into a traditional application-security compromise.

Organizations should continue applying established controls:

  • input validation
  • output encoding
  • parameterized queries
  • sandboxing
  • allowlisting
  • command restrictions
  • approval gates

AI does not replace secure software design.

It creates another layer that must operate within it.


The AI Supply Chain Is Growing Quickly

Few organizations build an AI application entirely from scratch.

A typical enterprise AI solution may depend on:

  • a foundation model provider
  • an orchestration framework
  • vector databases
  • embedding models
  • open-source libraries
  • APIs
  • plugins
  • MCP servers
  • third-party datasets
  • externally developed agents

Each dependency creates another trust relationship.

That is why OWASP’s GenAI work increasingly includes AI supply-chain transparency, including initiatives around AI Bills of Materials and broader risk mapping. OWASP Gen AI Security Project

Organizations should therefore understand:

Which models are we using?

Which components depend on them?

Which third parties process our data?

Which tools can our agents call?

Which external systems could influence AI behavior?

Traditional software supply-chain security remains relevant.

But AI adds models, prompts, training data and autonomous integrations to the dependency graph.


Tools and Plugins Expand the Attack Surface

AI becomes substantially more powerful when it can use tools.

Those tools might include:

  • search
  • databases
  • file systems
  • ticketing systems
  • CRM
  • cloud platforms
  • messaging systems
  • code repositories

MCP and similar frameworks make these integrations easier to build.

But they also increase the importance of access control.

An AI agent with access to a tool effectively inherits some level of that tool’s capability.

Organizations should therefore implement:

  • explicit tool allowlists
  • scoped permissions
  • strong authentication
  • API authorization
  • input validation
  • logging
  • secrets management
  • network restrictions

OWASP’s guidance for secure MCP development reflects this emerging concern, specifically treating MCP servers as important connection points between AI assistants and external data, APIs and tools. OWASP Gen AI Security Project


Untrusted Data Can Manipulate AI Behavior

AI systems increasingly consume data automatically.

That may include:

  • documents
  • emails
  • webpages
  • third-party feeds
  • knowledge bases
  • vector databases
  • user-generated content

Security teams need to recognize that this information may not simply be data.

For an LLM, it may also become instructions.

That creates a new trust problem.

A malicious document could influence an AI system differently than a malicious document would affect a conventional application.

This is why AI architecture needs explicit trust boundaries around external context and retrieval systems.

Untrusted information should not automatically receive the same level of confidence as curated enterprise data.


Third-Party AI Risk Is Becoming More Important

Organizations may increasingly rely on AI services they do not directly control.

Third-party review should therefore go beyond conventional questions such as uptime and encryption.

Security leaders should also ask:

  • Is customer data used for training?
  • How long is prompt data retained?
  • What model providers are involved?
  • Where is data processed?
  • Which subcontractors have access?
  • Can enterprise data be deleted?
  • What telemetry is available?
  • How are AI security incidents reported?
  • What happens if the underlying model changes?

AI procurement increasingly needs input from:

Security + Legal + Privacy + Compliance + Data Governance

Not simply the business team purchasing the product.


Monitoring AI Must Become Part of Security Operations

One of the most important changes is operational.

AI security should not stop once an application passes an architecture review.

Organizations need visibility into what happens after deployment.

That includes understanding:

  • which user initiated an AI action
  • which model was involved
  • which identity the AI used
  • which data it accessed
  • which tools it called
  • which external systems were contacted
  • which actions were executed
  • whether policies were violated

OWASP’s recently published Agent Control Standard reflects this direction, emphasizing that enterprise agents should be inspectable, traceable and controllable at runtime rather than operating as black boxes. OWASP Gen AI Security Project

That has direct implications for the SOC.

AI telemetry eventually needs to become another source of security context, alongside:

  • EDR
  • identity
  • network activity
  • cloud telemetry
  • vulnerability data
  • threat intelligence

AI Incident Response Needs Its Own Playbooks

Organizations already prepare for incidents such as:

  • ransomware
  • account compromise
  • malware
  • data breaches

AI creates additional scenarios.

What happens when:

  • an employee sends sensitive data to an unauthorized AI platform?
  • an agent exposes credentials?
  • an AI integration begins performing unauthorized actions?
  • an MCP server is compromised?
  • a third-party model provider experiences a breach?
  • a poisoned data source influences agent behavior?

The security team should already know:

How do we contain it?

Can credentials be revoked?

Can the integration be disabled?

Which logs should be preserved?

Who owns the investigation?

What legal or regulatory obligations may apply?

AI incident response should therefore become part of the broader enterprise IR program.


The Most Important Lesson From the 2026 OWASP Guidance

The biggest mistake organizations can make is treating the OWASP LLM Top 10 as simply another vulnerability checklist.

The broader message is more important.

AI systems now sit at the intersection of:

Applications

Identity

Data

Third parties

Automation

Cloud

Security operations

As AI agents become more capable, those domains become more tightly connected.

That means AI security cannot belong exclusively to the development team.

It requires collaboration across:

  • application security
  • IAM
  • cloud security
  • data security
  • GRC
  • threat management
  • incident response
  • security operations

From AI Application Security to Enterprise AI Security

Security leaders should move beyond asking:

“Did we test the model for prompt injection?”

and begin asking:

Do we know what AI systems exist?

Do we know what identities they use?

Do we understand the data they can access?

Can we restrict their tools and actions?

Are third-party AI dependencies governed?

Can we detect abnormal AI activity?

Can we investigate an AI-related incident?

That is the transition from AI application security to enterprise AI security.


How Velocis Approaches AI Security

At Velocis Technologies, we believe AI security should connect directly to the existing cybersecurity program rather than operate as a separate silo.

Our approach brings together:

AI Governance

Define ownership, acceptable use and security requirements.

Identity and Zero Trust

Control the identities, permissions and credentials used by AI systems and agents.

Data Protection

Establish boundaries around sensitive and regulated information.

Application and Agent Security

Restrict tools, integrations and execution privileges.

Third-Party Risk

Evaluate AI providers, models, APIs and dependencies.

Security Monitoring

Incorporate AI activity into broader security operations.

Incident Response

Prepare organizations to contain and investigate AI-related security events.

The objective is not to slow down AI adoption.

It is to make adoption visible, governed and defensible.


Start With a Readiness Assessment

If your organization is deploying generative or agentic AI, begin with a few practical questions:

  1. Do we know which AI systems are currently being used?
  2. Have those systems been assigned owners?
  3. Do we understand which data they can access?
  4. Do we know which identities and permissions AI agents use?
  5. Are their tools and integrations restricted?
  6. Can we monitor AI activity?
  7. Are AI vendors included in third-party risk management?
  8. Do we have an AI-specific incident-response process?

If several answers are no, the organization does not necessarily need to stop AI adoption.

It needs stronger security guardrails around it.


Secure AI Without Slowing Innovation

The OWASP LLM Top 10 2026 is an important reminder that AI security is expanding beyond the model itself.

The organizations best positioned to use AI safely will be those that integrate AI into existing disciplines around:

identity, data, application security, risk management and security operations.

Velocis Technologies helps organizations build that operating model for generative and agentic AI.

Download the Velocis Enterprise AI Security Readiness Checklist

Use our 15-question Enterprise AI Security Readiness Checklist to evaluate your current visibility, governance, identity, data protection, monitoring and incident-response capabilities.

→ Download the AI Security Readiness Checklist

→ Request a Velocis AI Security & Governance Assessment

VT
AUTHOR

Velocis Technologies

Managed security operations and licensed investigations, based in Frisco, Texas.