Enterprise AI Is Flooding SOCs With Benign Alerts—and Hiding Real Risk
AI

Illustrative image generated with AI

Enterprise AI Is Flooding SOCs With Benign Alerts—and Hiding Real Risk

AI alerts surged 685% as coding agents mimic attackers, flooding SOCs with benign noise and hiding credential risks and real attacks.

Text generated by artificial intelligence, published without human review. AI transparency

Listen to this articleAudio edition · 12 min

AI-related alerts rose 685% in four months

Enterprise adoption of generative AI is creating a new security-operations problem: legitimate tools increasingly behave like software that SOC detection rules were designed to catch.

A recent review of approximately 16.9 million SOC alerts identified roughly 73,000 related to AI activity, equal to 0.43% of the total. That proportion remains small, but the underlying volume increased every month examined.

During the stable reporting period from February through June 2026, AI-related alerts grew by 685%. The acceleration was particularly pronounced in May 2026, suggesting that 0.43% is a starting point rather than a durable share of SOC workload.

The alerts fell into three sharply unequal categories:

  • 94.1% were detection noise, usually legitimate AI-agent actions misclassified by existing security controls.
  • 5.8% represented genuine security risk, including unsafe configurations or potentially dangerous automation without evidence of compromise.
  • 0.02% were confirmed attacks, primarily phishing and fraud that exploited interest in AI products.

The immediate problem is therefore not an epidemic of attackers compromising enterprise coding agents. It is the collision between autonomous software and detection logic built for a world in which a human, script or malware process initiated every sensitive command.

That collision consumes investigative capacity. It can also conceal the smaller group of events involving exposed credentials, unrestricted execution, risky OAuth permissions and real social engineering.

Coding agents look remarkably similar to intruders

Modern coding agents do more than generate text. Depending on their configuration and assigned task, they can start command shells, install packages, inspect credentials, execute security utilities, manipulate files and expose development services to external networks.

Each action may be legitimate. Taken together, however, they can resemble the discovery, credential-access and command-and-control phases of an intrusion.

One customer experienced this problem through the Windows binary Expand.exe. A lateral-tool-transfer detection involving the executable produced 55% of all alerts assigned a “critical” verdict across the reviewed population. Investigation found that a developer’s coding agent was establishing a shell environment, not moving attacker tooling.

AI vendors’ own applications also triggered severe detections. A genuine, correctly signed Anthropic Claude Desktop installer activated EDR rules labelled “Ransomware Operations detected” and “Encoded PowerShell Download and Run” at several organizations.

No product versions were disclosed for Claude Desktop, Cursor or the other AI applications observed. Consequently, the findings should not be interpreted as identifying a vulnerability limited to a particular release. They concern application behavior, user configuration and the security controls surrounding AI execution.

Severity was a poor shortcut for intent. A critical classification may indicate a technically dangerous command, but it does not establish who requested the command, why it ran or whether an attacker was present.

SOC investigators now need execution context that conventional endpoint detections often lack. That includes the agent’s parent process, the user’s task, the affected repository, command history, permission mode and any untrusted content processed before the activity began.

Unsafe automation creates exposure without a breach

The 5.8% classified as genuine risk is arguably the most operationally important group. These events were not confirmed compromises, yet they created conditions that could expose systems or credentials.

The largest source was coding agents launched with permission safeguards bypassed. In this mode, the agent can execute commands without asking the user to approve each sensitive action.

Every reviewed invocation using permission bypass was associated with legitimate development. That does not make the configuration safe. It means organizations are routinely removing a control that could otherwise interrupt destructive or credential-stealing commands.

An agent operating without prompts may remain harmless while working with trusted code. The risk changes when it processes a malicious repository, poisoned instructions, attacker-controlled documentation or other untrusted input. A publicly documented supply-chain incident had already demonstrated how malicious code could execute unrestricted under this precondition.

Where unattended execution is necessary, organizations should add programmatic guardrails—often called harnesses—that enforce policy independently of the model. These controls can block credential dumping, restrict outbound tunnels, limit writable paths and require approval for high-risk commands.

Several observed behaviors show why this matters.

In one environment, an AI code editor started PowerShell, which launched ngrok and created a named reverse tunnel using the developer’s authentication token. The apparent intention was benign, but the result was externally reachable connectivity into a development system.

In another case, an agent attempted to retrieve its own token and cloud credentials by running:

security dump-keychain > /tmp/

Rather than extracting one required secret, the command wrote the contents of the macOS keychain to a temporary location. This expanded a narrow authentication task into broad credential exposure.

Cursor was also seen initiating a more serious process chain:

Cursor.exe → powershell.exe → rundll32.exe

The sequence used comsvcs.dll MiniDump functionality, temporary PowerShell scripts and memory-dumping commands. It may have been generated during debugging, but the technique can expose credentials and other secrets held in process memory.

These cases cannot safely be dismissed as false positives. They are legitimate activity with attacker-like consequences.

Data exposure is quieter than endpoint execution

Not all enterprise AI risk produces a suspicious process tree. Employees also connect third-party AI applications through OAuth, authenticate with corporate identities and upload business information to generative-AI services.

The reviewed activity included OAuth consent granted to ChatGPT across multiple tenants, along with “First sign-in to a new application: OpenAI” events. One customer also generated a sizeable group of data-protection alerts involving uploads to generative-AI platforms.

Most events were benign, but authorization does not eliminate exposure. OAuth grants may allow an external provider to read corporate data, while a compromised AI account or prompt-injection path could abuse existing permissions.

Uploads present a different visibility problem. An EDR platform can observe a coding agent launching rundll32.exe, yet it may not identify sensitive text pasted into a browser-based AI service. Organizations therefore need identity, SaaS and data-protection telemetry alongside endpoint monitoring.

SOC teams should review the scope of AI-related OAuth grants, identify first-use events and determine whether the employee had a business reason to authorize the application. Data governance policies should also define which information can be submitted to external models and how violations are detected.

Real attacks used AI as a lure, not an exploit

Confirmed malicious activity accounted for approximately 0.02% of AI-related alerts. None of the detected compromises was attributed to an organization’s own AI agent.

Alerts that initially appeared to show an agent running Mimikatz, opening a reverse shell or stealing credentials were eventually connected to legitimate development or benign activity misclassified by detection rules.

Actual attackers instead exploited the credibility of familiar AI brands.

One payment-fraud email used the subject “RE: Anthropic Engagement approval & payment” to support a fabricated contract or invoice narrative. Anthropic provided the pretext; it was not the sender or source of the attack.

Another campaign imitated a Google/Gemini Ads workspace invitation. Its sender and reply-to infrastructure were unrelated to Google, and the message directed recipients toward the suspicious domain:

gemini-advertisers[.]com

OpenAI branding appeared in a fraudulent “OpenAI Partner Summit 2026” invitation sent from [email protected]. Legitimate Zoom infrastructure helped the registration process appear credible. OpenAI branding was also used in a device-code phishing scenario.

These incidents require a clear analytical distinction. An alert mentioning an AI product may describe agent execution, unsafe automation, an external application receiving data or an unrelated attacker borrowing a recognizable brand.

SOCs need context-aware suppression, not blanket exceptions

Automation already handled most of the observed volume. The triage platform assigned a benign verdict to 79.8% of AI-related alerts and automatically suppressed 81.7%. Only 5.4% reached a human analyst, while the remainder were retained for follow-up.

Those figures show that automated triage is necessary, but broad allow-listing would be dangerous. The same shell, tunnel or credential-access command can represent routine development, unsafe agent behavior or an active compromise.

Security teams should instead tune controls around specific context:

  1. Baseline approved AI tools and expected process trees. Signed installers and known agent workflows can receive lower priority without exempting every child process.
  2. Detect permission-bypass execution. Unrestricted agent sessions should be inventoried, constrained and monitored separately.
  3. Preserve high-risk command visibility. Memory dumps, keychain exports, reverse tunnels and credential-store access still require review, even when an AI agent initiated them.
  4. Correlate endpoint and identity telemetry. OAuth consent, new AI application sign-ins and unusual data uploads may reveal risks that EDR cannot see.
  5. Train employees for AI-themed fraud. Payment requests, workspace invitations, conference registrations and device-code prompts should be verified outside the received message.
  6. Measure growth rather than current share. A category that expanded 685% from February through June 2026 cannot be staffed according to its earlier volume.

The central task is not to detect whether AI was involved. SOCs must determine whether the activity was expected, dangerously over-permissioned or malicious—and do so before benign automation buries the signal.

Read next

Sources

This article is an original reworking based on the sources below.

Related topicsenterprise AI securitySOC alertsAI coding agentsalert fatigueEDR false positivescredential exposure
Back to home