# How to run a shadow AI audit

URL: https://shadowaidetectiontools.com/guides/how-to-run-a-shadow-ai-audit/
Updated: 2026-11-16

A shadow AI audit lists every AI app, agent, extension, plugin and MCP server in use without approval, then rates each by data exposure and owner. Pull identity provider, proxy and endpoint data first, reconcile them into one inventory, and expect a first pass in days, not months.

## What does a shadow AI audit cover?

A shadow AI audit covers seven kinds of unapproved AI: web apps, desktop apps, coding agents, browser extensions, IDE plugins, MCP servers and AI features switched on inside approved SaaS, plus apps granted OAuth access. Cover all of them, because each is visible from a different place and a single log source shows only some.

Set the scope in writing before pulling data: which business units, which devices (managed and unmanaged), which identity tenants and which SaaS apps. Decide up front what counts as approved, since the audit output is the difference between what is in use and what is on the approved list.

Sources: [AI agent support matrix, Microsoft Defender for Endpoint](https://learn.microsoft.com/en-us/defender-endpoint/ai-agent-support-matrix); [Harmonic Security: endpoint AI security](https://www.harmonic.security/solutions/endpoint-ai-security).

## Which data sources do you pull first?

Pull the identity provider logs first, then proxy or DNS logs, then SaaS admin consoles, then endpoint inventory. Identity records show which AI apps staff signed in to with a work account, and they exist before any new tool is bought.

In Microsoft Entra ID the sign-in logs record every sign-in to the tenant, and the audit logs record application and consent changes. In Google Workspace, API controls list configured apps, accessed apps and apps pending review, with details appearing 24 to 48 hours after authorization. Okta exposes the System Log through an API. Then upload a firewall or proxy log: Microsoft documents a manual snapshot report for exactly this check before an automatic collector is set up.

Sources: [Sign-in logs in Microsoft Entra ID](https://learn.microsoft.com/en-us/entra/identity/monitoring-health/concept-sign-ins); [Audit logs in Microsoft Entra ID](https://learn.microsoft.com/en-us/entra/identity/monitoring-health/concept-audit-logs); [Control which apps access Google Workspace data](https://support.google.com/a/answer/7281227); [System Log API, Okta Developer](https://developer.okta.com/docs/reference/api/system-log/); [Create snapshot cloud discovery reports, Microsoft Defender for Cloud Apps](https://learn.microsoft.com/en-us/defender-cloud-apps/create-snapshot-cloud-discovery-reports).

## How long does a first audit take?

A first audit takes days when it relies on existing logs and about a week or more when new collection is needed. Published vendor setup times show the range: Grip Security says 10 minutes of setup and about 5 days to gather historic usage, Nudge Security says most organizations deploy in under an hour, and Harmonic says first insight in about 30 minutes.

Reco publishes 24 to 48 hours to full deployment, and Microsoft documents that Purview DSPM for AI policies need at least 24 hours before results appear. All of these are vendor statements, so treat them as planning figures and measure your own.

Sources: [Grip Security: discover SaaS risks](https://www.grip.security/platform/discover-saas-risks); [Nudge Security: AI security use case](https://www.nudgesecurity.com/use-cases/ai-security-3); [Harmonic Security: shadow AI detection](https://www.harmonic.security/solutions/shadow-ai-detection); [Reco: shadow AI discovery](https://www.reco.ai/use-cases/shadow-ai-discovery); [Data Security Posture Management for AI, Microsoft Purview](https://learn.microsoft.com/en-us/purview/dspm-for-ai); [Grip Security source (grip-security-14)](https://www.grip.security/ai-security); [Reco source (reco-08)](https://www.reco.ai/platform/application-discovery).

## What should the audit produce?

The audit should produce one inventory with an owner for each entry, the data the tool touches, the sign-in method and a disposition: approve, restrict, replace or remove. A list of domains alone is not an inventory.

Add the vantage point that found each item. An entry seen only in the proxy log may be a personal account, and an entry seen only in OAuth records may never have run on a managed device. The inventory guide on this site lists the fields.

Sources: [View discovered apps on the Cloud discovery dashboard](https://learn.microsoft.com/en-us/defender-cloud-apps/discovered-apps); [OAuth Token Audit Activity Events, Google for Developers](https://developers.google.com/workspace/admin/reports/v1/appendix/activity/token).

## What should you do with the first findings?

Triage by data exposure and by whether the account is personal or corporate, then pick one action per finding: warn the user, route to an approved tool, require approval, revoke the OAuth grant or block. Revoking an OAuth grant is a documented action in several products, and Microsoft documents reviewing and revoking permissions granted to enterprise applications in Entra ID.

Schedule the next pass before closing the first. Cloud discovery policies can alert when a new app appears, which turns the audit into a standing control.

Sources: [Review permissions granted to enterprise applications](https://learn.microsoft.com/en-us/entra/identity/enterprise-apps/manage-application-permissions); [Create cloud discovery policies, Microsoft Defender for Cloud Apps](https://learn.microsoft.com/en-us/defender-cloud-apps/cloud-discovery-policies).

## Sources

- [AI agent support matrix, Microsoft Defender for Endpoint](https://learn.microsoft.com/en-us/defender-endpoint/ai-agent-support-matrix) (learn.microsoft.com), read 2026-11-16
- [Harmonic Security: endpoint AI security](https://www.harmonic.security/solutions/endpoint-ai-security) (harmonic.security), read 2026-11-16
- [Sign-in logs in Microsoft Entra ID](https://learn.microsoft.com/en-us/entra/identity/monitoring-health/concept-sign-ins) (learn.microsoft.com), read 2026-11-16
- [Audit logs in Microsoft Entra ID](https://learn.microsoft.com/en-us/entra/identity/monitoring-health/concept-audit-logs) (learn.microsoft.com), read 2026-11-16
- [Control which apps access Google Workspace data](https://support.google.com/a/answer/7281227) (support.google.com), read 2026-11-16
- [System Log API, Okta Developer](https://developer.okta.com/docs/reference/api/system-log/) (developer.okta.com), read 2026-11-16
- [Create snapshot cloud discovery reports, Microsoft Defender for Cloud Apps](https://learn.microsoft.com/en-us/defender-cloud-apps/create-snapshot-cloud-discovery-reports) (learn.microsoft.com), read 2026-11-16
- [Grip Security: discover SaaS risks](https://www.grip.security/platform/discover-saas-risks) (grip.security), read 2026-11-16
- [Nudge Security: AI security use case](https://www.nudgesecurity.com/use-cases/ai-security-3) (nudgesecurity.com), read 2026-11-16
- [Harmonic Security: shadow AI detection](https://www.harmonic.security/solutions/shadow-ai-detection) (harmonic.security), read 2026-11-16
- [Reco: shadow AI discovery](https://www.reco.ai/use-cases/shadow-ai-discovery) (reco.ai), read 2026-11-16
- [Data Security Posture Management for AI, Microsoft Purview](https://learn.microsoft.com/en-us/purview/dspm-for-ai) (learn.microsoft.com), read 2026-11-16
- [View discovered apps on the Cloud discovery dashboard](https://learn.microsoft.com/en-us/defender-cloud-apps/discovered-apps) (learn.microsoft.com), read 2026-11-16
- [OAuth Token Audit Activity Events, Google for Developers](https://developers.google.com/workspace/admin/reports/v1/appendix/activity/token) (developers.google.com), read 2026-11-16
- [Review permissions granted to enterprise applications](https://learn.microsoft.com/en-us/entra/identity/enterprise-apps/manage-application-permissions) (learn.microsoft.com), read 2026-11-16
- [Create cloud discovery policies, Microsoft Defender for Cloud Apps](https://learn.microsoft.com/en-us/defender-cloud-apps/cloud-discovery-policies) (learn.microsoft.com), read 2026-11-16

## Related pages

- [Triaging What a Shadow AI Scan Finds](/guides/triaging-what-a-shadow-ai-scan-finds/)
- [What a Shadow AI Inventory Should Contain](/guides/what-a-shadow-ai-inventory-should-contain/)
- [AI asset register (glossary)](/glossary/ai-asset-register/)
- [All guides](/guides/)
- [Embedded AI Features Switched On in Approved SaaS](/guides/embedded-ai-features-switched-on-in-approved-saas/)
- [Personal vs Corporate AI Accounts: Telling Them Apart](/guides/personal-versus-corporate-ai-accounts/)
- [The ranking](/ranking/)
- [Glossary](/glossary/)
