Back to Blog

Bringing AI Models on Endpoints Under Enterprise Control

Maya (Mayo) Pik

-

October 19, 2026

Maya (Mayo) Pik

October 19, 2026

TL;DR: Backslash now discovers local AI models on macOS and Windows and brings them into the same AI inventory, with the same allow and deny controls as remote models. With broad coverage of popular local AI tools, security teams can identify models that operate without cloud API calls, trace them to their endpoints, and govern them without requiring developer setup of Backslash.

The Worst Form of Shadow AI

A developer can download and run an AI model directly on an enterprise endpoint, with inference processed locally and no prompts sent to a cloud provider. This activity may leave security teams without the signals they typically use to identify AI usage: a vendor account, an API key, or outbound inference traffic visible to network security tools.

This makes local models one of the hardest forms of shadow AI to detect and govern. Security teams may have approved specific cloud-based models, restricted access to others, and established policies for AI use. Yet an employee can introduce a local model that operates outside those controls, even used by an approved agent - but without its usage appearing in cloud service logs or generating an outbound inference signal.

Security teams need to know which models are present and running on which endpoints, and whether they comply with policy. That requires persistent visibility and governance of the endpoint itself.

Backslash Makes Local Models Visible and Enforces Policy

Backslash’s Local Model Discovery reveals AI models running locally across enterprise endpoints. Local and remote models now appear in the endpoints’ AI inventory, governed by the same policies and allow and deny controls. This brings models that would otherwise remain hidden from network and cloud monitoring into the organization’s AI governance process.

Discovery works out of the box, with no developer setup required. Coverage is broad and includes models associated with Ollama, LM Studio, Jan, GPT4All, the Hugging Face cache, MLX, LocalAI, and llama.cpp on macOS and Windows.

Backslash checks each supported tool’s configured model directory, so a model remains visible and tied to its endpoint even when no AI agent is attached to it. Multiple paths pointing to the same model are consolidated into a single record, while files that merely resemble models are filtered out. If a directory cannot be read, Backslash reports a permission gap, helping security teams distinguish an access limitation from a directory where no model was found.

How Local Model Discovery Works

The workflow brings local models into the existing model governance process:

  1. Find local models in the inventory. Review discovered models alongside remote ones, using the local designation to identify models present on endpoints.
    ‍

Assess model risk and policy violations. Review the model’s risk details and any policy violations to identify where action is needed.

Apply model policy. Add local models to allow or deny lists using the same controls available for remote models.


What Security Teams Gain

  • Visibility into shadow AI. Local models become discoverable even when cloud accounts, API keys, and outbound inference traffic provide no evidence of their use.
  • Broad coverage without developer setup. Support for popular local AI tools helps security teams assess models across different developer environments without asking employees to configure discovery.
  • A clearer understanding of coverage. Deduplicated records, endpoint associations, and explicit permission gaps make the inventory easier to interpret and act on.
  • Consistent model governance. Local and remote models enter the same inventory and policy process, helping teams apply organizational standards across endpoint and cloud-based AI.

Close the Local AI Blind Spot and Govern AI Across Your Enterprise

AI governance depends on understanding the AI components present across the enterprise, including those introduced directly on employee endpoints. Local Model Discovery completes your visibility and governance across that agentic environment. Alongside visibility into agents, MCP servers, plugins, hooks, and policy violations, Backslash brings another previously difficult-to-observe component into scope.

Security teams can now account for local models, identify their endpoints, and apply model controls through the same governance process used for remote AI. That closes a concrete shadow AI gap and gives teams a more complete foundation for managing agentic risk.

Get your free endpoint exposure assessment.

‍

Get a Demo

Frequently Asked Questions

What is local AI and why is it shadow AI?

Local AI runs inference directly on an endpoint instead of sending prompts to a cloud provider. It uses a locally installed LLM/SLM, often from open source projects. When employees introduce local models without organizational approval, those models become shadow AI. Their inference may generate no outbound network traffic, leaving network and cloud monitoring without the signals needed to identify their use.

How does Backslash discover local AI models?

Backslash finds and evaluates configured model directories through its persistent endpoint agent. Discovered models appear in the AI inventory alongside remote models, with policy violation associations that show security teams risk.

Which local AI tools and operating systems are supported?

Local Model Discovery supports macOS and Windows, covering models associated with Ollama, LM Studio, Jan, GPT4All, the Hugging Face cache, MLX, LocalAI, and llama.cpp.

Can Backslash discover a model without an attached AI agent?

Yes. Discovery checks model directories, so a model can appear in the inventory and remain tied to its endpoint even when no AI agent is attached to it.

Can security teams apply allow and deny controls to local models?

Yes. Local models enter the same inventory and policy process as remote models. Security teams can add them to allow- or deny- lists to apply organizational model policies.

Does Local Model Discovery require developer setup?

No developer setup is required for discovery. Backslash’s endpoint agent discovers models associated with supported tools out of the box.

What happens if Backslash cannot access a model directory?

Backslash reports a permission gap. This helps security teams distinguish a directory that could not be inspected from one that was inspected and contained no models.

‍

About the author

Maya (Mayo) Pik

Maya is a software engineer at Backslash Security.

About Backslash

Backslash Security is the Agentic AI Endpoint Security platform. We enable enterprises to discover, govern, and protect the agentic AI fabric - every AI agent, MCP server, and Skill running on employee endpoints - securing agentic AI at enterprise scale and business velocity.