Scalytics Deep Search User Bot

Last updated May 09, 2025

At Scalytics, we’re building the enterprise-grade private search infrastructure for AI. Deep Search is part of that mission: a fully private, explainable search runtime that empowers our customers to query the web securely, without ever exposing their data to third parties.

To enable this, we run a user agent that acts only in response to direct customer queries through our platform. This bot is never used for training public AI models or broad internet crawling.

User Agent Details

Full user-agent string:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; 
Scalytics-User/1.0; +https://scalytics.io/deepsearch)

Bot name: Scalytics-User

Purpose:

Scalytics-User is a fetcher that powers the Deep Search feature inside Scalytics Connect. When an enterprise user submits a question through their private AI assistant, this bot may retrieve live content from the public web to enrich the response. It enables real-time web access within the boundaries of the user’s control and security settings.

This user agent is strictly user-driven and does not participate in general web crawling or bulk indexing. It exists only to serve live, query-specific retrieval initiated by authenticated users.

robots.txt policy:

Since every fetch is explicitly initiated by a user, Scalytics-User generally does not obey robots.txt. We honor noindex and related directives where applicable and recommend webmasters reach out if special handling is desired.

How Scalytics Deep Search Works

Scalytics Deep Search is not a public crawler or search engine. It’s a customer-controlled module within Scalytics Connect, our private AI stack.

  • Each customer runs Deep Search in their own isolated environment.
  • Queries are processed using local or containerized LLMs and embedding models, with real-time augmentation using search results from the web.
  • No third-party APIs, no data exposure, and no data retention beyond what the customer configures.

Think of it as a private Deep Search or Research AI or self-hosted web retrieval layer—designed for security-first organizations that want modern AI capabilities without surrendering their IP or customer data.