Known Agents is an AI agent and bot traffic analytics platform designed to help website owners track, control, and monetize the increasing presence of AI agents, crawlers, and scrapers visiting their sites. Founded in New York City by Gavin King, formerly of Meta/Instagram, Vimeo, PayPal, and Intuit, Known Agents provides real-time visibility into non-human traffic, enabling businesses to understand and optimize interactions with these digital visitors.
Key Features and Functionality:
- Real-Time Bot Analytics: Monitor and analyze the activity of AI agents, crawlers, and scrapers on your website as it happens.
- Agent Identification: Identify and categorize various AI agents, including GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Googlebot, Bytespider (TikTok), and CCBot (Common Crawl).
- Session Replays: Replay AI agent navigation patterns to understand their behavior and interactions with your site.
- LLM Referral Tracking: Measure citations and human click-throughs from AI chat platforms like ChatGPT, Claude, and Gemini.
- Automatic Robots.txt Management: Control access for entire categories of bots, including AI crawlers, scrapers, and SEO bots, with automated robots.txt updates.
- Bad Bot Detection: Identify and block misbehaving bots and unauthorized scrapers that may be impacting your site's performance.
Primary Value and Solutions:
Known Agents addresses the challenge of unseen AI agent traffic, which can constitute a significant portion of a website's visitors. By providing detailed insights into this non-human traffic, website owners can:
- Optimize Content and SEO Strategies: Understand which pages AI agents are most interested in, allowing for targeted content optimization.
- Protect Intellectual Property: Monitor and control access to content, preventing unauthorized scraping and potential misuse.
- Enhance Server Performance: Identify and manage bot traffic to reduce server load and improve site performance.
- Leverage AI-Driven Referrals: Track and capitalize on human referrals originating from AI chat platforms, turning AI interactions into growth opportunities.
By offering these capabilities, Known Agents empowers businesses to navigate the evolving digital landscape where AI agents play an increasingly prominent role.
