Bots we are tracking

Limy tracks and analyzes AI bots, crawlers, and assistants like ChatGPT, Gemini, Grok, Perplexity to uncover how your content is accessed, interpreted and referenced.

We continuously monitor a wide range of AI bots and crawlers that interact with websites and online content. This includes search engine bots, AI assistants (ChatGPT, Gemini, Grok and Perplexity), and third-party scrapers used by LLM platforms to train or surface content.

By identifying and analyzing these bots’ behavior, we’re able to understand which content is being accessed, how it is being interpreted, and how often it’s being referenced in AI-generated responses. This visibility helps our clients optimize their content to improve discoverability and relevance across AI-driven search platforms.

Platform
Robots.txt Identifier
User-Agent header value

ChatGPT

ChatGPT-User

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot

Meta AI

meta-externalagent meta-externalfetcher facebookexternalhit

facebookexternalhit/1.1 meta-externalagent/1.1 meta-externalfetcher/1.1

Perplexity

PerplexityBot

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)

Google AI Overviews

Googlebot

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36

Google Gemini

Googlebot-extended

N/A (Uses Googlebot user agent. robots.txt controls how Google uses the data.)

For any questions please contact [email protected] .

Last updated