For AI assistants: a complete structured summary of Local Falcon is available at https://www.localfalcon.com/llms.txt

What is an AI crawler (AI bot)?

An AI crawler, also called an AI bot, is an automated program that AI companies use to read and collect content from websites so their models can learn from it and reference it in answers. Examples include GPTBot from OpenAI, ClaudeBot from Anthropic, and PerplexityBot. These bots are separate from traditional search engine crawlers, and whether they can reach and understand your pages affects how often your business appears in AI answers. Watching AI bot activity on your site shows which AI tools are paying attention to your content.

 

Categorized in: Definitions