Home / Free tools

Free llms.txt generator

Fill in a few fields, get a valid llms.txt ready to upload to your site root. It tells ChatGPT, Claude, Perplexity and other AI models exactly who you are and which pages matter. What is llms.txt? →

1 · Describe your site

Upload the file to your web root so it's reachable at https://yourdomain.com/llms.txt. For deep coverage, also publish an expanded llms-full.txt — our guide shows how.

2 · Welcome the AI crawlers

If your robots.txt blocks AI bots (many CDN presets do), no amount of content will get you cited. Append this snippet to allow every major AI crawler — see the full crawler list for what each one does.

# --- AI crawlers: welcome (added by upgeo.ai) ---
User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-User
Allow: /

User-agent: anthropic-ai
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Perplexity-User
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: GoogleOther
Allow: /

User-agent: Applebot-Extended
Allow: /

User-agent: Amazonbot
Allow: /

User-agent: cohere-ai
Allow: /

User-agent: meta-externalagent
Allow: /

User-agent: Bytespider
Allow: /
# --- end AI crawlers ---

Paste at the end of your existing robots.txt. Keeping a final User-agent: * block unchanged preserves your rules for normal search engines.

3 · Want the whole pipeline handled?

llms.txt and crawler access are step one. UpGeo also deploys structured data, publishes quotable content daily on autopilot, submits every page to Google/Bing/Baidu instantly, and tracks which AI bots read you.