# SKYA — robots.txt
# Public marketing pages are open to crawlers; app surfaces below are blocked.
#
# ONE GROUP, ON PURPOSE. Do not add a "User-agent: Googlebot" block.
#
# This file used to carry eleven friendly "explicit allow" groups, one each
# for Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot and the rest, every
# one of them containing nothing but "Allow: /".
#
# A crawler obeys exactly ONE group: the most specific one that matches its
# name. So every one of those blocks told that crawler to ignore the
# "User-agent: *" group entirely, Disallow lines included. The named bots,
# which are the only ones that matter, were being invited to crawl /admin,
# /dashboard, /projects, /settings, /billing, /login, /share and /invite.
# The blocks were added to be welcoming and they switched the whole list off.
#
# Every crawler already matches "*", and "Allow: /" is the default, so the
# named groups bought nothing. If a specific bot ever needs different rules,
# it needs the FULL list repeated inside its own group, not just the
# difference.

User-agent: *
Allow: /
Allow: /llms.txt
Allow: /llms-full.txt
Disallow: /admin
Disallow: /dashboard
Disallow: /projects
Disallow: /agent-hub
Disallow: /onboarding
Disallow: /settings
Disallow: /billing
Disallow: /invite
Disallow: /share
Disallow: /portal
Disallow: /clientportal
Disallow: /auth
Disallow: /login
Disallow: /signup
Disallow: /unsubscribe
Disallow: /design-system
Disallow: /lovable
Disallow: /not-found
Disallow: /documentation

# AI answer engines are welcome on the public pages and are covered by the
# group above: GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot,
# Google-Extended, Bingbot and the social preview crawlers all match "*".
# The guides written for them:
#   https://skya.one/llms.txt
#   https://skya.one/llms-full.txt

Sitemap: https://skya.one/sitemap-index.xml
Sitemap: https://skya.one/sitemap.xml
Sitemap: https://skya.one/sitemap-blog.xml
Sitemap: https://skya.one/news-sitemap.xml