# robots.txt for moltenrock.com
#
# Cloudflare prepends its own "content-signals" policy ABOVE this block:
#   Content-Signal: search=yes, ai-train=no, use=reference
# i.e. it lets search/citation crawlers in (so AI answer engines can cite us)
# and blocks AI-*training* crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot,
# Bytespider, Amazonbot, meta-externalagent, ...).
#
# We keep OUR block minimal so it never contradicts that policy: allow everything
# by default (the citation crawlers we care about are not blocked) and point to
# the sitemap. To ALSO permit AI training, change the Cloudflare content-signal
# to ai-train=yes — do NOT re-add per-bot Allow lines here (that just creates a
# contradicting robots.txt).

User-agent: *
Allow: /

Sitemap: https://moltenrock.com/sitemap.xml