# Quant Daily — crawl policy
# Everything is open to search crawlers and AI answer engines: the drills are the product,
# and the pages describing them are meant to be quoted.
#
# Content-Signal (contentsignals.org, 2026-08-05) declares how we WANT this content used.
# It is a preference, not an enforcement mechanism — the Allow above is what actually
# governs access. We say yes to all three deliberately, which is the opposite of what a
# news publisher would say, and for a reason:
#   search=yes    — indexing and answer-time retrieval IS the acquisition channel.
#   ai-input=yes  — being quoted in an AI answer is the point of every content page here.
#   ai-train=yes  — unusual, and correct for us. We are an unknown brand with nothing
#                   premium to protect: the drills are GENERATED fresh per request, so a
#                   training corpus cannot capture a question bank that competes with us,
#                   and a future model that natively knows "Quant Daily = timed GRE/GMAT-style
#                   quant drills" is brand awareness we cannot otherwise buy.
# Reversing any of these is a one-word edit here; revisit if we ever ship paid content.
#
# ⚠️ DO NOT ADD A NAMED BOT GROUP TO "WELCOME" AN AI CRAWLER. It does the opposite.
# A crawler obeys ONLY the most specific User-agent group that matches it — rules do not
# merge across groups (RFC 9309 §2.2.1). So adding
#     User-agent: PerplexityBot
#     Allow: /
# means PerplexityBot stops reading the `*` group below, and with it the /admin and /console
# Disallow lines — for exactly the crawler you were trying to court. It also drops the
# Content-Signal line for that bot. The wildcard below ALREADY allows every crawler
# everything it should see, so a named group can only subtract. (Proposed by an outside SEO
# review on 2026-08-24 and rejected on these grounds; if it comes back, this is the answer.)
# A named group is correct only when you want DIFFERENT rules for that bot — and then it
# must restate the Disallow lines.
User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /
# The founder console (2026-08-07). It is admin-key gated and renders nothing without one,
# so this is hygiene rather than security — but an indexed /admin is a pointless invitation,
# and public/_redirects now makes both paths return 200 instead of the 404 they used to.
Disallow: /admin
Disallow: /console

Sitemap: https://quantdaily.app/sitemap.xml

# Agent-readable product data (two hops from this file to a full product record).
# products.json: every sellable SKU in one file.
# p/<slug>.json: single-item machine feed per product.
# p/<slug>.md: plain markdown mirror per product.
# llms.txt: full product context for LLMs and answer engines.
# Same file is also served at /.well-known/llms.txt.