# Mestanova.cz: a directory of places in Czech cities. Every crawler is welcome on the public # pages; the rules below keep them out of accounts, forms, the language switch and the search # boxes' own answers. "Allow: /" closes each group, so a parser that takes the first matching # rule reads it as a longest-match one does. What the site is and how it is organised: https://mestanova.cz/llms.txt User-agent: * Disallow: /admin Disallow: /cs/account Disallow: /en/account Disallow: /cs/*/go/ Disallow: /en/*/go/ # Language switch: sets a cookie and redirects to the page's other-language URL, which the # hreflang alternates already name. Disallow: /set-locale/ # Forms, the search pages' results and the search boxes' JSON: noindex pages, nothing to rank. Disallow: /cs/*/request$ Disallow: /cs/*/request? Disallow: /en/*/request$ Disallow: /en/*/request? Disallow: /cs/*/claim$ Disallow: /en/*/claim$ Disallow: /cs/*/search? Disallow: /en/*/search? Disallow: /cs/*/search/suggest Disallow: /en/*/search/suggest Disallow: /cs/search? Disallow: /en/search? Disallow: /cs/search/suggest Disallow: /en/search/suggest Allow: / # The content may be searched, quoted by assistants and learned from (Cloudflare's content signals). Content-Signal: search=yes, ai-input=yes, ai-train=yes # AI crawlers and assistants, named, on the same terms: the directory is meant to be found and # quoted, with a link back. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot User-agent: Applebot-Extended User-agent: Amazonbot User-agent: meta-externalagent User-agent: meta-externalfetcher User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: CCBot Disallow: /admin Disallow: /cs/account Disallow: /en/account Disallow: /cs/*/go/ Disallow: /en/*/go/ Disallow: /set-locale/ Disallow: /cs/*/request$ Disallow: /cs/*/request? Disallow: /en/*/request$ Disallow: /en/*/request? Disallow: /cs/*/claim$ Disallow: /en/*/claim$ Disallow: /cs/*/search? Disallow: /en/*/search? Disallow: /cs/*/search/suggest Disallow: /en/*/search/suggest Disallow: /cs/search? Disallow: /en/search? Disallow: /cs/search/suggest Disallow: /en/search/suggest Allow: / Sitemap: https://mestanova.cz/sitemap.xml