# The use of robots or other automated means to access this site # without the express permission is strictly prohibited. # Contact us User-agent: * Disallow: /*&p=* Disallow: /*?p=* Disallow: /p/delete Disallow: /p/manage Disallow: /p/rurl Disallow: /api/* Disallow: /serviceworker.js* Disallow: /*/wp-* Disallow: /wp-* ### Robots not useful User-agent: 360Spider Disallow: / User-agent: Amazonbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: anthropic-ai Allow: /$ Allow: /help Disallow: / User-agent: Applebot Disallow: / User-agent: AwarioBot Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: Baiduspider Disallow: / # https://babbar.tech/crawler User-agent: barkrowler Disallow: / # Bytedance User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: Claude-Web Allow: /$ Allow: /help Disallow: / User-agent: ClaudeBot Allow: /$ Allow: /help Disallow: / User-agent: coccocbot-image Disallow: / User-agent: coccocbot-web Disallow: / User-agent: dotbot Disallow: / # Facebook parse a lot of pages. IA training ? User-agent: facebookexternalhit Disallow: / User-agent: GPTBot Allow: /$ Allow: /help Disallow: / User-agent: IonCrawl Disallow: / User-Agent: ImagesiftBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: Omgili Disallow: / User-agent: Omgilibot Disallow: / User-Agent: panscient.com Disallow: / User-agent: PetalBot Disallow: / User-agent: SeekportBot Disallow: / User-agent: semrushbot Disallow: / User-agent: Sogou Disallow: / User-agent: Sogou inst spider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-Agent: WellKnownBot Disallow: / User-agent: Yandex Disallow: / User-agent: Yisouspider Disallow: / User-agent: Zoominfobot Disallow: /