User-agent: * Disallow: /-sys-/ Disallow: /~sys~/ Disallow: /%7esys%7e/ Disallow: /nb/ Disallow: /awl/ Disallow: /forum/nb/ Disallow: /news/nb/ Disallow: /articles/nb/ Disallow: /video/nb/ User-agent: GoogleOther Disallow: / User-agent: meta-externalagent Disallow: / User-agent: GPTBot Disallow: / User-agent: Owler Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: dotbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: barkrowler Disallow: / User-agent: SiteCheckerBotCrawler Disallow: / User-agent: FemtosearchBot Disallow: / User-agent: ImagesiftBot Disallow: /