User-agent: Googlebot Disallow: /nogooglebot/ User-agent: * Allow: / User-agent: * Disallow: SemrushBot Disallow: PetalBot Disallow: AhrefsBot Disallow: Googlebot Disallow: DotBot Disallow: bingbot Disallow: applebot Disallow: MJ12bot Disallow: org_bot Disallow: DataForSeoBot Disallow: BLEXBot Disallow: YandexBot Sitemap: http://www.techtelegraph.co.uk/sitemap.xml User-agent: * Crawl-delay: 5