# updated 26/11/15 by HBS. Sitemap: https://www.wired-gov.net/sitemap.xml Sitemap: https://www.wired-gov.net/news.xml User-agent: * Disallow: /dev/ User-agent: TurnitinBot User-agent: TweetmemeBot User-agent: Buck User-agent: LumtelBot User-agent: SEOkicks User-agent: VelenPublicWebCrawler User-agent: Diffbot User-agent: PagePeeker User-agent: ifiscraper User-agent: MegaIndex user-agent: Mediatoolkitbot User-agent: Pinterestbot User-agent: Pinterest User-agent: Cliqzbot User-agent: DotBot User-agent: Seekport Crawler User-agent: SerendeputyBot User-agent: Mappy User-agent: linkdexbot User-agent: trendictionbot User-agent: SeznamBot User-agent: MojeekBot User-agent: Gigabot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: trendictionbot User-agent: BLEXBot User-agent: MJ12bot User-agent: Yandex User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: SemrushBot-BA User-agent: SemrushBot-SI User-agent: SemrushBot-SWA User-agent: SemrushBot-CT User-agent: SemrushBot-BM User-agent: AhrefsBot User-agent: CompSpyBot User-agent: Curious George User-agent: CybEye.com User-agent: DoCoMo User-agent: daumoa User-agent: ExB Language Crawler User-agent: Ezooms User-agent: Flamingo_SearchEngine User-agent: gsa-crawler User-agent: grub-client User-agent: Genieo User-agent: Genio User-agent: LWNutch User-agent: LexxeBot User-agent: libcrawl User-agent: linkdex User-agent: magpie-crawler User-agent: NPBot User-agent: OpenWebIndex User-agent: QuerySeekerSpider User-agent: RediffNewsBot User-agent: SEOENGWorldBot User-agent: SEOkicks-Robot User-agent: Scanmine User-agent: Screaming Frog SEO Spider User-agent: ShopWiki User-agent: ShowyouBot User-agent: Sosospider User-agent: repparser User-agent: sindice-site-manager User-agent: sogou spider User-agent: sogou User-agent: Veoozbot User-agent: woriobot User-agent: WocBot User-agent: Yeti User-agent: YoudaoBot User-agent: yacybot User-agent: yolinkBot Disallow: / User-agent: Mediapartners-Google Disallow: