User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /utils/ Disallow: /customers/ Disallow: /eshop/ Disallow: /webmail/ Disallow: /shoppe/admin/ Disallow: /phpsm/ sitemap: http://whitesindia.com/sitemapindex.xml User-agent: TwengaBot Disallow: / User-agent: Yandex Disallow: / User-agent: Yandex bot Disallow: / User-agent: almaden Disallow: / User-agent: ASPSeek Disallow: / User-agent: dumbBot Disallow: / User-agent: grub-client Disallow: / User-agent: MSIECrawler Disallow: / User-agent: NPBot Disallow: / User-agent: OWR_Crawler Disallow: / User-agent: psbot Disallow: / User-agent: RPT-HTTPClient Disallow: / User-agent: ScoutAbout Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Wget Disallow: / User-agent: wget Disallow: / User-agent: Cherry Picker Disallow: / User-agent: Crescent Internet ToolPak Disallow: / User-agent: DISCo Pump Disallow: / User-agent: Teleport Disallow: / User-agent: Telesoft Disallow: / User-agent: vspider Disallow: / User-agent: WebCopier Disallow: / User-agent: WebEMailExtractor Disallow: / User-agent: WebReaper Disallow: / User-agent: WebStripper Disallow: / User-agent: UbiCrawler Disallow: / User-agent: Zao Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebZIP Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-agent: k2spider Disallow: / User-agent: htdig Disallow: / User-agent: LNSpiderGuy Disallow: / User-agent: Netprospector Disallow: / User-agent: PerMan Surfer Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: YahooSeeker/CafeKelsa Disallow: / User-agent: BecomeBot* Disallow: / User-agent: ShopWiki Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: Ocelli* Disallow: / User-agent: stress-agent Disallow: / User-agent: e-SocietyRobot* Disallow: / User-agent: Accoona-AI-Agent Disallow: / User-agent: Accoona-Biz-Agent Disallow: / User-agent: AMZNKAssocBot Disallow: / User-agent: baiduspider Disallow: / User-agent: szukacz Disallow: /