# Multi - All4home robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # https://www.robotstxt.org/robotstxt.html Sitemap: https://all4home.com.gr/index.php?route=extension/feed/google_sitemap User-agent: * Disallow: /*?page=$ Disallow: /*&page=$ Disallow: /*?sort Disallow: /*&sort Disallow: /*?order= Disallow: /*&order= Disallow: /*?limit Disallow: /*&limit Disallow: /*?filter Disallow: /*&filter Disallow: /*?route=account/ Disallow: /*?route=affiliate/ Disallow: /*?route=checkout/ Disallow: /*?route=product/search Disallow: /*?route=checkout/cart Disallow: /admin Disallow: /account Disallow: /cart Disallow: /checkout Disallow: /login Disallow: /wishlist # Blocking bad link checker robots User-agent: AhrefsBot User-agent: Alexibot User-agent: SurveyBot User-agent: rogerbot User-agent: Exabot User-agent: 008 User-agent: BaiDuSpider User-agent: BecomeBot User-agent: CherryPicker User-agent: Cherry Picker User-agent: Control User-agent: Crescent Internet ToolPak User-agent: DISCo Pump User-agent: DOC User-agent: Download Ninja User-agent: EmailSiphon User-agent: Fetch User-agent: grub User-agent: grub-client User-agent: htdig User-agent: HTTrack User-agent: InternetSeer.com User-agent: k2spider User-agent: larbin User-agent: libwww User-agent: linko User-agent: LNSpiderGuy User-agent: Mail.Ru User-agent: MFC Foundation Class Library User-agent: Microsoft User-agent: Microsoft.URL.Control User-agent: MJ12bot User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT) User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95) User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 98) User-agent: MSIECrawler User-agent: Netprospector User-agent: NPBot User-agent: Offline Explorer User-agent: oodlebot/1.0 User-agent: PerMan Surfer User-agent: psbot User-agent: RPT-HTTPClient User-agent: SemrushBot User-agent: ShopWiki User-agent: sitecheck.internetseer.com User-agent: SiteSnagger User-agent: Sogou web spider User-agent: szukacz User-agent: Teleport User-agent: TeleportPro User-agent: Telesoft User-agent: Ultraseek User-agent: UbiCrawler User-agent: vspider User-agent: WebCopier User-agent: WebEMailExtractor User-agent: WebReaper User-agent: Webster Pro User-agent: WebStripper User-agent: WebZIP User-agent: wget User-agent: Xenu User-agent: Xenu’s User-agent: Xenu’s Link Sleuth 1.1c User-agent: XoviBot User-agent: yacybot User-agent: YodaoBot User-agent: Zao User-agent: Zealbot User-agent: ZyBORG User-agent: Sosospider User-agent: Ruby User-agent: sentibot Disallow: /