AdsTxtCrawler AdsTxtCrawler is a bot, but at the moment it is not known who develops it. Latest user agents:AdsTxtCrawler/1.0.2AdsTxtCrawler/1.0; +https://github.com/InteractiveAdvertisingBureau/adstxtcrawler