magpie-crawler magpie-crawler is a bot, but at the moment it is not known who develops it. Latest magpie-crawler versions:magpie-crawler 1.0Latest user agents:magpie-crawler/1.1 (robots-txt-checker; +http://www.brandwatch.net)magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)