Resources > Crawlers list > WebCrawler

logo WebCrawler

ID: 70955
ProducerUnknown Author
Other robots of the same producerAdsrvrBot, centurybot9, CLcrawler, DaveCrawler, DF Bot, DownloaderChrome, Fake bot, Fuze_Bot, MauiBot, Monibot, nbertaupete95, PleskBot, seoscanners.net bot, The Knowledge AI, TMM Crawler, WebBot, YFF35
Bot URL
StatusActive Active

Known variants

WebCrawler/1.0

UseragentstringMozilla/5.0 (compatible; WebCrawler/1.0)
CategoryWeb scraper
First seen2019-10-09 15:28:09
Last seen2019-11-25 14:49:30
IP addresses2
Walk from
34.204.190.85ec2-34-204-190-85.compute-1.amazonaws.comUS
35.170.76.74ec2-35-170-76-74.compute-1.amazonaws.comUS
 
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.