Resources > Crawlers list > WebCrawler

logo WebCrawler

ID: 70955
ProducerUnknown Author
Other robots of the same producer1M7bot, AAABot, AccompanyBot, AdBot, AdsrvrBot, AdsTxtCrawler, AnyBot, aranhabot, Aream Crawler, AteniumBot, badbot, BananaBot, bbot, BorneoBot, brands-bot, brands-bot-logo, centurybot9, CF-UC User Agent, chimebot, clark-crawler, CLcrawler, CrawlBot, dark_NeXus_Qbot, DAutoBot, DaveCrawler, DF Bot, Dmbot, DownloaderChrome, Elisabot, Fake bot, Fuze_Bot, GoodBot, Grover, gschaid bot, Headless Chrome, Info bot, KauaiBot, KauaiSlowBot, LanaiBot, MauiBot, Monibot, MyBot, nbertaupete95, newspaper, Nicecrawler, NiueBot, OgScrper, Orbbot, p40Bot, PleskBot, polaris botnet, Rely Bot, ScamadviserExternalHit, sc_bot, SEBot-WA, seolyt, seoscanners.net bot, Snap URL Preview Service, spider, Spider_Bot, Storm-crawler, TestBot, The Knowledge AI, ThinkChaos, TinyBotTestUA, TinyTestBot, TMM Crawler, TprAdsTxtCrawler, TrendsmapResolver, Web Crawler, WebBot, XTC BOTNET, YFF35, YunSecurityBot
Bot URL
StatusActive Active

Known variants

WebCrawler/1.0

UseragentstringMozilla/5.0 (compatible; WebCrawler/1.0)
CategoryWeb scraper
First seen2019-10-09 15:28:09
Last seen2019-11-25 14:49:30
IP addresses2
Walk from
34.204.190.85ec2-34-204-190-85.compute-1.amazonaws.comUS
35.170.76.74ec2-35-170-76-74.compute-1.amazonaws.comUS
 
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.