Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 687,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 356,797 total
Last seenCrawlerIP addressIP nameDC Country
2021-06-23 06:28:25logo uptime.bot52.77.36.31ec2-52-77-36-31.ap-southeast-1.compute.amazonaws.comSG
2021-06-23 06:28:23logo uptime.bot18.233.58.241ec2-18-233-58-241.compute-1.amazonaws.comUS
2021-06-23 06:28:22logo uptime.bot52.47.146.163ec2-52-47-146-163.eu-west-3.compute.amazonaws.comFR
2021-06-23 06:28:14logo Anturis Agent5.79.100.165?NL
2021-06-23 06:28:12logo downnotifier.com monitoring108.61.201.55monitoring-tyo.downnotifier.comJP
2021-06-23 06:27:34logo MJ12bot204.12.197.234modenewly.comUS
2021-06-23 06:27:22logo Google Cloud Monitoring35.221.55.249?US
2021-06-23 06:27:13logo Google Cloud Monitoring35.185.178.105?SG
2021-06-23 06:27:05logo webmonitoring.online159.65.64.238?US
2021-06-23 06:27:04logo CCBot3.236.124.77ec2-3-236-124-77.compute-1.amazonaws.com US
2021-06-23 06:26:07logo MojeekBot5.102.173.71crawl-5-102-173-71.mojeek.comGB
2021-06-23 06:25:48logo MxToolbox bot52.55.244.91keeper-us-east-1b.mxtoolbox.comUS
2021-06-23 06:25:19logo PetalBot114.119.152.235petalbot-114-119-152-235.petalsearch.comCN
2021-06-23 06:24:59logo GotSiteMonitor54.241.7.11ec2-54-241-7-11.us-west-1.compute.amazonaws.comUS
2021-06-23 06:24:55logo agentslug35.177.164.141ec2-35-177-164-141.eu-west-2.compute.amazonaws.com GB
2021-06-23 06:24:19logo Google Cloud Monitoring35.198.39.162?US
2021-06-23 06:22:45logo HappyApps crawler54.81.36.109ec2-54-81-36-109.compute-1.amazonaws.comUS
2021-06-23 06:22:38logo SEMrushBot85.208.98.27bot.semrush.comUS
2021-06-23 06:22:38logo FreeWebMonitoring SiteChecker74.208.136.135freewebmonitoring.comUS
2021-06-23 06:21:12logo SEMrushBot85.208.98.25bot.semrush.comUS
2021-06-23 06:20:59logo Google Cloud Monitoring35.185.252.44?US
2021-06-23 06:20:32logo WEDOS OnLine monitoring89.221.217.205cz6.probe.wedos.onlineCZ
2021-06-23 06:20:17logo Google Cloud Monitoring35.205.205.242?US
2021-06-23 06:20:03logo Hlidam.to robot95.168.209.93tik02.vas-server.czCZ
2021-06-23 06:19:49logo agentslug18.231.145.161ec2-18-231-145-161.sa-east-1.compute.amazonaws.com BR
2021-06-23 06:19:45logo Substack crawler107.20.82.146ec2-107-20-82-146.compute-1.amazonaws.comUS
2021-06-23 06:19:39logo WebGazer116.203.242.207?DE
2021-06-23 06:19:00logo MonTools.Com108.61.194.235108.61.194.235.vultr.comUS
2021-06-23 06:18:48logo SiteUptime.com167.172.53.228node-do-lon1.siteuptime.comGB
2021-06-23 06:18:11logo downnotifier.com monitoring206.189.127.129monitoring-lon.downnotifier.comGB

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.