Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 755,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 395,482 total
Last seenCrawlerIP addressIP nameDC Country
2021-09-21 21:16:07logo uptime.bot18.233.58.241ec2-18-233-58-241.compute-1.amazonaws.comUS
2021-09-21 21:16:07logo uptime.bot52.47.146.163ec2-52-47-146-163.eu-west-3.compute.amazonaws.comFR
2021-09-21 21:16:01logo CCBot3.233.242.204ec2-3-233-242-204.compute-1.amazonaws.comUS
2021-09-21 21:15:45logo omgilibot82.166.33.7982-166-33-79.barak-online.net IL
2021-09-21 21:15:38logo uptime.bot52.77.36.31ec2-52-77-36-31.ap-southeast-1.compute.amazonaws.comSG
2021-09-21 21:15:28logo Anturis Agent67.225.148.163anturis.comUS
2021-09-21 21:15:00logo GotSiteMonitor54.246.107.43ec2-54-246-107-43.eu-west-1.compute.amazonaws.comIE
2021-09-21 21:14:47logo agentslug3.8.192.49ec2-3-8-192-49.eu-west-2.compute.amazonaws.com GB
2021-09-21 21:14:08logo webmonitoring.online159.65.64.238?US
2021-09-21 21:13:38logo MojeekBot5.102.173.71crawl-5-102-173-71.mojeek.comGB
2021-09-21 21:12:52logo MxToolbox bot52.55.244.91keeper-us-east-1b.mxtoolbox.comUS
2021-09-21 21:12:28logo Google Cloud Monitoring35.199.12.162?US
2021-09-21 21:12:10logo Google Cloud Monitoring35.198.224.104?US
2021-09-21 21:10:59logo Uptimebot23.227.177.15423-227-177-154.static.hvvc.usUS
2021-09-21 21:10:49logo AhrefsBot54.36.148.108ip-54-36-148-108.a.ahrefs.comFR
2021-09-21 21:10:07logo WebGazer78.47.204.123?DE
2021-09-21 21:10:04logo WatchMouse150.107.148.136? ID
2021-09-21 21:09:59logo FreeWebMonitoring SiteChecker74.208.136.135freewebmonitoring.comUS
2021-09-21 21:09:44logo agentslug13.36.230.131ec2-13-36-230-131.eu-west-3.compute.amazonaws.com FR
2021-09-21 21:09:33logo Google Cloud Monitoring35.199.90.14?US
2021-09-21 21:06:40logo Uptimebot159.65.224.115new13.uptime.comUS
2021-09-21 21:06:11logo Google Cloud Monitoring35.185.252.44?US
2021-09-21 21:05:20logo Google Cloud Monitoring35.205.205.242?US
2021-09-21 21:05:06logo GotSiteMonitor54.243.132.119ec2-54-243-132-119.compute-1.amazonaws.comUS
2021-09-21 21:04:57logo GotSiteMonitor52.60.85.69ec2-52-60-85-69.ca-central-1.compute.amazonaws.comUS
2021-09-21 21:04:34logo SiteUptime.com167.172.53.228node-do-lon1.siteuptime.comGB
2021-09-21 21:04:28logo PetalBot114.119.134.216petalbot-114-119-134-216.petalsearch.comCN
2021-09-21 21:03:25logo WebGazer116.203.242.207?DE
2021-09-21 21:03:00logo SEMrushBot85.208.98.27bot.semrush.comUS
2021-09-21 21:02:33logo Google Cloud Monitoring104.197.30.241?US

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.