Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 731,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 406,278 total
Last seenCrawlerIP addressIP nameDC Country
2021-10-24 13:24:06logo uptime.bot52.47.146.163ec2-52-47-146-163.eu-west-3.compute.amazonaws.comFR
2021-10-24 13:23:40logo uptime.bot52.77.36.31ec2-52-77-36-31.ap-southeast-1.compute.amazonaws.comSG
2021-10-24 13:23:36logo agentslug3.24.214.4ec2-3-24-214-4.ap-southeast-2.compute.amazonaws.com AU
2021-10-24 13:23:20logo uptime.bot18.233.58.241ec2-18-233-58-241.compute-1.amazonaws.comUS
2021-10-24 13:23:06logo webmonitoring.online159.65.64.238?US
2021-10-24 13:21:38logo MxToolbox bot52.55.244.91keeper-us-east-1b.mxtoolbox.comUS
2021-10-24 13:21:16logo SEMrushBot185.191.171.44crawl38.bl.semrush.comMD
2021-10-24 13:21:00logo Google Cloud Monitoring35.185.252.44?US
2021-10-24 13:20:45logo CCBot3.214.224.207ec2-3-214-224-207.compute-1.amazonaws.comUS
2021-10-24 13:20:20logo Google Cloud Monitoring35.187.114.193?US
2021-10-24 13:20:03logo WatchMouse150.107.148.136? ID
2021-10-24 13:19:33logo Googlebot66.249.79.132crawl-66-249-79-132.googlebot.comUS
2021-10-24 13:19:32logo WEDOS OnLine monitoring89.221.217.205cz6.probe.wedos.onlineCZ
2021-10-24 13:18:23logo agentslug3.125.251.74ec2-3-125-251-74.eu-central-1.compute.amazonaws.comDE
2021-10-24 13:18:13logo SEMrushBot185.191.171.4crawl4.bl.semrush.comMD
2021-10-24 13:17:36logo Google Cloud Monitoring35.224.249.156?US
2021-10-24 13:17:18logo Uptimebot23.227.177.15423-227-177-154.static.hvvc.usUS
2021-10-24 13:15:33logo MJ12bot162.210.196.98hosted-by.leaseweb.comUS
2021-10-24 13:15:17logo WebGazer116.203.242.207?DE
2021-10-24 13:15:07logo GotSiteMonitor54.243.132.119ec2-54-243-132-119.compute-1.amazonaws.comUS
2021-10-24 13:14:57logo GotSiteMonitor54.246.107.43ec2-54-246-107-43.eu-west-1.compute.amazonaws.comIE
2021-10-24 13:14:43logo Uptimia94.177.238.121host121-238-177-94.static.arubacloud.frFR
2021-10-24 13:13:40logo Substack crawler3.238.139.88ec2-3-238-139-88.compute-1.amazonaws.comUS
2021-10-24 13:12:21logo Google Cloud Monitoring35.199.12.162?US
2021-10-24 13:12:08logo Google Cloud Monitoring35.198.248.66?SG
2021-10-24 13:11:10logo MJ12bot144.76.176.171?DE
2021-10-24 13:10:19logo SeznamBot77.75.78.163fulltextrobot-77-75-78-163.seznam.czCZ
2021-10-24 13:10:17logo WebGazer159.69.88.22?DE
2021-10-24 13:09:18logo Google Cloud Monitoring35.198.36.209?US
2021-10-24 13:09:10logo SEMrushBot185.191.171.40crawl34.bl.semrush.comMD

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.