Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 746,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 418,167 total
Last seenCrawlerIP addressIP nameDC Country
2021-11-29 20:56:27logo uptime.bot18.233.58.241ec2-18-233-58-241.compute-1.amazonaws.comUS
2021-11-29 20:56:05logo uptime.bot52.47.146.163ec2-52-47-146-163.eu-west-3.compute.amazonaws.comFR
2021-11-29 20:55:11logo agentslug13.211.142.167ec2-13-211-142-167.ap-southeast-2.compute.amazonaws.com AU
2021-11-29 20:55:11logo GotSiteMonitor52.60.85.69ec2-52-60-85-69.ca-central-1.compute.amazonaws.comUS
2021-11-29 20:55:11logo MxToolbox bot18.205.72.90keeper-us-east-1c.mxtoolbox.comUS
2021-11-29 20:54:54logo uptime.bot52.77.36.31ec2-52-77-36-31.ap-southeast-1.compute.amazonaws.comSG
2021-11-29 20:54:19logo Google Cloud Monitoring35.199.77.186?US
2021-11-29 20:54:11logo ByteDance crawler110.249.202.146? CN
2021-11-29 20:53:19logo PetalBot114.119.131.245petalbot-114-119-131-245.petalsearch.comCN
2021-11-29 20:52:17logo SiteUptime.com167.172.53.228node-do-lon1.siteuptime.comGB
2021-11-29 20:51:44logo WEDOS OnLine monitoring31.31.74.226cz1.probe.wedos.onlineCZ
2021-11-29 20:51:24logo Blogtrottr116.202.106.128qw45.blogtrottr.comDE
2021-11-29 20:51:24logo Uptimebot5.180.211.97uptime-lon15-clouvider.uptime.comGB
2021-11-29 20:50:59logo Google Cloud Monitoring35.197.32.224?US
2021-11-29 20:50:58logo SEMrushBot185.191.171.9crawl9.bl.semrush.comMD
2021-11-29 20:50:42logo CCBot34.207.247.69ec2-34-207-247-69.compute-1.amazonaws.com US
2021-11-29 20:50:24logo Google Cloud Monitoring35.187.114.193?US
2021-11-29 20:50:16logo WebGazer94.130.226.108?DE
2021-11-29 20:50:04logo WatchMouse150.107.148.136? ID
2021-11-29 20:49:53logo agentslug188.68.236.148n8236h148.sprintdatacenter.netPL
2021-11-29 20:48:58logo FreeWebMonitoring SiteChecker74.208.136.135freewebmonitoring.comUS
2021-11-29 20:47:33logo Google Cloud Monitoring35.239.194.85?US
2021-11-29 20:47:12logo SEMrushBot185.191.171.36crawl30.bl.semrush.comMD
2021-11-29 20:46:47logo Monibot54.151.65.95ec2-54-151-65-95.us-west-1.compute.amazonaws.com ?
2021-11-29 20:45:33logo Uptimebot185.209.179.215uptime-new21-maxihost.uptime.comUS
2021-11-29 20:45:21logo Substack crawler18.214.23.35ec2-18-214-23-35.compute-1.amazonaws.comUS
2021-11-29 20:45:06logo GotSiteMonitor54.243.132.119ec2-54-243-132-119.compute-1.amazonaws.comUS
2021-11-29 20:44:58logo GotSiteMonitor54.245.241.22ec2-54-245-241-22.us-west-2.compute.amazonaws.comUS
2021-11-29 20:44:43logo agentslug54.64.29.216ec2-54-64-29-216.ap-northeast-1.compute.amazonaws.comJP
2021-11-29 20:42:58logo MxToolbox bot52.55.244.91keeper-us-east-1b.mxtoolbox.comUS

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.