Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 660,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 334,727 total
Last seenCrawlerIP addressIP nameDC Country
2021-04-14 14:55:13logo HetrixTools crawler45.32.204.172wk7-1.hetrixtools.comUS
2021-04-14 14:55:13logo HetrixTools crawler51.195.46.219wk5-3.hetrixtools.comFR
2021-04-14 14:55:13logo HetrixTools crawler52.67.204.189wk9.hetrixtools.comBR
2021-04-14 14:55:03logo agentslug54.253.132.128ec2-54-253-132-128.ap-southeast-2.compute.amazonaws.com 
2021-04-14 14:55:03logo GotSiteMonitor54.246.107.43ec2-54-246-107-43.eu-west-1.compute.amazonaws.comIE
2021-04-14 14:55:03logo AhrefsBot54.36.148.172ip-54-36-148-172.a.ahrefs.comFR
2021-04-14 14:55:03logo Substack crawler54.210.84.140ec2-54-210-84-140.compute-1.amazonaws.comUS
2021-04-14 14:54:43logo Anturis Agent5.79.100.165?NL
2021-04-14 14:54:33logo agentslug3.25.140.187ec2-3-25-140-187.ap-southeast-2.compute.amazonaws.comUS
2021-04-14 14:54:19logo Google Cloud Monitoring35.199.126.168?US
2021-04-14 14:54:12logo HetrixTools crawler185.143.173.230wk12.hetrixtools.comRU
2021-04-14 14:54:12logo HetrixTools crawler94.16.112.18wk5-2.hetrixtools.comDE
2021-04-14 14:54:02logo agentslug35.182.92.173ec2-35-182-92-173.ca-central-1.compute.amazonaws.comCA
2021-04-14 14:54:02logo HetrixTools crawler35.199.108.206wk9-2.hetrixtools.comUS
2021-04-14 14:53:41logo Uptimebot159.65.224.115new13.uptime.comUS
2021-04-14 14:53:32logo CCBot3.235.41.241ec2-3-235-41-241.compute-1.amazonaws.comUS
2021-04-14 14:53:30logo agentslug13.233.179.18ec2-13-233-179-18.ap-south-1.compute.amazonaws.comIN
2021-04-14 14:53:20logo HetrixTools crawler23.227.169.50wk7-2.hetrixtools.comIT
2021-04-14 14:53:20logo HetrixTools crawler37.200.70.211wk12-3.hetrixtools.comRU
2021-04-14 14:52:25logo HetrixTools crawler104.237.139.48wk7.hetrixtools.comUS
2021-04-14 14:51:48logo SeznamBot77.75.73.26fulltextrobot-test-77-75-73-26.seznam.czCZ
2021-04-14 14:51:36logo HetrixTools crawler23.111.108.100wk12-2.hetrixtools.comRU
2021-04-14 14:51:30logo Uptimia209.222.21.25?US
2021-04-14 14:51:05logo webmonitoring.online159.65.64.238?US
2021-04-14 14:50:59logo Google Cloud Monitoring35.197.32.224?US
2021-04-14 14:50:23logo SiteUptime.com167.172.53.228node-do-lon1.siteuptime.comGB
2021-04-14 14:50:23logo Google Cloud Monitoring35.240.124.58?US
2021-04-14 14:50:15logo YandexBot5.255.231.1435-255-231-143.spider.yandex.comRU
2021-04-14 14:50:06logo Hlidam.to robot95.168.209.93tik02.vas-server.czCZ
2021-04-14 14:50:04logo HetrixTools crawler31.192.104.220wk12-1.hetrixtools.comRU

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.