Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 498,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 240,674 total
Last seenCrawlerIP addressIP nameDC Country
2020-02-25 12:12:39logo AdminLabs94.237.29.23494-237-29-234.de-fra1.upcloud.hostDE
2020-02-25 12:12:33logo Anturis Agent185.135.157.53?FR
2020-02-25 12:12:16logo Nodemeter188.166.215.12as-si2.nodes.nodemeter.netSG
2020-02-25 12:12:07logo Nodemeter178.62.23.58eu-en.nodes.nodemeter.netGB
2020-02-25 12:12:01logo Anturis Agent5.79.100.165?NL
2020-02-25 12:11:41logo bingbot40.77.167.111msnbot-40-77-167-111.search.msn.comUS
2020-02-25 12:11:10logo CCBot3.218.67.1ec2-3-218-67-1.compute-1.amazonaws.comUS
2020-02-25 12:11:09logo Googlebot64.233.172.40google-proxy-64-233-172-40.google.comUS
2020-02-25 12:11:02logo CCBot34.204.191.0ec2-34-204-191-0.compute-1.amazonaws.comUS
2020-02-25 12:10:28logo gocrawl54.152.135.150ec2-54-152-135-150.compute-1.amazonaws.com US
2020-02-25 12:10:14logo Nodemeter107.170.248.133us-sf.nodes.nodemeter.netUS
2020-02-25 12:10:03logo bingbot157.55.39.21msnbot-157-55-39-21.search.msn.comUS
2020-02-25 12:10:00logo SEMrushBot46.229.168.137crawl9.bl.semrush.comUS
2020-02-25 12:09:30logo Freshworks bot52.42.49.200ec2-52-42-49-200.us-west-2.compute.amazonaws.comUS
2020-02-25 12:09:14logo Mail.Ru bot95.163.255.95fetcher10-4.go.mail.ruRU
2020-02-25 12:07:17logo AdminLabs94.237.8.4094-237-8-40.fi-hel2.upcloud.hostFI
2020-02-25 12:07:16logo downnotifier.com monitoring104.236.216.73110.e-active.nlUS
2020-02-25 12:07:13logo Uptimebot168.235.94.185uptime-lax21-ramnode.uptime.comUS
2020-02-25 12:06:43logo Uptimebot168.235.107.3uptime-lax24-ramnode.uptime.comUS
2020-02-25 12:06:30logo Uptimebot206.189.177.144?US
2020-02-25 12:05:06logo GotSiteMonitor54.243.132.119ec2-54-243-132-119.compute-1.amazonaws.comUS
2020-02-25 12:04:22logo WebGazer88.99.84.6?DE
2020-02-25 12:03:14logo SeeWithKids bot35.228.94.129?US
2020-02-25 12:02:45logo SEMrushBot46.229.168.136crawl8.bl.semrush.comUS
2020-02-25 12:02:25logo DotBot216.244.66.242?US
2020-02-25 12:02:20logo WordPress.com bots192.0.117.243?US
2020-02-25 12:01:19logo NIXStatsbot195.201.113.217?DE
2020-02-25 12:00:42logo bingbot13.66.139.1?US
2020-02-25 11:59:24logo WebGazer78.47.204.123?DE
2020-02-25 11:57:13logo downnotifier.com monitoring139.59.109.12monitoring-sgp.downnotifier.comSG

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.