Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 525,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 233,139 total
Last seenCrawlerIP addressIP nameDC Country
2020-01-25 14:22:02logo Anturis Agent185.135.157.53?FR
2020-01-25 14:22:02logo CCBot34.229.131.116ec2-34-229-131-116.compute-1.amazonaws.comUS
2020-01-25 14:21:51logo AdminLabs94.237.29.23494-237-29-234.de-fra1.upcloud.hostDE
2020-01-25 14:21:12logo Anturis Agent5.79.100.165?NL
2020-01-25 14:21:08logo MJ12bot162.210.196.98hosted-by.leaseweb.comUS
2020-01-25 14:21:06logo Nodemeter107.170.248.133us-sf.nodes.nodemeter.netUS
2020-01-25 14:21:02logo Uptimebot157.245.87.235new16.uptime.comUS
2020-01-25 14:20:49logo Online Domain Tools142.4.203.217mail.email-verifier-online-domain-tools.comCA
2020-01-25 14:19:09logo Nodemeter178.62.23.58eu-en.nodes.nodemeter.netGB
2020-01-25 14:18:53logo AhrefsBot54.36.149.23ip-54-36-149-23.a.ahrefs.comFR
2020-01-25 14:18:37logo Freshworks bot52.42.49.200ec2-52-42-49-200.us-west-2.compute.amazonaws.comUS
2020-01-25 14:17:49logo Online Domain Tools130.193.12.185mail.online-domain-tools.comCZ
2020-01-25 14:17:06logo SEMrushBot46.229.168.129crawl1.bl.semrush.comUS
2020-01-25 14:16:48logo Uptimebot168.235.94.185uptime-lax21-ramnode.uptime.comUS
2020-01-25 14:15:57logo montastic-monitor13.57.204.165ec2-13-57-204-165.us-west-1.compute.amazonaws.comUS
2020-01-25 14:15:56logo downnotifier.com monitoring139.59.109.12monitoring-sgp.downnotifier.comSG
2020-01-25 14:15:41logo WebGazer95.216.162.150?FI
2020-01-25 14:15:04logo GotSiteMonitor54.243.132.119ec2-54-243-132-119.compute-1.amazonaws.comUS
2020-01-25 14:15:00logo GotSiteMonitor54.232.96.90ec2-54-232-96-90.sa-east-1.compute.amazonaws.comBR
2020-01-25 14:14:49logo Online Domain Tools185.183.98.178c3.online-domain-tools.comNL
2020-01-25 14:14:48logo Protopage142.4.217.113virt9.protopage.comCA
2020-01-25 14:13:35logo Mail.Ru bot95.163.255.194fetcher16-45.go.mail.ruRU
2020-01-25 14:12:50logo montastic-monitor52.53.213.182ec2-52-53-213-182.us-west-1.compute.amazonaws.comUS
2020-01-25 14:12:36logo Feedpresso crawler34.90.243.119?US
2020-01-25 14:11:50logo Online Domain Tools151.80.129.116mail3.email-verifier-online-domain-tools.comFR
2020-01-25 14:10:41logo WebGazer116.202.105.128?DE
2020-01-25 14:10:24logo MonTools.Com107.191.48.232107.191.48.232.vultr.comUS
2020-01-25 14:10:02logo SEMrushBot46.229.168.130crawl2.bl.semrush.comUS
2020-01-25 14:09:10logo SeznamBot77.75.79.109fulltextrobot-77-75-79-109.seznam.czCZ
2020-01-25 14:08:49logo Online Domain Tools216.158.234.82mail2.email-verifier-online-domain-tools.comUS

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.