Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 546,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 225,532 total
Last seenCrawlerIP addressIP nameDC Country
2019-11-22 20:48:46logo CCBot18.204.56.104ec2-18-204-56-104.compute-1.amazonaws.comUS
2019-11-22 20:48:33logo Testomatobot45.32.199.43?US
2019-11-22 20:48:18logo Freshworks bot52.42.49.200ec2-52-42-49-200.us-west-2.compute.amazonaws.comUS
2019-11-22 20:48:13logo Nodemeter188.166.215.12as-si2.nodes.nodemeter.netSG
2019-11-22 20:48:10logo Anturis Agent5.79.100.165?NL
2019-11-22 20:48:07logo AdminLabs94.237.29.23494-237-29-234.de-fra1.upcloud.hostDE
2019-11-22 20:47:53logo Anturis Agent185.135.157.53?FR
2019-11-22 20:47:52logo SEMrushBot46.229.168.153crawl25.bl.semrush.comUS
2019-11-22 20:47:50logo Online Domain Tools130.193.12.185mail.online-domain-tools.comCZ
2019-11-22 20:47:02logo bingbot157.55.39.31msnbot-157-55-39-31.search.msn.comUS
2019-11-22 20:46:36logo WebGazer116.202.105.128?DE
2019-11-22 20:46:25logo AhrefsBot54.36.150.167ip-54-36-150-167.a.ahrefs.comFR
2019-11-22 20:46:07logo Nodemeter178.62.23.58eu-en.nodes.nodemeter.netGB
2019-11-22 20:46:05logo DownloaderChrome54.245.69.11ec2-54-245-69-11.us-west-2.compute.amazonaws.com US
2019-11-22 20:45:48logo WEDOS OnLine monitoring89.221.219.62cz3.probe.wedos.onlineCZ
2019-11-22 20:45:31logo HappyApps crawler34.230.30.225ec2-34-230-30-225.compute-1.amazonaws.comUS
2019-11-22 20:45:26logo Uptimebot206.189.177.144?US
2019-11-22 20:45:22logo Monibot18.191.161.78ec2-18-191-161-78.us-east-2.compute.amazonaws.com US
2019-11-22 20:44:52logo Cula52.209.30.187ec2-52-209-30-187.eu-west-1.compute.amazonaws.comIE
2019-11-22 20:44:51logo Online Domain Tools185.183.98.178c3.online-domain-tools.comNL
2019-11-22 20:43:44logo updown.io bot45.76.104.117?JP
2019-11-22 20:43:22logo Uptimia206.189.135.60bangalore.uptimia.comIN
2019-11-22 20:42:48logo downnotifier.com monitoring149.28.73.26monitoring-lax.downnotifier.comUS
2019-11-22 20:41:58logo WebGazer116.203.81.203?DE
2019-11-22 20:41:51logo Online Domain Tools37.187.55.111mail.odt-six.comFR
2019-11-22 20:41:42logo WebGazer116.203.186.164?DE
2019-11-22 20:41:01logo SEMrushBot46.229.168.143crawl15.bl.semrush.comUS
2019-11-22 20:40:18logo DownloaderChrome34.211.29.149ec2-34-211-29-149.us-west-2.compute.amazonaws.com US
2019-11-22 20:40:18logo DownloaderChrome34.211.29.149ec2-34-211-29-149.us-west-2.compute.amazonaws.com US
2019-11-22 20:40:14logo SEMrushBot46.229.168.149crawl21.bl.semrush.comUS

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.