Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 538,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 30 records of 231,736 total
Last seenCrawlerIP addressIP nameDC Country
2019-12-17 14:33:46logo Anturis Agent5.79.100.165?NL
2019-12-17 14:33:46logo Testomatobot45.32.199.43?US
2019-12-17 14:33:28logo AdminLabs94.237.29.23494-237-29-234.de-fra1.upcloud.hostDE
2019-12-17 14:33:22logo Freshworks bot52.42.49.200ec2-52-42-49-200.us-west-2.compute.amazonaws.comUS
2019-12-17 14:33:07logo agentslug3.82.64.188ec2-3-82-64-188.compute-1.amazonaws.com US
2019-12-17 14:33:07logo Nodemeter188.166.215.12as-si2.nodes.nodemeter.netSG
2019-12-17 14:32:57logo Anturis Agent185.135.157.53?FR
2019-12-17 14:32:54logo Online Domain Tools216.158.234.82mail2.email-verifier-online-domain-tools.comUS
2019-12-17 14:32:15logo Uptimia176.126.84.140?SE
2019-12-17 14:32:06logo Nodemeter178.62.23.58eu-en.nodes.nodemeter.netGB
2019-12-17 14:31:57logo downnotifier.com monitoring104.236.216.73110.e-active.nlUS
2019-12-17 14:30:58logo cron-job.org195.201.26.157cron-job.orgDE
2019-12-17 14:30:08logo Nodemeter107.170.248.133us-sf.nodes.nodemeter.netUS
2019-12-17 14:30:03logo Hlidam.to robot95.168.209.93tik02.vas-server.czCZ
2019-12-17 14:29:54logo Online Domain Tools37.187.55.111mail.odt-six.comFR
2019-12-17 14:29:08logo Uptimebot168.235.79.24uptime-lax22-ramnode.uptime.comUS
2019-12-17 14:28:36logo SeznamBot77.75.73.26fulltextrobot-test-77-75-73-26.seznam.czCZ
2019-12-17 14:28:34logo WebGazer78.47.204.123?DE
2019-12-17 14:26:54logo Online Domain Tools142.4.203.217mail.email-verifier-online-domain-tools.comCA
2019-12-17 14:26:32logo SEMrushBot46.229.168.133crawl5.bl.semrush.comUS
2019-12-17 14:24:41logo Qwantify91.242.162.3?FR
2019-12-17 14:23:54logo Online Domain Tools151.80.129.116mail3.email-verifier-online-domain-tools.comFR
2019-12-17 14:23:34logo WebGazer88.99.84.6?DE
2019-12-17 14:22:00logo downnotifier.com monitoring37.97.137.40monitoring-ams.downnotifier.comNL
2019-12-17 14:21:37logo sogou spider106.38.241.191sogouspider-106-38-241-191.crawl.sogou.comCN
2019-12-17 14:20:54logo Online Domain Tools51.255.37.129mail.odt-sn.comFR
2019-12-17 14:18:14logo SEMrushBot46.229.168.149crawl21.bl.semrush.comUS
2019-12-17 14:17:54logo Online Domain Tools130.193.12.185mail.online-domain-tools.comCZ
2019-12-17 14:17:50logo SEMrushBot46.229.168.139crawl11.bl.semrush.comUS
2019-12-17 14:16:39logo sogou spider111.202.101.135sogouspider-111-202-101-135.crawl.sogou.com CN

 
.. and more .. (All IP Addresses available to users with subscription. ... Learn More)
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.