Resources > IP list: web crawlers

Udger database includes categorized (udger detected/tested) IP addresses

More than 1,586,000 of categorized IP addresses

List type: Crawlers | Public proxies | Public cgi proxies | VPN services | Tor exit nodes | Fake crawlers | Web scrapers| Known attack source

"A Web crawler is an Internet bot which systematically browses the web."

showing first 10 records of 1,156,123 total
Last seenCrawlerIP addressIP nameDC Country
2026-10-20 05:03:16logo anthropic bot216.73.216.199?US
2026-10-20 05:02:24logo uptime.bot52.77.36.31ec2-52-77-36-31.ap-southeast-1.compute.amazonaws.comSG
2026-10-20 05:02:16logo uptime.bot52.47.146.163ec2-52-47-146-163.eu-west-3.compute.amazonaws.comFR
2026-10-20 05:02:14logo uptime.bot18.233.58.241ec2-18-233-58-241.compute-1.amazonaws.comUS
2026-10-20 05:01:57logo SEMrushBot85.208.98.553.ku.bot.semrush.comUS
2026-10-20 05:01:50logo diderot-bot77.114.79.107ec2-77-114-79-107.us-east-2.compute.amazonaws.comUS
2026-10-20 05:00:39logo WebGazer167.235.134.123?DE
2026-10-20 04:59:49logo SEMrushBot185.191.171.16crawl16.bl.semrush.comMD
2026-10-20 04:57:06logo Feedpresso crawler178.63.88.44?DE
2026-10-20 04:47:12logo linkfluence54.39.188.170?CA
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.