Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo Wikipedia crawler2019-09-21 07:32:50UPUP
logo Urlcheckr2019-09-08 11:29:22UPUP
logo MB-SiteCrawler2019-09-04 09:49:25UPUP
logo Mailkit crawler2019-08-30 13:49:03UP
logo Dead Link Checker2019-08-29 09:31:11UPUP
logo backlink-check.de2019-08-29 09:31:11UPUP
logo BrokenLinkCheck.com2019-08-29 09:31:11UP
logo deadlinkchecker2019-08-28 12:08:03UP
logo Licorne crawler2019-08-05 05:19:52UP
logo LinkAlarm2019-07-17 09:33:40UPUP
logo LinkTiger2019-07-11 17:17:10UP
logo Geek-Tools2019-07-07 08:32:21UP
logo 2bone2019-07-03 10:10:14UP
logo Online Domain Tools2019-06-20 08:10:40UP
logo Siteimprove.com bot2019-05-30 10:20:37UP
logo Link Valet Online2019-04-12 14:56:55UP
logo UASlinkChecker2019-03-04 12:45:59UPUP

Maybe inactive robots (One year we have not heard about them)
logo topster_de-crawler2018-06-13 14:22:06UP
logo damn404 crawler2018-01-11 14:59:54UPUP
logo 2Bone2017-10-23 12:20:53UP
logo outbrain2017-04-11 21:54:21UPUP
logo dlcbot2015-04-22 09:04:27UPUP

Historical (Old robots, Inactive cravlers)
logo pmoz.info ODP link checker2019-09-18 13:26:02UPUP
logo AWeber bot2011-09-30 00:21:09UPUP
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.