Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo BrokenLinkCheck.com2020-12-05 09:06:31UP
logo Siteimprove.com bot2020-12-04 09:28:37UP
logo backlink-check.de2020-11-30 13:45:04UPUP
logo MB-SiteCrawler2020-11-30 13:44:32UPUP
logo Online Domain Tools2020-11-30 13:43:31UP
logo Urlcheckr2020-11-18 11:09:43UPUP
logo Dead Link Checker2020-11-18 11:08:27UPUP
logo UASlinkChecker2020-11-18 03:21:54UPUP
logo Link Valet Online2020-10-18 16:53:15UP
logo Wikipedia crawler2020-10-05 04:37:49UPUP
logo deadlinkchecker2020-09-28 15:38:56UP
logo outbrain2020-09-28 13:05:06UPUP
logo LinkTiger2020-08-17 13:05:11UP
logo LinkAlarm2020-08-09 13:17:41UPUP
logo Atomseobot2020-07-02 16:25:46UPUP
logo Mailkit crawler2020-04-06 09:06:03UP

Maybe inactive robots (One year we have not heard about them)
logo PartyflockLinkChecker2019-11-03 03:38:33UPUP
logo Licorne crawler2019-08-05 05:19:52UP
logo Litmus crawler2019-04-12 12:45:36UP

Historical (Old robots, Inactive cravlers)
logo pmoz.info ODP link checker2020-12-26 00:06:55DownUP
logo Geek-Tools2019-07-07 08:32:21Down
logo 2bone2019-07-03 10:10:14UP
logo topster_de-crawler2018-06-13 14:22:06UP
logo damn404 crawler2018-01-11 14:59:54DownDown
logo 2Bone2017-10-23 12:20:53UP
logo dlcbot2015-04-22 09:04:27UPUP
logo AWeber bot2011-09-30 00:21:09UPUP
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.