Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo Urlcheckr2021-09-19 08:46:43UPUP
logo UASlinkChecker2021-09-13 18:21:59UPUP
logo deadlinkchecker2021-09-08 20:20:43UP
logo Dead Link Checker2021-09-08 20:20:03UPUP
logo Wikipedia crawler2021-09-08 14:53:48UPUP
logo LinkTiger2021-09-08 05:36:20UP
logo Link Valet Online2021-08-04 05:41:41UP
logo Mailkit crawler2021-07-20 20:41:33UP
logo Atomseobot2021-07-05 06:59:31UPUP
logo Licorne crawler2021-07-01 06:15:12UP
logo BrokenLinkCheck.com2021-07-01 06:13:32UP
logo bot2021-05-25 08:06:02UP
logo MB-SiteCrawler2021-05-20 08:44:06UPUP
logo Online Domain Tools2021-03-04 05:26:36UP
logo backlink-check.de2021-03-04 05:25:05UPUP
logo outbrain2020-09-28 13:05:06UPUP

Maybe inactive robots (One year we have not heard about them)
logo LinkAlarm2020-08-09 13:17:41UPUP
logo PartyflockLinkChecker2019-11-03 03:38:33UPUP
logo Litmus crawler2019-04-12 12:45:36UP

Historical (Old robots, Inactive cravlers)
logo ODP link checker2021-02-20 17:34:40DownUP
logo Geek-Tools2019-07-07 08:32:21Down
logo 2bone2019-07-03 10:10:14UP
logo topster_de-crawler2018-06-13 14:22:06UP
logo damn404 crawler2018-01-11 14:59:54DownDown
logo 2Bone2017-10-23 12:20:53UP
logo dlcbot2015-04-22 09:04:27UPUP
logo AWeber bot2011-09-30 00:21:09UPUP
Among our clients
View more..., inc.  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.