Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo deadlinkchecker2019-03-08 11:04:46UP
logo BrokenLinkCheck.com2019-03-08 11:04:14UP
logo UASlinkChecker2019-03-04 12:45:59UPUP
logo Online Domain Tools2019-03-03 07:43:44UP
logo LinkTiger2019-02-26 07:24:01UP
logo MB-SiteCrawler2019-02-10 07:36:34UPUP
logo Dead Link Checker2019-02-07 09:37:34UPUP
logo Licorne crawler2019-02-01 01:38:51UP
logo bot2019-01-11 08:15:38UP
logo Geek-Tools2019-01-02 08:32:17UP
logo 2bone2019-01-02 08:30:56UP
logo backlink-check.de2019-01-02 08:27:52UPUP
logo Link Valet Online2018-11-21 05:34:32UP
logo topster_de-crawler2018-06-13 14:22:06UP
logo LinkAlarm2018-04-19 13:17:35UPUP

Maybe inactive robots (One year we have not heard about them)
logo damn404 crawler2018-01-11 14:59:54UPUP
logo 2Bone2017-10-23 12:20:53UP
logo outbrain2017-04-11 21:54:21UPUP
logo GiftBot2017-02-14 08:13:11UPUP
logo dlcbot2015-04-22 09:04:27UP

Historical (Old robots, Inactive cravlers)
logo ODP link checker2019-01-15 02:38:36UPUP
logo AWeber bot2011-09-30 00:21:09UPUP
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.