Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo IABot2019-05-15 20:18:06UPUP
logo Urlcheckr2019-05-14 06:58:17UPUP
logo BrokenLinkCheck.com2019-05-14 06:57:07UP
logo deadlinkchecker2019-05-14 04:56:20UP
logo bot2019-05-09 04:54:53UP
logo 2bone2019-04-17 09:25:42UP
logo Link Valet Online2019-04-12 14:56:55UP
logo backlink-check.de2019-04-12 11:16:37UPUP
logo MB-SiteCrawler2019-04-09 07:52:13UPUP
logo Dead Link Checker2019-03-28 15:35:09UPUP
logo UASlinkChecker2019-03-04 12:45:59UPUP
logo Online Domain Tools2019-03-03 07:43:44UP
logo LinkTiger2019-02-26 07:24:01UP
logo Licorne crawler2019-02-01 01:38:51UP
logo Geek-Tools2019-01-02 08:32:17UP
logo topster_de-crawler2018-06-13 14:22:06UP

Maybe inactive robots (One year we have not heard about them)
logo LinkAlarm2018-04-19 13:17:35UPUP
logo damn404 crawler2018-01-11 14:59:54UPUP
logo 2Bone2017-10-23 12:20:53UP
logo outbrain2017-04-11 21:54:21UPUP
logo GiftBot2017-02-14 08:13:11UPUP
logo dlcbot2015-04-22 09:04:27UP

Historical (Old robots, Inactive cravlers)
logo ODP link checker2019-01-15 02:38:36UPUP
logo AWeber bot2011-09-30 00:21:09UPUP
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.