Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo InternetMeasurement2024-05-20 21:20:33UP
logo GTmetrix2024-04-04 12:23:05UPUP
logo KeyCDN bot2024-02-19 07:20:16UPUP
logo bot2023-12-16 11:14:21UPUP
logo Pagespeed2023-08-14 19:08:50UPUP

Maybe inactive robots (One year we have not heard about them)
logo k6 crawler2023-01-04 06:23:58UP
logo Google Page Speed Insights2022-06-07 11:53:46UPUP
logo YellowLabTools2020-11-25 13:33:11UPUP
logo Neustar WPM2020-04-23 18:43:09UP

Historical (Old robots, Inactive cravlers)
logo LoadImpact2018-07-10 09:20:23DownUP
logo GomezAgent2017-06-15 22:54:17UP
Among our clients
View more..., inc.  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.