Resources > UA list: crawlers

Udger database includes detailed information about ever single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo Scrapy2018-11-19 12:06:28UPUP
logo arachnode.net2018-09-26 08:11:14UPUP
logo Mixnode2018-08-20 01:06:54UP
logo 0082018-08-14 06:14:32DownUP
logo Contacts Crawler2018-06-28 00:35:28UP
logo Quick-Crawler2018-06-08 07:47:17UP
logo Pu_iN2018-05-25 21:26:19UPUP
logo Diffbot2018-04-26 08:22:37UP
logo voltron2018-04-01 12:07:39DownUP
logo aylienbot2018-01-29 08:28:49DownUP

Maybe inactive robots (One year we have not heard about them)
logo MailDBBot2017-04-06 20:08:19DownUP
logo scrapy-redis2017-03-06 12:58:15UP
logo Profound scrapyproject2017-01-05 14:39:19UPUP
logo Crawlera2016-02-08 16:08:25UP
logo import.io2016-02-03 18:34:09UP

Historical (Old robots, Inactive cravlers)
logo Saleslift2017-12-23 05:57:41Down
logo Spinn3r2015-12-16 04:26:23DownDown
logo KimonoLabs2015-06-22 04:28:40UP
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.