Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo Monibot2020-05-27 11:24:43
logo BorneoBot2020-05-27 07:23:54
logo polaris botnet2020-05-27 02:18:19
logo Fake bot2020-05-27 01:47:52
logo dark_NeXus_Qbot2020-05-27 00:01:04
logo bot2020-05-26 23:23:38
logo The Knowledge AI2020-05-26 22:30:48
logo MauiBot2020-05-26 11:50:09
logo Scrapy2020-05-26 09:37:58UPUP
logo DownloaderChrome2020-05-26 08:49:13
logo spider2020-05-26 05:34:20
logo Diffbot2020-05-25 15:40:10UPUP
logo TrendsmapResolver2020-05-25 15:38:17
logo centurybot92020-05-25 10:21:46
logo DF Bot2020-05-23 21:05:16
logo XTC BOTNET2020-05-16 03:32:00
logo MetaInspector2020-05-12 11:35:05UPUP
logo Splash2020-05-10 06:48:49UPUP
logo YFF352020-04-30 09:57:55
logo TMM Crawler2020-03-27 23:45:04
logo aylienbot2020-03-01 10:42:29DownUP
logo nbertaupete952020-02-25 21:56:17
logo SemanticJuice crawler2020-01-21 22:33:59UPUP
logo bbot2020-01-11 06:11:09
logo brands-bot-logo2020-01-08 07:31:44
logo brands-bot2020-01-06 23:57:31
logo WebBot2019-11-25 14:49:31
logo WebCrawler2019-11-25 14:49:30
logo Fuze_Bot2019-11-12 16:04:52
logo AdBot2019-11-10 14:25:36
logo OgScrper2019-10-31 16:32:37
logo AdsrvrBot2019-10-28 08:30:19
logo CLcrawler2019-10-12 04:10:48
logo PleskBot2019-08-29 09:05:20
logo arachnode.net2019-08-11 09:00:54UPUP
logo DaveCrawler2019-07-07 11:25:07

Maybe inactive robots (One year we have not heard about them)
logo Frontera2019-05-23 13:42:37UPUP
logo crawler2019-05-07 17:52:28UP
logo Mixnode2018-08-20 01:06:54UP
logo 0082018-08-14 06:14:32DownUP
logo Contacts Crawler2018-06-28 00:35:28UP
logo Quick-Crawler2018-06-08 07:47:17UP
logo voltron2018-04-01 12:07:39DownUP
logo MailDBBot2017-04-06 20:08:19DownUP
logo scrapy-redis2017-03-06 12:58:15UP
logo Crawlera2016-02-08 16:08:25UP
logo import.io2016-02-03 18:34:09UP

Historical (Old robots, Inactive cravlers)
logo Saleslift2017-12-23 05:57:41Down
logo Profound scrapyproject2017-01-05 14:39:19UPUP
logo Spinn3r2015-12-16 04:26:23DownDown
logo KimonoLabs2015-06-22 04:28:40UP
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.