Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo Monibot2022-10-02 15:57:20
logo Headless Chrome2022-10-02 13:02:50
logo centurybot92022-10-02 07:38:15
logo Fake bot2022-10-02 07:00:03
logo Spider2022-10-02 05:36:05
logo MauiBot2022-10-02 03:26:39
logo DF Bot2022-10-01 22:37:32
logo AdsTxtCrawlerTP2022-10-01 09:12:56
logo Diffbot2022-10-01 05:53:16UPUP
logo BitSightBot2022-10-01 05:45:06
logo TMM Crawler2022-09-30 19:20:18
logo nbertaupete952022-09-29 06:27:02
logo AdsTxtCrawler2022-09-28 16:49:58
logo Scrapy2022-09-28 14:45:43UPUP
logo AccompanyBot2022-09-27 07:15:46
logo ViberBot2022-09-25 15:04:00
logo Orbbot2022-09-22 12:43:49
logo loli_spider2022-09-22 07:48:34
logo The Knowledge AI2022-09-21 22:39:08
logo ScamadviserExternalHit2022-09-20 16:49:45
logo WhatStuffWhereBot2022-09-20 16:19:36
logo Splash2022-09-20 06:39:20UPUP
logo seolyt2022-09-19 05:29:07
logo seoscanners.net bot2022-09-17 03:58:54
logo DnBCrawler2022-09-16 12:26:20
logo Storm-crawler2022-09-15 12:22:22
logo newspaper2022-09-12 13:38:16
logo Dmbot2022-09-08 10:19:47
logo TprAdsTxtCrawler2022-09-01 11:33:03
logo Bot2022-08-30 07:44:00
logo polite-crawler2022-08-30 01:03:44
logo web-crawler2022-08-24 06:24:14
logo RW_Crawler2022-08-17 15:40:04
logo Nicecrawler2022-08-03 06:39:24UP
logo My Nutch Spider2022-07-28 19:11:23
logo MetaInspector2022-07-21 15:18:14UPUP
logo ThinkChaos2022-07-16 13:33:33
logo Elisabot2022-05-24 01:58:46
logo sempi.tech bot2022-05-02 18:29:40UP
logo sc_bot2022-05-01 19:27:36
logo DownloaderChrome2022-04-06 23:21:23
logo ResearchBot2022-04-05 09:20:40
logo badbot2022-03-25 08:35:39
logo DAutoBot2022-03-24 11:08:31
logo Unknown bot2022-03-17 16:25:18
logo SEBot-WA2022-02-28 18:05:21
logo jurgendata2022-02-24 10:44:12Down
logo TrendsmapResolver2022-02-18 11:18:14
logo Crawlbot2022-01-11 11:17:47
logo p40Bot2022-01-11 07:42:22
logo PopScreen Bot2021-12-31 04:43:54
logo YFF352021-12-27 08:38:37
logo Grover2021-12-24 20:28:14
logo clark-crawler2021-12-01 21:25:51
logo FlfBaldrBot2021-12-01 14:21:32
logo SemanticJuice crawler2021-11-30 19:33:28UPUP
logo polaris botnet2021-11-24 16:20:15

Maybe inactive robots (One year we have not heard about them)
logo tes-cocrawler2021-09-24 00:16:09
logo CF-UC User Agent2021-09-23 06:44:10
logo CrawlBot2021-08-18 03:48:00
logo TestBot2021-08-12 03:17:05
logo TinyBotTestUA2021-07-27 16:41:28
logo trafilatura2021-07-25 09:03:07UPUP
logo PyWebCopyBot2021-07-17 04:23:01UP
logo TinyTestBot2021-07-03 04:02:41
logo aranhabot2021-07-01 01:53:25
logo KauaiSlowBot2021-06-17 04:33:58
logo LanaiBot2021-05-18 05:18:18
logo GoodBot2021-05-14 05:26:27
logo chimebot2021-05-12 22:45:16
logo Snap URL Preview Service2021-04-22 01:15:03
logo autoemailspider2021-04-20 08:50:07
logo fake_bot2021-04-07 02:48:18
logo FlorKz.2021-04-02 16:36:36
logo 1M7bot2021-02-25 17:15:24
logo Aream Crawler2021-01-29 23:51:39
logo AAABot2021-01-29 04:36:11
logo AnyBot2021-01-15 19:02:00
logo KauaiBot2021-01-14 23:39:01
logo AteniumBot2021-01-05 10:09:38
logo MyBot2020-12-12 23:17:21
logo gschaid bot2020-10-18 12:43:50Down
logo XTC BOTNET2020-09-08 16:16:38
logo Rely Bot2020-08-27 10:43:37
logo Info bot2020-08-24 20:12:21
logo NiueBot2020-08-12 12:20:03
logo BananaBot2020-07-18 17:01:13
logo Web Crawler2020-05-31 19:42:48
logo BorneoBot2020-05-27 19:23:30
logo dark_NeXus_Qbot2020-05-27 00:01:04
logo YunSecurityBot2020-04-16 23:14:45
logo aylienbot2020-03-01 10:42:29DownUP
logo bbot2020-01-11 06:11:09
logo brands-bot-logo2020-01-08 07:31:44
logo brands-bot2020-01-06 23:57:31
logo WebBot2019-11-25 14:49:31
logo WebCrawler2019-11-25 14:49:30
logo Fuze_Bot2019-11-12 16:04:52
logo AdBot2019-11-10 14:25:36
logo OgScrper2019-10-31 16:32:37
logo AdsrvrBot2019-10-28 08:30:19
logo CLcrawler2019-10-12 04:10:48
logo PleskBot2019-08-29 09:05:20
logo arachnode.net2019-08-11 09:00:54UPUP
logo TSpider2019-08-07 07:58:51
logo DaveCrawler2019-07-07 11:25:07
logo DaaS.sh crawler2019-05-07 17:52:28UP
logo Mixnode2018-08-20 01:06:54UP
logo 0082018-08-14 06:14:32DownUP
logo voltron2018-04-01 12:07:39DownUP
logo MailDBBot2017-04-06 20:08:19DownUP
logo scrapy-redis2017-03-06 12:58:15UP
logo AlexionResearchBot2011-08-19 02:17:35

Historical (Old robots, Inactive cravlers)
logo Frontera2019-05-23 13:42:37UPUP
logo Contacts Crawler2018-06-28 00:35:28UP
logo Quick-Crawler2018-06-08 07:47:17UP
logo Saleslift2017-12-23 05:57:41Down
logo Profound scrapyproject2017-01-05 14:39:19UPUP
logo Crawlera2016-02-08 16:08:25UP
logo import.io2016-02-03 18:34:09UP
logo Spinn3r2015-12-16 04:26:23DownDown
logo KimonoLabs2015-06-22 04:28:40UP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.