Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo newspaper2021-12-07 16:41:08
logo Monibot2021-12-07 16:27:09
logo The Knowledge AI2021-12-07 11:38:56
logo Headless Chrome2021-12-07 07:24:04
logo Fake bot2021-12-07 06:24:55
logo seoscanners.net bot2021-12-07 04:31:38
logo spider2021-12-07 04:14:35
logo MauiBot2021-12-07 02:26:28
logo Grover2021-12-07 01:46:51
logo AdsTxtCrawler2021-12-06 14:23:23
logo centurybot92021-12-06 05:46:34
logo nbertaupete952021-12-06 00:07:35
logo DF Bot2021-12-04 18:21:33
logo Orbbot2021-12-04 05:34:53
logo TMM Crawler2021-12-02 23:32:11
logo clark-crawler2021-12-01 21:25:51
logo AccompanyBot2021-12-01 16:58:36
logo MetaInspector2021-12-01 16:35:51UPUP
logo ThinkChaos2021-12-01 14:57:47
logo FlfBaldrBot2021-12-01 14:21:32
logo SemanticJuice crawler2021-11-30 19:33:28UPUP
logo Scrapy2021-11-24 23:39:36UPUP
logo polaris botnet2021-11-24 16:20:15
logo Diffbot2021-11-17 11:31:30UPUP
logo sempi.tech bot2021-11-11 12:11:51UP
logo ScamadviserExternalHit2021-11-04 08:24:40
logo YFF352021-10-28 18:13:13
logo Elisabot2021-10-28 18:06:02
logo DAutoBot2021-10-27 14:09:16
logo DnBCrawler2021-10-22 21:22:25
logo DownloaderChrome2021-10-19 06:57:55
logo Storm-crawler2021-10-16 07:19:58
logo tes-cocrawler2021-09-24 00:16:09
logo CF-UC User Agent2021-09-23 06:44:10
logo Dmbot2021-09-22 14:33:50
logo Spider_Bot2021-09-09 07:24:12
logo badbot2021-08-26 10:27:00
logo CrawlBot2021-08-18 03:48:00
logo TestBot2021-08-12 03:17:05
logo sc_bot2021-07-31 16:39:56
logo TinyBotTestUA2021-07-27 16:41:28
logo trafilatura2021-07-25 09:03:07UPUP
logo Nicecrawler2021-07-19 12:08:44UP
logo PyWebCopyBot2021-07-17 04:23:01UP
logo TinyTestBot2021-07-03 04:02:41
logo aranhabot2021-07-01 01:53:25
logo KauaiSlowBot2021-06-17 04:33:58
logo SEBot-WA2021-06-14 06:12:01
logo LanaiBot2021-05-18 05:18:18
logo TprAdsTxtCrawler2021-05-18 02:51:06
logo GoodBot2021-05-14 05:26:27
logo chimebot2021-05-12 22:45:16
logo Snap URL Preview Service2021-04-22 01:15:03
logo seolyt2021-04-16 23:53:26
logo 1M7bot2021-02-25 17:15:24
logo Aream Crawler2021-01-29 23:51:39
logo AAABot2021-01-29 04:36:11
logo AnyBot2021-01-15 19:02:00
logo KauaiBot2021-01-14 23:39:01
logo AteniumBot2021-01-05 10:09:38
logo MyBot2020-12-12 23:17:21

Maybe inactive robots (One year we have not heard about them)
logo gschaid bot2020-10-18 12:43:50Down
logo Splash2020-09-22 11:48:56UPUP
logo XTC BOTNET2020-09-08 16:16:38
logo Rely Bot2020-08-27 10:43:37
logo Info bot2020-08-24 20:12:21
logo NiueBot2020-08-12 12:20:03
logo TrendsmapResolver2020-08-04 12:33:46
logo BananaBot2020-07-18 17:01:13
logo p40Bot2020-06-10 07:06:01
logo Web Crawler2020-05-31 19:42:48
logo BorneoBot2020-05-27 19:23:30
logo dark_NeXus_Qbot2020-05-27 00:01:04
logo YunSecurityBot2020-04-16 23:14:45
logo aylienbot2020-03-01 10:42:29DownUP
logo bbot2020-01-11 06:11:09
logo brands-bot-logo2020-01-08 07:31:44
logo brands-bot2020-01-06 23:57:31
logo WebBot2019-11-25 14:49:31
logo WebCrawler2019-11-25 14:49:30
logo Fuze_Bot2019-11-12 16:04:52
logo AdBot2019-11-10 14:25:36
logo OgScrper2019-10-31 16:32:37
logo AdsrvrBot2019-10-28 08:30:19
logo CLcrawler2019-10-12 04:10:48
logo PleskBot2019-08-29 09:05:20
logo arachnode.net2019-08-11 09:00:54UPUP
logo TSpider2019-08-07 07:58:51
logo DaveCrawler2019-07-07 11:25:07
logo DaaS.sh crawler2019-05-07 17:52:28UP
logo Mixnode2018-08-20 01:06:54UP
logo 0082018-08-14 06:14:32DownUP
logo voltron2018-04-01 12:07:39DownUP
logo MailDBBot2017-04-06 20:08:19DownUP
logo scrapy-redis2017-03-06 12:58:15UP

Historical (Old robots, Inactive cravlers)
logo Frontera2019-05-23 13:42:37UPUP
logo Contacts Crawler2018-06-28 00:35:28UP
logo Quick-Crawler2018-06-08 07:47:17UP
logo Saleslift2017-12-23 05:57:41Down
logo Profound scrapyproject2017-01-05 14:39:19UPUP
logo Crawlera2016-02-08 16:08:25UP
logo import.io2016-02-03 18:34:09UP
logo Spinn3r2015-12-16 04:26:23DownDown
logo KimonoLabs2015-06-22 04:28:40UP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.