Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo Fake bot2024-11-21 09:41:24
logo Monibot2024-11-21 09:18:36
logo ALittle Client2024-11-21 05:39:32
logo Headless Chrome2024-11-21 05:25:02
logo Custom-AsyncHttpClient2024-11-21 01:47:30
logo Dormouse2024-11-20 23:42:57
logo Magellan2024-11-20 23:31:27
logo Hello World2024-11-20 19:42:57
logo Mozilla2024-11-20 11:17:05
logo keys-so-bot2024-11-20 06:00:56
logo DnBCrawler2024-11-19 18:38:09
logo nvdorz2024-11-19 17:02:38
logo More2024-11-19 15:11:49
logo FAST-WebCrawler2024-11-19 05:39:45
logo SkyworkSpider2024-11-19 05:09:12
logo gaeskeun_bot2024-11-17 05:13:40
logo Test Certificate Info2024-11-16 21:45:49
logo nbertaupete952024-11-16 16:16:10
logo VsuSearchSpider2024-11-16 13:45:49
logo Splash2024-11-16 12:14:22UPUP
logo DF Bot2024-11-15 23:50:59
logo PS_Daily2024-11-14 13:58:41
logo wpbot2024-11-13 23:34:37
logo Nicecrawler2024-11-09 19:51:21UP
logo Scrapy2024-11-06 03:22:13UPUP
logo Fellow Links Parser Robot2024-10-30 15:11:21
logo PoeSearchBot2024-10-28 17:19:39
logo SEBot-WA2024-10-28 12:02:03
logo FriendlyCrawler2024-10-28 11:54:13
logo ISSCyberRiskCrawler2024-10-28 11:16:18
logo SearchExpress2024-10-26 22:40:12
logo TheInternetSearch2024-10-15 12:33:55
logo crawler_eb_germany2024-10-11 05:56:50
logo Orbbot2024-10-09 08:29:36
logo Searcherxweb2024-10-06 15:30:33
logo SeoCherryBot2024-10-03 03:24:48
logo HappyWing2024-09-28 05:23:57
logo ScrapeheroBot2024-09-15 04:59:00UPUP
logo your-search-bot2024-09-10 06:36:36
logo NinjaAIBot2024-09-09 09:25:36
logo jurgendata2024-09-08 17:20:31Down
logo mj-wordpress-crawler2024-09-02 05:29:13
logo seolyt2024-08-17 19:24:56
logo Test2024-08-14 11:29:15
logo YFF352024-08-13 13:53:01
logo GlobalWebSearch2024-08-10 12:34:18
logo Diffbot2024-08-10 07:05:31UPUP
logo NetAPI2024-08-04 22:01:13
logo advanced_crawler2024-08-04 07:23:11
logo Headless Edge2024-07-30 11:36:40
logo zebra-v2-bot2024-07-26 00:50:56
logo IBM Crawler2024-07-25 07:02:58
logo MyBot2024-07-24 02:40:24
logo Adventurer2024-07-23 07:50:56
logo Golfe2024-07-19 06:03:21
logo img2dataset2024-07-11 02:58:36UPUP
logo centurybot92024-07-04 12:42:52
logo WorldBot2024-06-30 06:10:06Down
logo Yuuperbot2024-06-10 13:29:55
logo alienfarm2024-06-10 10:58:25
logo zzhbot2024-06-06 00:06:04
logo edansbot2024-06-04 16:28:37
logo Searcherweb2024-05-27 13:58:35
logo newspaper2024-05-27 06:02:29
logo SuperMegaHyperColossalMassiveGiganticAstronomicalM2024-05-24 03:52:51
logo HawaiiBot2024-05-22 19:35:14
logo The Knowledge AI2024-05-20 20:29:28
logo Friendly_Crawler2024-05-19 12:41:12
logo Elisabot2024-05-07 07:26:54
logo ImageMind2024-04-29 04:35:58
logo Friendly testing bot2024-04-28 13:00:22
logo Crawler2024-04-22 17:03:50
logo Unknown bot2024-04-16 13:56:13
logo MetaInspector2024-04-04 14:00:10UPUP
logo Autoconfig Test from USTC2024-03-27 22:28:41
logo BotPoke2024-03-17 09:40:07
logo magicsearchdev2024-03-14 14:44:23
logo SSSSBot2024-03-03 09:59:54Down
logo Wordup-12024-02-22 11:54:47
logo SeoulBot2024-02-16 17:23:12
logo Spider2024-02-12 04:28:51
logo SCAN2024-01-22 23:09:55
logo PhxBot2024-01-22 22:21:18
logo CXK_Bot2024-01-19 22:02:03
logo BDBot2024-01-14 05:11:52
logo SummalyBot2024-01-08 09:37:25
logo Dmbot2024-01-08 09:04:42
logo _zbot2024-01-06 06:42:12

Maybe inactive robots (One year we have not heard about them)
logo gregcrawler2023-11-16 23:31:54
logo thesis-research-bot2023-11-08 23:32:51
logo fidget-spinner-bot2023-11-07 01:24:58
logo my-tiny-bot2023-11-06 04:11:49
logo AntBot2023-11-05 16:00:56
logo friendly-spider2023-11-02 16:17:42
logo test-bot2023-10-30 22:19:01
logo RssReaderBot2023-10-27 22:21:01
logo RainBot2023-10-23 08:44:40
logo lolbot2023-10-23 01:08:44
logo TinyTestBot2023-10-06 17:05:57
logo ds-robot2023-10-03 14:51:34
logo jaddjabot2023-09-28 19:08:53
logo Implcit:AdsTxt-Scrapr2023-09-28 13:58:34
logo FriendlyRssReader2023-09-27 23:02:35
logo ChimeUnfurlAgent2023-09-24 07:53:13
logo TinyTestBoty2023-09-21 06:58:00
logo Trokambot2023-09-15 07:16:47
logo CrawlyProjectCrawler2023-08-27 15:19:53
logo MoonBot2023-08-25 09:43:50
logo PyWebCopyBot2023-08-25 05:28:16UP
logo LunaBot2023-08-24 01:51:31
logo GoogleRot2023-08-19 05:26:41
logo ScamadviserExternalHit2023-08-18 19:05:17
logo lunabot2023-08-18 07:39:37
logo Nutch Spider2023-08-18 04:16:39
logo badbot2023-08-14 09:33:35
logo Wordupindexinfo12023-08-11 06:52:04
logo researchxoftheweb2023-07-30 15:28:30
logo test2023-07-29 03:34:31
logo goodbot2023-07-25 11:48:36
logo QBOT2023-07-08 04:54:07
logo BSbot2023-07-03 05:22:29
logo StactBot2023-06-27 13:30:52
logo AccompanyBot2023-06-27 06:53:40
logo MJBot2023-06-17 14:29:57
logo ResearchBot2023-06-11 14:53:40
logo PoliteCrawl2023-05-29 12:26:46
logo Storm-crawler2023-05-13 10:53:09
logo GlobalGoalsDirectoryBot2023-04-26 06:43:04
logo PrivateBot2023-04-23 00:16:17
logo PhantomBot2023-04-10 01:28:30
logo SuperBot2023-04-02 05:06:23
logo Bimbot2023-03-26 04:56:01
logo sempi.tech bot2023-03-23 08:49:29UP
logo dcrawl2023-03-20 01:05:29UPUP
logo Keerthi Bot2023-03-20 00:10:24
logo AteniumBot2023-03-02 14:05:15
logo MauiBot2023-01-18 21:21:43
logo AdsTxtCrawler2023-01-12 17:12:15
logo TMM Crawler2023-01-09 21:01:17
logo AdsTxtCrawlerTP2023-01-02 06:14:34
logo Bot2022-12-07 10:08:29
logo linabot2022-12-05 05:05:35
logo google resource2022-12-04 08:33:50
logo DownloaderChrome2022-12-04 05:26:27
logo websusebot2022-11-19 02:30:20
logo Centro Ads.txt Crawler2022-11-10 13:07:00
logo seoscanners.net bot2022-10-26 18:04:08
logo _1z_bot2022-10-26 06:11:14
logo MetadataScraper2022-10-22 09:43:04
logo WhatStuffWhereBot2022-10-12 09:00:22
logo TrendsmapResolver2022-10-10 14:09:35
logo Zephuli-Bot2022-10-07 15:33:30
logo ViberBot2022-09-25 15:04:00
logo loli_spider2022-09-22 07:48:34
logo TprAdsTxtCrawler2022-09-01 11:33:03
logo polite-crawler2022-08-30 01:03:44
logo web-crawler2022-08-24 06:24:14
logo RW_Crawler2022-08-17 15:40:04
logo My Nutch Spider2022-07-28 19:11:23
logo ThinkChaos2022-07-16 13:33:33
logo sc_bot2022-05-01 19:27:36
logo browserClientA2022-03-28 08:58:37
logo DAutoBot2022-03-24 11:08:31
logo PHPCrawl2022-03-18 07:31:22UP
logo Crawlbot2022-01-11 11:17:47
logo p40Bot2022-01-11 07:42:22
logo PopScreen Bot2021-12-31 04:43:54
logo Grover2021-12-24 20:28:14
logo clark-crawler2021-12-01 21:25:51
logo FlfBaldrBot2021-12-01 14:21:32
logo SemanticJuice crawler2021-11-30 19:33:28UPUP
logo polaris botnet2021-11-24 16:20:15
logo loadtest2021-11-22 16:43:45
logo tes-cocrawler2021-09-24 00:16:09
logo CF-UC User Agent2021-09-23 06:44:10
logo CrawlBot2021-08-18 03:48:00
logo TestBot2021-08-12 03:17:05
logo TinyBotTestUA2021-07-27 16:41:28
logo trafilatura2021-07-25 09:03:07UPUP
logo aranhabot2021-07-01 01:53:25
logo KauaiSlowBot2021-06-17 04:33:58
logo LanaiBot2021-05-18 05:18:18
logo GoodBot2021-05-14 05:26:27
logo chimebot2021-05-12 22:45:16
logo Snap URL Preview Service2021-04-22 01:15:03
logo autoemailspider2021-04-20 08:50:07
logo fake_bot2021-04-07 02:48:18
logo FlorKz.2021-04-02 16:36:36
logo 1M7bot2021-02-25 17:15:24
logo Aream Crawler2021-01-29 23:51:39
logo AAABot2021-01-29 04:36:11
logo AnyBot2021-01-15 19:02:00
logo KauaiBot2021-01-14 23:39:01
logo gschaid bot2020-10-18 12:43:50Down
logo XTC BOTNET2020-09-08 16:16:38
logo Rely Bot2020-08-27 10:43:37
logo Info bot2020-08-24 20:12:21
logo NiueBot2020-08-12 12:20:03
logo BananaBot2020-07-18 17:01:13
logo Web Crawler2020-05-31 19:42:48
logo BorneoBot2020-05-27 19:23:30
logo dark_NeXus_Qbot2020-05-27 00:01:04
logo YunSecurityBot2020-04-16 23:14:45
logo aylienbot2020-03-01 10:42:29DownUP
logo bbot2020-01-11 06:11:09
logo brands-bot-logo2020-01-08 07:31:44
logo brands-bot2020-01-06 23:57:31
logo WebBot2019-11-25 14:49:31
logo WebCrawler2019-11-25 14:49:30
logo Fuze_Bot2019-11-12 16:04:52
logo AdBot2019-11-10 14:25:36
logo OgScrper2019-10-31 16:32:37
logo AdsrvrBot2019-10-28 08:30:19
logo UrlTest2019-10-24 04:14:53
logo CLcrawler2019-10-12 04:10:48
logo WorksOgCrawler2019-09-11 10:47:55
logo arachnode.net2019-08-11 09:00:54UPUP
logo TSpider2019-08-07 07:58:51
logo DaveCrawler2019-07-07 11:25:07
logo DaaS.sh crawler2019-05-07 17:52:28UP
logo Mixnode2018-08-20 01:06:54UP
logo 0082018-08-14 06:14:32DownUP
logo voltron2018-04-01 12:07:39DownUP
logo MailDBBot2017-04-06 20:08:19DownUP
logo scrapy-redis2017-03-06 12:58:15UP
logo AlexionResearchBot2011-08-19 02:17:35

Historical (Old robots, Inactive cravlers)
logo Frontera2019-05-23 13:42:37UPUP
logo Contacts Crawler2018-06-28 00:35:28UP
logo Quick-Crawler2018-06-08 07:47:17UP
logo Saleslift2017-12-23 05:57:41Down
logo Profound scrapyproject2017-01-05 14:39:19UPUP
logo Crawlera2016-02-08 16:08:25UP
logo import.io2016-02-03 18:34:09UP
logo Spinn3r2015-12-16 04:26:23DownDown
logo KimonoLabs2015-06-22 04:28:40UP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.