Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus - AI


Crawlers (Robots)Last seenbot URLProducer URL
logo WebCrawler2025-12-05 07:46:06
logo Monibot2025-12-05 07:41:33
logo Fake bot2025-12-05 07:39:42
logo ALittle Client2025-12-05 05:52:26
logo Headless Chrome2025-12-05 04:50:44
logo keys-so-bot2025-12-05 04:50:20
logo crawler2025-12-05 04:35:42
logo SyncSearch2025-12-05 04:35:27
logo TestBot2025-12-05 04:28:32
logo Mozilla2025-12-05 04:28:12
logo WF search2025-12-05 03:14:06
logo SlaccaleBot2025-12-04 20:36:13
logo ABEvalBot2025-12-04 06:21:16
logo HanaleiBot2025-12-04 06:21:16
logo Test Certificate Info2025-12-04 06:21:15
logo libredtail-http2025-12-04 06:16:09
logo TestUserAgent2025-12-03 05:41:59
logo DnBCrawler2025-12-02 21:24:35
logo OpenAI bot2025-12-01 09:02:34UPUP
logo SQLi-Scanner2025-12-01 08:51:41
logo ISSCyberRiskCrawler2025-12-01 08:31:31
logo Scrapy2025-11-30 05:11:58UPUP
logo xfa12025-11-30 05:10:24
logo wpbot2025-11-29 22:29:57
logo Hello World2025-11-29 05:09:29
logo nbertaupete952025-11-28 05:13:14
logo Orbbot2025-11-27 16:13:40
logo SmartBotCrawler2025-11-27 06:32:52
logo MetadataScraper2025-11-26 06:30:45
logo SEBot-WA2025-11-26 06:06:21
logo Custom-AsyncHttpClient2025-11-26 05:57:19
logo AliyunSecBot2025-11-24 05:26:27
logo ShapBot2025-11-23 15:38:05
logo jurgendata2025-11-23 13:29:52Down
logo Linux Gnu (cow)2025-11-21 06:55:18
logo SearchExpress2025-11-20 07:34:47
logo Test2025-11-20 04:19:18
logo env-checker2025-11-18 02:58:17
logo More2025-11-17 18:26:22
logo img2dataset2025-11-17 04:31:53UPUP
logo test2025-11-15 07:57:58
logo hopgoblin2025-11-15 07:56:50
logo ip9max2025-11-14 06:13:42
logo websusebot2025-11-13 11:41:10
logo adaptive-bot2025-11-03 04:34:12
logo SaluteBot2025-11-01 13:16:04
logo MetaInspector2025-10-31 23:36:07UPUP
logo VDP-Scanner2025-10-31 18:18:30
logo CompanyCrawler2025-10-31 16:43:35
logo TechNewsBot2025-10-31 05:54:02
logo r00ts3c-owned-you2025-10-26 23:09:54
logo K/b-scanner2025-10-26 05:49:39
logo Diffbot2025-10-26 05:37:13UPUP
logo cc_bot2025-10-25 08:55:23
logo Crawler-IP-Fetcher2025-10-25 03:58:15
logo GoParserBot2025-10-24 23:08:08
logo WanScannerBot2025-10-22 12:46:16
logo Clearscopebot2025-10-21 16:41:56
logo CMS-Checker2025-10-21 16:41:40
logo link-geo-country2025-10-21 11:12:20
logo Unknown bot2025-10-21 11:01:27
logo ThinkChaos2025-10-20 13:47:27
logo crawler_eb_germany2025-10-19 14:31:36
logo WarpBot2025-10-15 05:05:55
logo Nicecrawler2025-10-14 19:32:33UP
logo BacklinkSpider2025-10-14 19:32:21
logo SummalyBot2025-10-14 09:37:54
logo NiueBot2025-10-13 08:01:59
logo MiniWebCrawler2025-10-08 15:42:26
logo OIDC-Fetcher2025-10-07 19:05:35
logo SQ-Scanner2025-10-05 02:01:04
logo UppinaMonitor2025-10-02 07:49:47
logo GoRedirectChecker2025-10-01 04:14:55
logo WPDetector2025-09-29 21:53:05
logo nvdorz2025-09-28 17:07:00
logo CandidateCrawler2025-09-28 10:03:27
logo DomainAuditor2025-09-27 22:04:41
logo site-checker2025-09-25 20:35:26
logo EmailWolf2025-09-25 00:55:54
logo bang20122025-09-23 00:35:11
logo sexy-spider2025-09-20 06:42:40
logo ModelContextProtocol2025-09-17 10:55:22
logo rss-feed-index-bot2025-09-16 00:42:39
logo n8n-serp-crawler2025-09-15 23:42:25
logo sendgrid-scanner2025-09-13 05:20:12
logo CustomScanner2025-09-11 22:09:23
logo robots-ai-permissions2025-09-11 17:40:47
logo Triplechecker2025-09-09 13:51:45
logo TakeoverScanner2025-09-09 10:17:30
logo EnvScanner2025-09-05 03:22:30
logo fedcrawl2025-09-04 04:44:31
logo PDFBot2025-09-03 15:19:47
logo curb2025-08-28 14:38:32
logo TestCrawler2025-08-26 21:12:15
logo img2dataset-rs2025-08-24 14:57:57UP
logo parisbot2025-08-21 03:53:24
logo ErisBot2025-08-21 02:50:32
logo Robot2025-08-18 13:06:54
logo bot;2025-08-15 16:56:36
logo Magellan2025-08-14 22:50:28
logo HawaiiBot2025-08-08 04:20:26
logo NetAPI2025-07-28 02:25:48
logo BackScanX2025-07-26 03:22:50
logo wise2025-07-24 09:35:12
logo FAST-WebCrawler2025-07-18 13:29:26
logo ImageBot2025-07-15 04:39:44
logo Spider_Bot2025-07-12 00:23:25
logo search-engine-indexer2025-07-11 14:12:51
logo MyCrawler2025-07-08 11:10:52
logo MyEducationalCrawler2025-07-08 09:01:11
logo Rankabot2025-07-04 11:09:35
logo HostHeaderScanner2025-06-25 16:26:28
logo Nexgate Ruby Client2025-06-22 07:24:55
logo your-search-bot2025-06-20 18:52:56
logo v0bot2025-06-15 20:14:19
logo GoScanner2025-06-13 09:42:19
logo WPCheckBot2025-06-08 02:42:02
logo Apache-Smuggler2025-06-06 22:24:37
logo Timing-Analysis2025-06-06 22:24:37
logo HAProxy-Smuggler2025-06-06 22:24:37
logo WAF-Bypass-Test2025-06-06 22:24:37
logo Nginx-Smuggler2025-06-06 22:24:37
logo Desync-Exploit2025-06-06 22:24:37
logo AASA-Bot2025-06-03 05:10:08
logo SuperFastScraper2025-06-01 15:54:06
logo ZAKREGEX-Scanner2025-05-27 03:53:30
logo linus-torvalds-loves-you2025-05-26 16:03:28
logo TimeTravelAggregator-lanl2025-05-25 13:42:14UP
logo studyBot2025-05-22 19:52:28
logo DARPResearchBot2025-05-18 13:41:08
logo YFF352025-05-17 14:18:21
logo ShellBot2025-05-15 05:55:20
logo ScannerBot2025-05-13 03:47:38
logo MassScanner2025-05-06 23:41:09
logo robots-bulk-crawler2025-05-06 09:13:50
logo Tranco Crawler2025-04-25 13:05:08
logo CoreBot2025-04-24 10:56:13
logo LMCSearchBot2025-04-18 09:21:28
logo GeneralWebsiteSpider2025-04-16 18:46:12
logo Navy Federal2025-04-11 23:22:42
logo JSACrawlerBot2025-04-09 07:33:51
logo newswtbot2025-04-08 20:09:51
logo Gensparkbot2025-04-04 06:06:21
logo web_fetcher2025-04-04 00:50:40
logo centurybot2025-04-02 23:46:03
logo VsuSearchSpider2025-04-01 20:35:46
logo Spider2025-03-28 07:18:53
logo LookoutBot2025-03-28 06:16:35
logo Guest2025-03-27 00:05:06
logo white-analyz-bug2025-02-25 13:42:08
logo BotPoke2025-02-23 12:07:24
logo HealthCheckBot2025-02-17 12:16:37
logo howBot2025-02-09 16:21:37
logo AdsTxtBot2025-02-08 14:22:54
logo robots.py2025-02-07 19:13:08
logo NinjaAIBot2025-01-07 19:07:40
logo Dmbot2025-01-06 23:03:44
logo SkyworkSpider2025-01-05 04:44:25
logo PlamoExplorer2024-12-20 15:54:14
logo Nutch Spider2024-12-19 21:58:40

Maybe inactive robots (One year we have not heard about them)
logo Dormouse2024-12-04 19:50:35
logo PoeSearchBot2024-11-28 06:01:50
logo gaeskeun_bot2024-11-17 05:13:40
logo Splash2024-11-16 12:14:22UPUP
logo DF Bot2024-11-15 23:50:59
logo PS_Daily2024-11-14 13:58:41
logo Fellow Links Parser Robot2024-10-30 15:11:21
logo FriendlyCrawler2024-10-28 11:54:13
logo TheInternetSearch2024-10-15 12:33:55
logo Searcherxweb2024-10-06 15:30:33
logo SeoCherryBot2024-10-03 03:24:48
logo HappyWing2024-09-28 05:23:57
logo ScrapeheroBot2024-09-15 04:59:00UPUP
logo mj-wordpress-crawler2024-09-02 05:29:13
logo GlobalWebSearch2024-08-10 12:34:18
logo advanced_crawler2024-08-04 07:23:11
logo Headless Edge2024-07-30 11:36:40
logo zebra-v2-bot2024-07-26 00:50:56
logo IBM Crawler2024-07-25 07:02:58
logo MyBot2024-07-24 02:40:24
logo Adventurer2024-07-23 07:50:56
logo Golfe2024-07-19 06:03:21
logo WorldBot2024-06-30 06:10:06Down
logo Yuuperbot2024-06-10 13:29:55
logo alienfarm2024-06-10 10:58:25
logo zzhbot2024-06-06 00:06:04
logo edansbot2024-06-04 16:28:37
logo Searcherweb2024-05-27 13:58:35
logo newspaper2024-05-27 06:02:29
logo SuperMegaHyperColossalMassiveGiganticAstronomicalM2024-05-24 03:52:51
logo The Knowledge AI2024-05-20 20:29:28
logo Friendly_Crawler2024-05-19 12:41:12
logo Elisabot2024-05-07 07:26:54
logo ImageMind2024-04-29 04:35:58
logo Friendly testing bot2024-04-28 13:00:22
logo Crawler2024-04-22 17:03:50
logo Autoconfig Test from USTC2024-03-27 22:28:41
logo magicsearchdev2024-03-14 14:44:23
logo SSSSBot2024-03-03 09:59:54Down
logo Wordup-12024-02-22 11:54:47
logo SeoulBot2024-02-16 17:23:12
logo SCAN2024-01-22 23:09:55
logo PhxBot2024-01-22 22:21:18
logo CXK_Bot2024-01-19 22:02:03
logo BDBot2024-01-14 05:11:52
logo _zbot2024-01-06 06:42:12
logo gregcrawler2023-11-16 23:31:54
logo thesis-research-bot2023-11-08 23:32:51
logo fidget-spinner-bot2023-11-07 01:24:58
logo my-tiny-bot2023-11-06 04:11:49
logo AntBot2023-11-05 16:00:56
logo friendly-spider2023-11-02 16:17:42
logo test-bot2023-10-30 22:19:01
logo RssReaderBot2023-10-27 22:21:01
logo RainBot2023-10-23 08:44:40
logo lolbot2023-10-23 01:08:44
logo TinyTestBot2023-10-06 17:05:57
logo ds-robot2023-10-03 14:51:34
logo jaddjabot2023-09-28 19:08:53
logo Implcit:AdsTxt-Scrapr2023-09-28 13:58:34
logo FriendlyRssReader2023-09-27 23:02:35
logo ChimeUnfurlAgent2023-09-24 07:53:13
logo TinyTestBoty2023-09-21 06:58:00
logo Trokambot2023-09-15 07:16:47
logo CrawlyProjectCrawler2023-08-27 15:19:53
logo MoonBot2023-08-25 09:43:50
logo PyWebCopyBot2023-08-25 05:28:16UP
logo LunaBot2023-08-24 01:51:31
logo GoogleRot2023-08-19 05:26:41
logo ScamadviserExternalHit2023-08-18 19:05:17
logo lunabot2023-08-18 07:39:37
logo badbot2023-08-14 09:33:35
logo Wordupindexinfo12023-08-11 06:52:04
logo researchxoftheweb2023-07-30 15:28:30
logo goodbot2023-07-25 11:48:36
logo QBOT2023-07-08 04:54:07
logo BSbot2023-07-03 05:22:29
logo StactBot2023-06-27 13:30:52
logo AccompanyBot2023-06-27 06:53:40
logo MJBot2023-06-17 14:29:57
logo ResearchBot2023-06-11 14:53:40
logo PoliteCrawl2023-05-29 12:26:46
logo Storm-crawler2023-05-13 10:53:09
logo GlobalGoalsDirectoryBot2023-04-26 06:43:04
logo PrivateBot2023-04-23 00:16:17
logo PhantomBot2023-04-10 01:28:30
logo SuperBot2023-04-02 05:06:23
logo Bimbot2023-03-26 04:56:01
logo sempi.tech bot2023-03-23 08:49:29UP
logo dcrawl2023-03-20 01:05:29UPUP
logo Keerthi Bot2023-03-20 00:10:24
logo AteniumBot2023-03-02 14:05:15
logo MauiBot2023-01-18 21:21:43
logo AdsTxtCrawler2023-01-12 17:12:15
logo TMM Crawler2023-01-09 21:01:17
logo AdsTxtCrawlerTP2023-01-02 06:14:34
logo Bot2022-12-07 10:08:29
logo linabot2022-12-05 05:05:35
logo google resource2022-12-04 08:33:50
logo DownloaderChrome2022-12-04 05:26:27
logo Centro Ads.txt Crawler2022-11-10 13:07:00
logo seoscanners.net bot2022-10-26 18:04:08
logo _1z_bot2022-10-26 06:11:14
logo WhatStuffWhereBot2022-10-12 09:00:22
logo TrendsmapResolver2022-10-10 14:09:35
logo Zephuli-Bot2022-10-07 15:33:30
logo ViberBot2022-09-25 15:04:00
logo loli_spider2022-09-22 07:48:34
logo TprAdsTxtCrawler2022-09-01 11:33:03
logo polite-crawler2022-08-30 01:03:44
logo web-crawler2022-08-24 06:24:14
logo RW_Crawler2022-08-17 15:40:04
logo My Nutch Spider2022-07-28 19:11:23
logo sc_bot2022-05-01 19:27:36
logo browserClientA2022-03-28 08:58:37
logo DAutoBot2022-03-24 11:08:31
logo PHPCrawl2022-03-18 07:31:22UP
logo Crawlbot2022-01-11 11:17:47
logo p40Bot2022-01-11 07:42:22
logo PopScreen Bot2021-12-31 04:43:54
logo Grover2021-12-24 20:28:14
logo clark-crawler2021-12-01 21:25:51
logo FlfBaldrBot2021-12-01 14:21:32
logo SemanticJuice crawler2021-11-30 19:33:28UPUP
logo polaris botnet2021-11-24 16:20:15
logo loadtest2021-11-22 16:43:45
logo tes-cocrawler2021-09-24 00:16:09
logo CF-UC User Agent2021-09-23 06:44:10
logo CrawlBot2021-08-18 03:48:00
logo TinyBotTestUA2021-07-27 16:41:28
logo trafilatura2021-07-25 09:03:07UPUP
logo aranhabot2021-07-01 01:53:25
logo KauaiSlowBot2021-06-17 04:33:58
logo LanaiBot2021-05-18 05:18:18
logo GoodBot2021-05-14 05:26:27
logo chimebot2021-05-12 22:45:16
logo Snap URL Preview Service2021-04-22 01:15:03
logo autoemailspider2021-04-20 08:50:07
logo fake_bot2021-04-07 02:48:18
logo FlorKz.2021-04-02 16:36:36
logo 1M7bot2021-02-25 17:15:24
logo Aream Crawler2021-01-29 23:51:39
logo AAABot2021-01-29 04:36:11
logo AnyBot2021-01-15 19:02:00
logo KauaiBot2021-01-14 23:39:01
logo gschaid bot2020-10-18 12:43:50Down
logo XTC BOTNET2020-09-08 16:16:38
logo Rely Bot2020-08-27 10:43:37
logo Info bot2020-08-24 20:12:21
logo BananaBot2020-07-18 17:01:13
logo Web Crawler2020-05-31 19:42:48
logo BorneoBot2020-05-27 19:23:30
logo dark_NeXus_Qbot2020-05-27 00:01:04
logo YunSecurityBot2020-04-16 23:14:45
logo aylienbot2020-03-01 10:42:29DownUP
logo bbot2020-01-11 06:11:09
logo brands-bot-logo2020-01-08 07:31:44
logo brands-bot2020-01-06 23:57:31
logo WebBot2019-11-25 14:49:31
logo Fuze_Bot2019-11-12 16:04:52
logo AdBot2019-11-10 14:25:36
logo OgScrper2019-10-31 16:32:37
logo AdsrvrBot2019-10-28 08:30:19
logo UrlTest2019-10-24 04:14:53
logo CLcrawler2019-10-12 04:10:48
logo WorksOgCrawler2019-09-11 10:47:55
logo arachnode.net2019-08-11 09:00:54UPUP
logo TSpider2019-08-07 07:58:51
logo DaveCrawler2019-07-07 11:25:07
logo DaaS.sh crawler2019-05-07 17:52:28UP
logo Mixnode2018-08-20 01:06:54UP
logo 0082018-08-14 06:14:32DownUP
logo voltron2018-04-01 12:07:39DownUP
logo MailDBBot2017-04-06 20:08:19DownUP
logo scrapy-redis2017-03-06 12:58:15UP
logo AlexionResearchBot2011-08-19 02:17:35

Historical (Old robots, Inactive cravlers)
logo Frontera2019-05-23 13:42:37UPUP
logo Contacts Crawler2018-06-28 00:35:28UP
logo Quick-Crawler2018-06-08 07:47:17UP
logo Saleslift2017-12-23 05:57:41Down
logo Profound scrapyproject2017-01-05 14:39:19UPUP
logo Crawlera2016-02-08 16:08:25UP
logo import.io2016-02-03 18:34:09UP
logo Spinn3r2015-12-16 04:26:23DownDown
logo KimonoLabs2015-06-22 04:28:40UP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.