Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus - AI


Crawlers (Robots)Last seenbot URLProducer URL
logo anthropic bot2026-03-21 00:06:35UP
logo OpenAI bot2026-03-20 23:44:58UPUP
logo PerplexityBot2026-03-20 19:46:05UPUP
logo Azure AI Search2026-03-20 13:51:07UP
logo Google-NotebookLM2026-03-20 09:25:59UPUP
logo QuillBot2026-03-20 09:25:44UPUP
logo amazon-kendra2026-03-11 01:37:09UPUP
logo MistralAI crawler2026-03-05 08:59:43UPUP
logo WRTNBot2026-03-04 10:50:18DownUP
logo Gemini bot2026-02-26 05:45:20UPUP
logo TerraCotta2026-02-25 03:39:04UPUP
logo iAsk.ai2026-02-10 17:01:50UPUP
logo Aithlas bot2025-12-17 07:41:56UP
logo Algolia bot2025-11-30 05:11:46UP
logo Ai2Bot2025-11-12 04:38:28UPUP
logo NetShelter ContentScan2025-10-31 13:55:46UP
logo LinerBot2025-10-13 06:11:14UPUP
logo amazon-QBusiness2025-09-14 16:42:36UPUP
logo PanguBot2025-08-11 04:48:45UPUP
logo ZanistaBot2025-06-21 02:20:16UPUP

Maybe inactive robots (One year we have not heard about them)
logo Spawning bot2024-09-29 05:26:01UP
logo ChatGLM Spider2024-09-26 04:40:46UPUP
logo LLM-jp-Crawler2024-08-22 04:21:26UPUP
logo Google Cloud AI2020-10-19 17:23:41UPUP

Historical (Old robots, Inactive cravlers)
logo Crawling at Home2021-11-03 05:24:00DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.