Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus - AI


Crawlers (Robots)Last seenbot URLProducer URL
logo PerplexityBot2026-07-22 16:00:59UPUP
logo anthropic bot2026-07-22 15:51:02UP
logo OpenAI bot2026-07-22 14:56:06UPUP
logo Azure AI Search2026-07-22 11:51:44UP
logo FacebookBot2026-07-22 11:51:22UPUP
logo MistralAI crawler2026-07-21 22:21:59UPUP
logo Ceramic bot2026-07-19 07:44:09UPUP
logo amazon-kendra2026-07-18 07:34:51UPUP
logo QuillBot2026-07-16 17:32:40UPUP
logo Google-NotebookLM2026-07-16 15:51:57UPUP
logo active9.com bot2026-07-05 10:39:36UP
logo DeepSeekBot2026-07-02 06:20:06UPUP
logo iAsk.ai2026-07-02 05:17:38UPUP
logo Gemini bot2026-05-12 15:22:33UPUP
logo LLMSE2026-05-05 16:34:59UPUP
logo Moonshot bot2026-04-21 12:21:36UP
logo Reflection AI crawler2026-04-17 06:55:04UP
logo WRTNBot2026-03-04 10:50:18DownUP
logo Aithlas bot2025-12-17 07:41:56UP
logo Algolia bot2025-11-30 05:11:46UP
logo Ai2Bot2025-11-12 04:38:28UPUP
logo NetShelter ContentScan2025-10-31 13:55:46UP
logo LinerBot2025-10-13 06:11:14UPUP
logo amazon-QBusiness2025-09-14 16:42:36UPUP
logo PanguBot2025-08-11 04:48:45UPUP

Maybe inactive robots (One year we have not heard about them)
logo ZanistaBot2025-06-21 02:20:16UPUP
logo Devin2025-06-19 01:57:57UPUP
logo Spawning bot2024-09-29 05:26:01UP
logo ChatGLM Spider2024-09-26 04:40:46UPUP
logo LLM-jp-Crawler2024-08-22 04:21:26UPUP
logo Google Cloud AI2020-10-19 17:23:41UPUP

Historical (Old robots, Inactive cravlers)
logo Crawling at Home2021-11-03 05:24:00DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.