Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus - AI


Crawlers (Robots)Last seenbot URLProducer URL
logo anthropic bot2025-12-20 06:39:01UP
logo TerraCotta2025-12-20 05:38:52UPUP
logo PerplexityBot2025-12-20 05:38:05UPUP
logo OpenAI bot2025-12-20 05:08:23UPUP
logo QuillBot2025-12-17 07:43:44UP
logo Aithlas bot2025-12-17 07:41:56UP
logo WRTNBot2025-12-17 01:53:59DownUP
logo iAsk.ai2025-12-16 07:14:28UPUP
logo MistralAI crawler2025-12-05 12:08:02UPUP
logo Algolia bot2025-11-30 05:11:46UP
logo Google-NotebookLM2025-11-26 06:29:38UPUP
logo Ai2Bot2025-11-12 04:38:28UPUP
logo NetShelter ContentScan2025-10-31 13:55:46UP
logo Gemini bot2025-10-18 06:20:22UPUP
logo LinerBot2025-10-13 06:11:14UPUP
logo amazon-QBusiness2025-09-14 16:42:36UPUP
logo PanguBot2025-08-11 04:48:45UPUP
logo ZanistaBot2025-06-21 02:20:16UPUP

Maybe inactive robots (One year we have not heard about them)
logo Spawning bot2024-09-29 05:26:01UP
logo ChatGLM Spider2024-09-26 04:40:46UPUP
logo LLM-jp-Crawler2024-08-22 04:21:26UPUP
logo Google Cloud AI2020-10-19 17:23:41UPUP

Historical (Old robots, Inactive cravlers)
logo Crawling at Home2021-11-03 05:24:00DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.