Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus - AI


Crawlers (Robots)Last seenbot URLProducer URL
logo anthropic bot2025-12-05 07:22:19UP
logo OpenAI bot2025-12-05 06:45:12UPUP
logo TerraCotta2025-12-05 04:50:35UPUP
logo QuillBot2025-12-05 04:48:53UP
logo PerplexityBot2025-12-05 04:32:51UPUP
logo WRTNBot2025-12-03 12:22:38DownUP
logo Algolia bot2025-11-30 05:11:46UP
logo MistralAI crawler2025-11-26 20:16:49UPUP
logo Google-NotebookLM2025-11-26 06:29:38UPUP
logo iAsk.ai2025-11-14 08:21:56UPUP
logo Ai2Bot2025-11-12 04:38:28UPUP
logo NetShelter ContentScan2025-10-31 13:55:46UP
logo Gemini bot2025-10-18 06:20:22UPUP
logo LinerBot2025-10-13 06:11:14UPUP
logo amazon-QBusiness2025-09-14 16:42:36UPUP
logo PanguBot2025-08-11 04:48:45UPUP
logo ZanistaBot2025-06-21 02:20:16UPUP

Maybe inactive robots (One year we have not heard about them)
logo Spawning bot2024-09-29 05:26:01UP
logo ChatGLM Spider2024-09-26 04:40:46UPUP
logo LLM-jp-Crawler2024-08-22 04:21:26UPUP
logo Google Cloud AI2020-10-19 17:23:41UPUP

Historical (Old robots, Inactive cravlers)
logo Crawling at Home2021-11-03 05:24:00DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.