Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus - AI


Crawlers (Robots)Last seenbot URLProducer URL
logo MB-SiteCrawler2025-12-05 05:52:26UPUP
logo Google Read Aloud2025-12-05 04:51:48UPUP
logo censys.io crawler2025-12-05 04:49:53UPUP
logo SecurityHeaders2025-12-05 04:40:05UPUP
logo archive.org_bot2025-12-05 04:38:47UPUP
logo Cronless2025-12-05 04:16:24UP
logo DomainStatsBot2025-12-04 12:00:41UPUP
logo BuiltWith crawler2025-12-04 05:43:50UPUP
logo StatusNest2025-12-04 04:46:17UPUP
logo Chrome-Lighthouse2025-12-03 16:42:25UPUP
logo monitorbacklinks.com bot2025-12-03 08:52:39UPUP
logo letsencrypt bot2025-12-03 04:02:05UP
logo bitlybot2025-12-02 05:48:20UP
logo TextRazor crawler2025-11-30 09:23:12UP
logo REDbot2025-11-30 07:30:51UPUP
logo YandexBot2025-11-29 06:29:37UPUP
logo 2ip.ru bot2025-11-27 10:40:08UPUP
logo masscan2025-11-27 07:28:17UPUP
logo Photon2025-11-23 16:53:37UPUP
logo Ns.Tools Bot2025-11-22 10:12:20UP
logo imgproxy2025-11-16 09:53:52UPUP
logo Prerender2025-11-15 21:17:11UPUP
logo OpenRobotsTxt Crawler2025-11-15 12:03:51UPUP
logo OrgProbe2025-11-15 07:25:02UPUP
logo RobotsChecker2025-11-14 09:16:56UPUP
logo MS Cognitive Services2025-11-13 05:03:22UP
logo Cronjob.de bot2025-11-10 08:00:04UPUP
logo WellKnownBot2025-11-05 01:46:55UPUP
logo CastFeedValidator2025-11-04 05:01:50UP
logo updown.io bot2025-10-30 18:05:26UPUP
logo Cybaa bot2025-10-29 01:20:34UPUP
logo Naver scrapbook2025-10-28 04:15:07UPUP
logo Googlebot2025-10-20 06:20:50UPUP
logo WGETbot2025-10-14 08:55:49UPUP
logo RocketValidator crawler2025-10-14 08:53:22UPUP
logo internetnl2025-10-13 17:17:37UPUP
logo GoogleAssociationService2025-10-12 08:04:53UPUP
logo Observatory2025-10-08 17:38:17UPUP
logo Copywritely2025-10-06 18:24:09UPUP
logo vercel bot2025-10-02 04:28:44UP
logo SiteCheckerBot2025-09-27 22:27:59UPUP
logo go-camo2025-09-25 08:14:29UPUP
logo Check-Host2025-09-25 05:54:36UP
logo Seobility2025-09-09 07:53:44UPUP
logo WhatCMS.org bot2025-09-07 13:23:02UP
logo LinqTo.me2025-09-06 10:29:12UP
logo 2GDPR bot2025-09-06 10:22:30UP
logo Stephan Kopp bot2025-09-06 10:19:28UP
logo Tools4noobs.com Spider2025-09-06 10:18:38UP
logo ContentKing2025-09-06 09:59:30UPUP
logo DYNO Mapper2025-09-06 09:32:10UP
logo wowLink Crawler2025-09-06 07:06:15UP
logo allOrigins2025-09-06 06:43:13UPUP
logo wmtips.com2025-09-06 06:42:01UPUP
logo Proxyscotch2025-09-06 06:40:33UPUP
logo MergadoBot2025-09-06 06:38:54UPUP
logo Seo Servis2025-09-05 06:23:33UPUP
logo Grabify.link2025-09-05 06:21:18UPUP
logo PowerMapper Crawler2025-09-05 06:07:16UP
logo remove.bg2025-09-05 05:59:17UPUP
logo ImageFetcher2025-09-05 05:52:30UPUP
logo WebSniffer2025-09-05 05:43:24UPUP
logo hstspreload.org bot2025-09-05 04:40:12UPUP
logo Structured Data Markup Helper2025-09-05 04:40:12UPUP
logo github-camo2025-09-05 03:32:50UPUP
logo Spideraf-Bot2025-09-02 05:53:15UP
logo Mediumbot2025-09-01 16:20:10UP
logo alyze.com bot2025-08-24 17:47:39UPUP
logo SSL Labs2025-08-24 17:45:44UPUP
logo Ezgif2025-08-24 15:50:40UPUP
logo Schema-Markup-Validator2025-08-24 15:50:30UPUP
logo TestURI crawler2025-08-24 15:50:29UP
logo historious2025-08-24 15:50:29UPUP
logo KeyCDN bot2025-08-24 15:50:27UPUP
logo Google-InspectionTool2025-08-24 15:49:59UPUP
logo PWABuilder2025-08-24 15:49:44UPUP
logo GoodBarber2025-08-24 15:49:30UP
logo Opengraph.io bot2025-08-24 15:49:07UP
logo Feed Image Audit2025-08-24 11:01:35UPUP
logo opengeofeed.org crawler2025-08-24 11:00:29UPUP
logo WhatsMyIP.org2025-08-24 10:55:00UPUP
logo Deskyobot2025-08-24 10:46:24UPUP
logo LastModBot2025-08-24 10:44:11UPUP
logo Wheregoes bot2025-08-24 10:43:16UPUP
logo EasyBib crawler2025-08-24 10:41:16UPUP
logo Unshorten.It2025-08-24 10:40:18UPUP
logo PDF24 crawler2025-08-24 10:32:32UPUP
logo globalping bot2025-08-23 17:17:25UPUP
logo IPLoggerBot2025-08-01 09:26:16UPUP
logo s4a2025-07-16 03:37:34UP
logo cron-job.org2025-07-16 02:00:45UP
logo MxToolbox bot2025-07-15 17:25:48UP
logo Online Domain Tools2025-07-03 03:56:00UP
logo BoardReader crawler2025-06-20 16:53:11UP
logo Protopage2025-05-26 08:30:48UP
logo Netpeak bot2025-05-13 18:33:04UPUP
logo Apidog2025-05-06 09:46:03UP
logo magereport2025-04-16 14:42:07UPUP
logo GoogleDocs2025-04-15 09:40:46UPUP
logo t3versionsBot2025-04-03 05:40:21UPUP
logo Wappalyzer2025-03-20 08:07:53UPUP
logo DuckDuckBot2025-03-15 21:00:58UPUP
logo Riddlerbot2025-03-10 19:36:45UPUP
logo Google AppsViewer2025-03-07 18:06:58UPUP
logo Yandex.Webmaster2025-02-17 02:08:52UPUP
logo SenutoBot2025-02-11 12:06:21UP
logo Workona bot2025-02-11 06:22:21UP
logo Domains Project bot2025-01-26 14:26:48UPUP

Maybe inactive robots (One year we have not heard about them)
logo Google Apps Script2024-11-18 18:53:40UPUP
logo Camo Asset Proxy2024-11-03 11:31:35UPUP
logo ivre-masscan2024-09-06 15:19:06UPUP
logo Monsidobot2024-09-04 02:57:13UPUP
logo kazbtbot2024-09-03 07:35:52UPUP
logo PrintFriendly.com2024-09-03 07:35:52UPUP
logo hCardValidator2024-09-03 07:35:52UPUP
logo semaltbot2024-08-27 20:18:46UP
logo RSiteAuditor2024-08-07 04:28:50UPUP
logo Bad-Neighborhood2024-06-29 19:04:02UP
logo Wikipedia Citoid2024-05-16 15:55:03UPUP
logo archive-org_bot2024-05-07 05:08:04UPUP
logo PulnoBot2023-09-26 05:26:11UPUP
logo Morningscore Bot2023-09-11 11:06:27UP
logo ImageOptim2023-09-11 10:38:18UPUP
logo XML Sitemaps Generator2023-09-09 10:55:57UPUP
logo cg-eye2023-09-09 10:49:44UP
logo Pro Sitemaps Generator2023-06-24 10:54:12UPUP
logo Indiwtf2023-06-19 16:28:30UPUP
logo adstxtlab.com Crawler2023-06-06 05:20:51UP
logo Feedly2023-05-02 18:21:56UPUP
logo hosterstats newgtld2023-04-28 03:57:30UPUP
logo URIBOT2023-04-24 10:01:26UPUP
logo GoogleSites2023-03-30 10:29:40UPUP
logo PANDORA bot2023-03-05 12:31:22UPUP
logo Webcron.org crawler2023-01-04 01:05:14UP
logo GetProxi.es-bot2022-11-05 07:42:24UPUP
logo LeaveMeAloneBot2022-11-01 01:33:41UPUP
logo Hexometer.com crawler2022-10-17 15:58:26UPUP
logo Netzweck bot2022-09-28 20:28:39UPUP
logo CloudFlare-AlwaysOnline2022-09-27 21:06:22UPUP
logo EasyCron2022-09-01 15:09:03UP
logo Ghost Inspector2022-08-29 14:11:43UPUP
logo i4a.pl bot2022-05-20 09:27:48UPUP
logo Convertify2022-05-01 08:20:00UP
logo Robots_Tester2022-04-16 04:50:56UP
logo Taringa2022-04-15 03:36:11DownUP
logo Jeffrey Exif Viewer2022-02-28 21:41:46UPUP
logo TomBot2022-02-24 17:05:57UPUP
logo Sniply2022-02-21 12:25:18UPUP
logo cloudimage.io2022-01-30 06:55:04UPUP
logo Naver Scrap2022-01-20 08:19:04UPUP
logo RankMath bot2022-01-11 18:32:28UP
logo Cloudflare SpeedTest2022-01-04 16:12:20UPUP
logo Scribbr Bot2021-12-19 11:16:14UP
logo AFB2021-11-29 10:56:43UP
logo Punkspider2021-11-28 07:20:30UPUP
logo SpyOnWeb2021-09-30 19:46:31UP
logo SpotiboBot2021-09-03 20:28:40UP
logo AdAuth2021-08-24 16:56:31UP
logo GpcSupBot2021-07-18 12:45:29UPUP
logo SecurityBot2021-05-04 02:23:17UPUP
logo Bitextor2021-04-14 04:23:23UPUP
logo Page Analyzer2021-03-21 06:26:36UP
logo ddline.cn crawler2021-01-05 05:07:12UP
logo Google AMP crawler2021-01-04 18:09:28UPUP
logo NinjaBot2020-11-07 05:36:22UP
logo infohound.net crawler2020-10-27 10:21:24UPUP
logo Statically crawler2020-10-11 09:11:25UPUP
logo XmlSitemapGenerator2020-10-06 09:32:29UP
logo Pearltrees2020-10-06 09:32:29UPUP
logo XML Schema Validator2020-10-06 09:01:51UPUP
logo Website-audit.be Crawler2020-09-25 17:38:53UP
logo Filestack2020-09-15 07:19:28UPUP
logo TripleCheckerRobot2020-08-27 09:43:08UP
logo Browsershots2020-08-14 09:58:16UPUP
logo Site24x72020-07-23 05:44:03UPUP
logo link_thumbnailer2020-07-19 05:58:16UPUP
logo StatOnlineRuBot2020-05-14 03:06:25UPUP
logo SnapSearch2020-04-28 08:12:09UPUP
logo SetCronJob2020-04-09 18:48:04UPUP
logo PrivacyScore.org crawler2020-03-24 09:22:31UPUP
logo linkgraph.io crawler2020-03-14 07:44:31UP
logo CrawlForMe2020-03-01 12:24:25UPUP
logo ROR Sitemap Generator2020-02-07 09:12:18UP
logo iodc crawler2020-02-03 15:50:51UP
logo NameFo2020-01-26 14:52:33UP
logo WormlyBot2019-10-23 09:31:12UP
logo faviconkit2019-10-13 18:18:49UPUP
logo bingbot2019-09-13 19:23:03UPUP
logo DIGMATO.com crawler2019-09-09 13:33:29UPUP
logo GoSquared2019-08-11 08:52:52UP
logo ssl-tools.net2019-08-10 16:10:03UPUP
logo Genieo Web filter2019-05-20 16:42:02UPUP
logo probethenet.com scanner2019-05-16 01:10:36UP
logo WWRanks.com crawler2019-05-09 03:50:36UP
logo RankingBot2019-04-29 03:03:03UPUP
logo Favicon2019-04-25 06:31:31UPDown
logo htmlyse crawler2019-04-08 10:33:45UP
logo GoogleBot2019-03-27 09:35:44UPUP
logo northcutt.com crawler2019-03-26 11:34:16UPUP
logo HeartRailsBot2019-03-08 11:09:06UP
logo Check-Domains.com bot2018-12-23 07:43:12UP
logo Page Valet2018-12-05 10:10:34UP
logo FoundSeoTool2018-11-24 05:46:52UP
logo RankFlex.com Webspider2018-09-07 18:36:06UP
logo iThemes crawler2018-08-24 09:12:42UP
logo webhint crawler2018-06-07 18:37:27UP
logo SurveyBot2018-03-24 01:23:47UP
logo TcpTools Bot2018-03-16 07:25:04UPUP
logo Office 365 viewer2017-10-13 08:44:31UPUP
logo netk6 crawler2017-08-09 06:47:30DownUP
logo cuwhois2017-07-01 20:23:22UP
logo CSIRT.CZ crawler2017-06-29 08:38:50UPUP
logo 0xFF Domain Crawler2017-06-26 02:42:20Down
logo pdffillerbot2017-06-19 19:25:51UP
logo Mozilla Metadata Service2017-06-09 15:11:27UPUP
logo GIDBot2017-05-29 17:22:54UP
logo DIY-SEOBot2017-05-24 12:21:39DownUP
logo Whoiswebsitebot2017-04-08 05:53:34UP
logo SBA Research bot2017-01-19 04:47:17UPUP
logo Google-HotelAdsVerifier2017-01-01 16:26:28UPUP
logo HootSuite crawler2016-09-17 04:15:21UP
logo Audisto Crawler2016-08-24 16:25:42UPUP
logo WordPress.com bots2016-07-19 03:47:24UP
logo Siteimprove.com bot2016-01-11 03:42:51UP

Historical (Old robots, Inactive cravlers)
logo Google-Structured-Data-Testing-Tool 2025-04-09 18:30:57DownUP
logo httpcheck2024-09-03 07:21:03DownUP
logo Is it up2023-12-16 11:16:01DownDown
logo GAChecker2023-09-09 10:09:52DownDown
logo Closure Compiler Service2023-08-10 08:08:37DownUP
logo Prerender.cloud2022-06-06 09:04:16Down
logo r0.cz crawler2022-06-06 08:55:46UPDown
logo YP crawler2022-04-05 07:35:27UP
logo IPLogger Crawler2022-02-24 17:05:57UP
logo DNS-Tools Header-Analyzer2022-02-24 17:05:57DownUP
logo SimplyFast.info2022-02-24 17:05:57DownUP
logo DareBoost2022-02-21 20:42:56UP
logo metaforensics.io2022-02-21 20:42:44Down
logo sniptracker2022-02-21 20:17:38DownUP
logo WURFL ImageEngine2022-01-30 06:10:06UPUP
logo GetLinkInfo.com2021-09-19 08:37:54Down
logo URLitor.com2021-08-04 05:31:49DownUP
logo w3dt.net crawler2021-08-04 05:30:45DownUP
logo CronDroid2021-08-04 04:36:08Down
logo RUB crawler2021-04-25 03:21:47DownUP
logo Web Manifest Validator2021-04-15 04:26:31DownUP
logo Http2Bot2021-04-15 04:26:17DownUP
logo WhoAPI2021-01-15 04:51:44UP
logo ipv6-test.com validator2020-11-30 13:09:13Down
logo WebCookies2020-10-07 23:56:11DownUP
logo BrowserSpyBot2020-09-15 07:16:27Down
logo OpenGraphCheck2020-07-06 14:15:44DownUP
logo showsite crawler2020-05-28 04:07:22Down
logo Geek-Tools2020-01-15 03:26:17Down
logo hosterstats com2019-06-25 22:01:40DownUP
logo SiteExplorer2019-05-18 12:31:46DownDown
logo ExtLinksBot2019-05-17 21:02:18DownDown
logo Adstxtaggregator.com2019-05-02 08:29:11UPUP
logo Everyonedomainsbot2019-03-28 20:43:09Down
logo LongURL2018-12-08 07:23:09DownUP
logo wf_crawler2018-12-05 10:10:34Down
logo richardstoolbox crawler2018-12-01 08:24:28DownDown
logo SiteXY Webmaster tools2018-11-13 08:13:39Down
logo SputnikBot2018-07-23 10:54:10DownUP
logo SEO Browser2018-07-14 08:45:19DownUP
logo topster_de-crawler2018-06-13 14:26:48UP
logo seocharger-robot2018-04-19 08:53:36DownDown
logo wscheck.com2018-02-09 12:39:38Down
logo Web-sniffer.me/1.0.02018-02-09 11:05:43DownDown
logo HTTP-Header-Abfrage2017-10-23 06:44:30Down
logo Web-sniffer2017-08-07 14:14:12DownUP
logo ganarvisitas2017-07-01 19:50:33Down
logo Scrubby2017-06-19 14:11:21UPUP
logo ghostery bot2017-06-18 11:21:10UP
logo GC3pro2017-05-29 16:02:19Down
logo metacdn2017-03-03 14:05:20UP
logo Untiny2017-03-03 12:50:50DownUP
logo NeutrinoAPI2017-01-08 07:25:39UP
logo Whibse2016-08-24 15:21:05UP
logo MetaCommentBot2016-06-09 11:12:02Down
logo WP Engine2016-04-16 15:29:53UP
logo ResponseCodeTest2016-03-09 07:59:10Down
logo seo-nastroj.cz2015-11-25 11:40:46Down
logo SEOCentro bot2015-11-03 10:25:02UP
logo make.myUrl2015-10-07 13:01:33Down
logo Whoismindbot2015-09-01 15:21:11UPUP
logo Yahoo!2010-01-05 19:09:55UPUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.