Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo cron-job.org2021-09-24 15:01:08UP
logo MxToolbox bot2021-09-24 14:57:14UP
logo Chrome-Lighthouse2021-09-24 13:37:13UPUP
logo monitorbacklinks.com bot2021-09-24 13:26:43UPUP
logo TextRazor crawler2021-09-24 10:40:18UP
logo BuiltWith crawler2021-09-24 09:14:30UPUP
logo s4a2021-09-24 06:13:32UP
logo Photon2021-09-24 05:55:19UPUP
logo Google Read Aloud2021-09-24 05:53:12UPUP
logo masscan2021-09-24 05:49:05UP
logo DuckDuckBot2021-09-24 05:20:09UPUP
logo Googlebot2021-09-24 05:18:05UPUP
logo censys.io crawler2021-09-24 04:33:07UPUP
logo Cronless2021-09-23 22:42:24UP
logo WellKnownBot2021-09-23 16:51:57UPUP
logo CloudFlare-AlwaysOnline2021-09-23 06:43:55UPUP
logo ImageFetcher2021-09-23 06:06:03UPUP
logo updown.io bot2021-09-22 21:55:00UPUP
logo GoogleAssociationService2021-09-22 10:05:17UPUP
logo Prerender2021-09-22 09:41:33UPUP
logo Hexometer.com crawler2021-09-22 06:08:29UPUP
logo adstxtlab.com Crawler2021-09-21 09:17:53UP
logo YandexBot2021-09-21 08:09:03UPUP
logo Protopage2021-09-20 14:54:21UP
logo letsencrypt bot2021-09-20 06:08:18UP
logo hCardValidator2021-09-19 08:42:37UPUP
logo wowLink Crawler2021-09-19 08:42:09UP
logo WebSniffer2021-09-19 08:41:38UPUP
logo sniptracker2021-09-19 08:41:04UPUP
logo Check-Host2021-09-19 08:39:47UP
logo GetLinkInfo.com2021-09-19 08:37:54UP
logo Deskyobot2021-09-19 07:12:34UPUP
logo GoogleDocs2021-09-19 05:22:41UPUP
logo Naver Scrap2021-09-17 11:25:23UPUP
logo Wappalyzer2021-09-17 07:57:59UPUP
logo DomainStatsBot2021-09-16 04:13:39UPUP
logo Wheregoes bot2021-09-10 08:31:45UPUP
logo cloudimage.io2021-09-10 08:31:43UPUP
logo Ghost Inspector2021-09-09 12:56:34UPUP
logo PowerMapper Crawler2021-09-08 09:49:31UP
logo SpyOnWeb2021-09-06 04:28:14UP
logo WhatCMS.org bot2021-09-04 14:32:47UP
logo SpotiboBot2021-09-03 20:28:40UP
logo archive.org_bot2021-09-01 05:38:45UPUP
logo CastFeedValidator2021-08-31 06:50:45UPUP
logo KeyCDN bot2021-08-31 05:03:56UPUP
logo Prerender.cloud2021-08-31 05:03:47UP
logo Unshorten.It2021-08-31 05:03:47UPUP
logo r0.cz crawler2021-08-31 05:03:46UPDown
logo REDbot2021-08-31 05:03:46UPUP
logo EasyBib crawler2021-08-31 05:03:46UPUP
logo SiteCheckerBot2021-08-31 05:03:46UPUP
logo metaforensics.io2021-08-31 05:03:41UP
logo Yandex.Webmaster2021-08-31 05:03:40UPUP
logo remove.bg2021-08-31 05:03:40UPUP
logo Is it up2021-08-31 05:03:40UPDown
logo Seo Servis2021-08-31 05:03:40UPUP
logo bitlybot2021-08-24 17:26:36UP
logo AdAuth2021-08-24 16:56:31UP
logo imgproxy2021-08-20 16:03:41UPUP
logo Seobility2021-08-18 09:02:23UPUP
logo Punkspider2021-08-11 01:54:22UPUP
logo Bad-Neighborhood2021-08-06 03:01:51UP
logo cg-eye2021-08-04 05:40:46UP
logo DNS-Tools Header-Analyzer2021-08-04 05:32:22UPUP
logo URLitor.com2021-08-04 05:31:49UPUP
logo w3dt.net crawler2021-08-04 05:30:45UPUP
logo PrintFriendly.com2021-08-04 05:28:21UP
logo MB-SiteCrawler2021-08-04 05:22:59UPUP
logo SimplyFast.info2021-08-04 05:20:57UPUP
logo Jeffrey Exif Viewer2021-08-04 05:09:15UPUP
logo TestURI crawler2021-08-04 05:08:30UP
logo GAChecker2021-08-04 05:05:22UPUP
logo MergadoBot2021-08-04 05:04:38UP
logo DareBoost2021-08-04 04:57:27UP
logo CronDroid2021-08-04 04:36:08UP
logo wmtips.com2021-07-21 22:58:49UPUP
logo alyze.com bot2021-07-20 05:14:52UPUP
logo github-camo2021-07-20 05:12:09UPUP
logo WGETbot2021-07-20 05:11:15UPUP
logo Google Apps Script2021-07-19 20:06:35UPUP
logo GpcSupBot2021-07-18 12:45:29UPUP
logo Webcron.org crawler2021-07-07 13:30:06UP
logo Opengraph.io bot2021-07-01 06:15:11UPUP
logo kazbtbot2021-07-01 06:15:11UPUP
logo Scribbr Bot2021-06-18 07:23:08UP
logo EasyCron2021-05-28 01:48:04UP
logo Netpeak bot2021-05-24 23:33:56UPUP
logo Robots_Tester2021-05-20 07:05:17UP
logo OrgProbe2021-05-15 04:55:13UPUP
logo ivre-masscan2021-05-11 22:14:11UPUP
logo historious2021-05-05 06:54:29UPUP
logo IPLogger Crawler2021-05-05 06:52:36UP
logo RobotsChecker2021-05-05 06:36:08UPUP
logo SecurityBot2021-05-04 02:23:17UPUP
logo BoardReader crawler2021-05-02 09:47:48UP
logo Cloudflare SpeedTest2021-05-01 05:49:50UPUP
logo AFB2021-04-27 16:20:21UP
logo RUB crawler2021-04-25 03:21:47UPUP
logo Web Manifest Validator2021-04-15 04:26:31UPUP
logo Http2Bot2021-04-15 04:26:17UPUP
logo Bitextor2021-04-14 04:23:23UPUP
logo TomBot2021-04-07 11:55:59UPUP
logo Google-Structured-Data-Testing-Tool 2021-04-01 14:25:09UPUP
logo WURFL ImageEngine2021-03-21 06:28:29UP
logo Page Analyzer2021-03-21 06:26:36UP
logo Closure Compiler Service2021-03-08 12:48:20UPUP
logo Structured Data Markup Helper2021-03-08 12:48:19UPUP
logo GoogleSites2021-03-08 12:46:59UPUP
logo RocketValidator crawler2021-03-03 09:35:34UPUP
logo PANDORA bot2021-02-28 19:59:19UPUP
logo Domains Project bot2021-02-26 06:14:06UPUP
logo Taringa2021-02-22 04:40:04DownUP
logo Mediumbot2021-01-25 18:02:22UP
logo WhoAPI2021-01-15 04:51:44UP
logo ddline.cn crawler2021-01-05 05:07:12UP
logo Google AMP crawler2021-01-04 18:09:28UPUP
logo DYNO Mapper Crawler2020-12-16 17:24:18UP
logo ipv6-test.com validator2020-11-30 13:09:13UP
logo SSL Labs2020-11-21 05:38:06UPUP
logo PulnoBot2020-11-12 06:33:03UPUP
logo NinjaBot2020-11-07 05:36:22UP
logo ImageOptim2020-11-04 09:34:12UPUP
logo infohound.net crawler2020-10-27 10:21:24UPUP
logo Riddlerbot2020-10-22 16:47:36UPUP
logo Google Cloud AI2020-10-19 17:23:41UPUP
logo Statically crawler2020-10-11 09:11:25UP
logo Stephan Kopp bot2020-10-06 09:52:04UP
logo Tools4noobs.com Spider2020-10-06 09:50:13UP
logo Wikipedia Citoid2020-10-06 09:32:54UPUP
logo Cronjob.de bot2020-10-06 09:32:31UPUP
logo XML Sitemaps Generator2020-10-06 09:32:30UP
logo RSiteAuditor2020-10-06 09:32:30UPUP
logo Pearltrees2020-10-06 09:32:29UPUP
logo XmlSitemapGenerator2020-10-06 09:32:29UP
logo XML Schema Validator2020-10-06 09:01:51UPUP
logo Website-audit.be Crawler2020-09-25 17:38:53UP

Maybe inactive robots (One year we have not heard about them)
logo 2GDPR bot2020-09-15 15:06:49UP
logo Filestack2020-09-15 07:19:28UP
logo BrowserSpyBot2020-09-15 07:16:27UP
logo TripleCheckerRobot2020-08-27 09:43:08UP
logo Browsershots2020-08-14 09:58:16UPUP
logo Site24x72020-07-23 05:44:03UPUP
logo link_thumbnailer2020-07-19 05:58:16UPUP
logo StatOnlineRuBot2020-05-14 03:06:25UPUP
logo SnapSearch2020-04-28 08:12:09UPUP
logo SetCronJob2020-04-09 18:48:04UPUP
logo Feedly2020-04-08 15:07:07UPUP
logo ContentKing2020-03-30 03:16:23UPUP
logo Naver scrapbook2020-03-26 07:30:14UPUP
logo PrivacyScore.org crawler2020-03-24 09:22:31UPUP
logo LinqTo.me2020-03-16 07:51:41UP
logo linkgraph.io crawler2020-03-14 07:44:31UP
logo CrawlForMe2020-03-01 12:24:25UPUP
logo Online Domain Tools2020-02-23 12:05:19UP
logo ROR Sitemap Generator2020-02-07 09:12:18UP
logo Grabify.link2020-02-06 08:06:55UPUP
logo iodc crawler2020-02-03 15:50:51UP
logo NameFo2020-01-26 14:52:33UP
logo WormlyBot2019-10-23 09:31:12UP
logo YP crawler2019-10-22 10:36:56UP
logo Google AppsViewer2019-10-13 21:28:27UPUP
logo faviconkit2019-10-13 18:18:49UPUP
logo bingbot2019-09-13 19:23:03UPUP
logo DIGMATO.com crawler2019-09-09 13:33:29UPUP
logo GoSquared2019-08-11 08:52:52UP
logo ssl-tools.net2019-08-10 16:10:03UPUP
logo Genieo Web filter2019-05-20 16:42:02UPUP
logo probethenet.com scanner2019-05-16 01:10:36UP
logo WWRanks.com crawler2019-05-09 03:50:36UP
logo RankingBot2019-04-29 03:03:03UPUP
logo Favicon2019-04-25 06:31:31UPDown
logo htmlyse crawler2019-04-08 10:33:45UP
logo GoogleBot2019-03-27 09:35:44UPUP
logo northcutt.com crawler2019-03-26 11:34:16UPUP
logo HeartRailsBot2019-03-08 11:09:06UP
logo Check-Domains.com bot2018-12-23 07:43:12UP
logo Page Valet2018-12-05 10:10:34UP
logo FoundSeoTool2018-11-24 05:46:52UP
logo RankFlex.com Webspider2018-09-07 18:36:06UP
logo iThemes crawler2018-08-24 09:12:42UP
logo webhint crawler2018-06-07 18:37:27UP
logo SurveyBot2018-03-24 01:23:47UP
logo TcpTools Bot2018-03-16 07:25:04UPUP
logo Office 365 viewer2017-10-13 08:44:31UPUP
logo hosterstats newgtld2017-10-07 10:02:45UPUP
logo netk6 crawler2017-08-09 06:47:30DownUP
logo Monsidobot2017-07-06 09:26:22DownUP
logo cuwhois2017-07-01 20:23:22UP
logo CSIRT.CZ crawler2017-06-29 08:38:50UPUP
logo 0xFF Domain Crawler2017-06-26 02:42:20Down
logo pdffillerbot2017-06-19 19:25:51UP
logo Mozilla Metadata Service2017-06-09 15:11:27UPUP
logo GIDBot2017-05-29 17:22:54UP
logo DIY-SEOBot2017-05-24 12:21:39DownUP
logo Whoiswebsitebot2017-04-08 05:53:34UP
logo MS Cognitive Services2017-03-28 08:17:07UP
logo SBA Research bot2017-01-19 04:47:17UPUP
logo Google-HotelAdsVerifier2017-01-01 16:26:28UPUP
logo HootSuite crawler2016-09-17 04:15:21UP
logo Audisto Crawler2016-08-24 16:25:42UPUP
logo WordPress.com bots2016-07-19 03:47:24UP
logo Siteimprove.com bot2016-01-11 03:42:51UP

Historical (Old robots, Inactive cravlers)
logo WebCookies2020-10-07 23:56:11DownUP
logo OpenGraphCheck2020-07-06 14:15:44DownUP
logo showsite crawler2020-05-28 04:07:22Down
logo Geek-Tools2020-01-15 03:26:17Down
logo hosterstats com2019-06-25 22:01:40DownUP
logo SiteExplorer2019-05-18 12:31:46DownDown
logo ExtLinksBot2019-05-17 21:02:18DownDown
logo Adstxtaggregator.com2019-05-02 08:29:11UPUP
logo Everyonedomainsbot2019-03-28 20:43:09Down
logo LongURL2018-12-08 07:23:09DownUP
logo wf_crawler2018-12-05 10:10:34Down
logo richardstoolbox crawler2018-12-01 08:24:28DownDown
logo SiteXY Webmaster tools2018-11-13 08:13:39Down
logo SputnikBot2018-07-23 10:54:10DownUP
logo SEO Browser2018-07-14 08:45:19DownUP
logo topster_de-crawler2018-06-13 14:26:48UP
logo seocharger-robot2018-04-19 08:53:36DownDown
logo wscheck.com2018-02-09 12:39:38Down
logo Web-sniffer.me/1.0.02018-02-09 11:05:43DownDown
logo HTTP-Header-Abfrage2017-10-23 06:44:30Down
logo Web-sniffer2017-08-07 14:14:12DownUP
logo ganarvisitas2017-07-01 19:50:33Down
logo Scrubby2017-06-19 14:11:21UPUP
logo ghostery bot2017-06-18 11:21:10UP
logo WhatsMyIP.org2017-05-29 17:25:35DownDown
logo GC3pro2017-05-29 16:02:19Down
logo metacdn2017-03-03 14:05:20UP
logo Untiny2017-03-03 12:50:50DownUP
logo NeutrinoAPI2017-01-08 07:25:39UP
logo Whibse2016-08-24 15:21:05UP
logo GetProxi.es-bot2016-07-22 07:25:58DownDown
logo MetaCommentBot2016-06-09 11:12:02Down
logo WP Engine2016-04-16 15:29:53UP
logo ResponseCodeTest2016-03-09 07:59:10UP
logo seo-nastroj.cz2015-11-25 11:40:46Down
logo SEOCentro bot2015-11-03 10:25:02UP
logo make.myUrl2015-10-07 13:01:33Down
logo Whoismindbot2015-09-01 15:21:11UPUP
logo Yahoo!2010-01-05 19:09:55UPUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.