Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo cron-job.org2019-11-12 20:01:11UP
logo monitorbacklinks.com bot2019-11-12 19:43:40UPUP
logo GetLinkInfo.com2019-11-12 18:41:30UP
logo REDbot2019-11-12 18:39:54UPUP
logo github-camo2019-11-12 18:39:12UPUP
logo TomBot2019-11-12 18:37:30UPUP
logo Prerender2019-11-12 18:36:33UP
logo OpenGraphCheck2019-11-12 18:24:15UPUP
logo Google Read Aloud2019-11-12 17:27:09UPUP
logo Taringa2019-11-12 16:58:35UP
logo Google-Structured-Data-Testing-Tool 2019-11-12 16:03:30UPUP
logo Googlebot2019-11-12 14:42:53UPUP
logo CloudFlare crawler2019-11-12 12:47:25UPUP
logo Photon2019-11-12 12:03:16UPUP
logo TextRazor crawler2019-11-12 10:14:13UP
logo DuckDuckBot2019-11-12 09:30:56UPUP
logo Ghost Inspector2019-11-12 07:13:21UPUP
logo masscan2019-11-12 06:16:58UP
logo s4a2019-11-12 06:16:24UP
logo WhoAPI2019-11-12 04:49:04UP
logo CronDroid2019-11-11 22:37:54UP
logo Cronless2019-11-11 21:47:09UP
logo DomainStatsBot2019-11-11 17:39:21UPUP
logo bitlybot2019-11-09 11:33:58UP
logo RobotsChecker2019-11-07 07:20:25UPUP
logo OrgProbe2019-11-07 07:20:25UPUP
logo kazbtbot2019-11-05 14:34:36UPUP
logo URLitor.com2019-11-05 06:59:16UPUP
logo Filestack2019-11-05 06:20:26UP
logo TestURI crawler2019-11-05 06:02:37UP
logo link_thumbnailer2019-11-05 06:02:02UPUP
logo Wappalyzer2019-11-04 09:33:28UPUP
logo GAChecker2019-11-04 08:00:16UPUP
logo iodc crawler2019-11-04 06:22:47UP
logo Deskyobot2019-11-04 04:50:58UPUP
logo letsencrypt bot2019-11-02 01:04:26UP
logo archive.org_bot2019-10-31 07:39:46UPUP
logo Netpeak bot2019-10-31 07:39:22UPUP
logo YandexBot2019-10-29 04:57:52UPUP
logo Yandex.Webmaster2019-10-29 04:57:26UPUP
logo WURFL ImageEngine2019-10-29 03:53:51UP
logo adstxtlab.com Crawler2019-10-29 01:44:47UP
logo AdAuth2019-10-28 10:34:08UP
logo GoogleDocs2019-10-25 11:00:22UPUP
logo PowerMapper Crawler2019-10-24 11:20:59UP
logo DareBoost2019-10-24 10:35:38UP
logo WormlyBot2019-10-23 09:31:12UP
logo KeyCDN bot2019-10-23 09:21:26UPUP
logo YP crawler2019-10-22 10:36:56UP
logo updown.io bot2019-10-21 11:31:04UPUP
logo SiteCheckerBot2019-10-21 09:53:53UPUP
logo w3dt.net crawler2019-10-21 09:53:51UPUP
logo BoardReader crawler2019-10-21 06:41:11UP
logo Mergadobot2019-10-19 09:12:04UP
logo Geek-Tools2019-10-16 16:52:25UP
logo DNS-Tools Header-Analyzer2019-10-14 10:58:11UPUP
logo Unshorten.It2019-10-14 10:56:43UPUP
logo ipv6-test.com validator2019-10-14 10:55:51UP
logo Seo Servis2019-10-14 10:54:06UPUP
logo WebSniffer2019-10-14 08:58:26UPUP
logo Check-Host2019-10-14 08:55:24UP
logo SnapSearch2019-10-14 08:54:55UPUP
logo alyze.info2019-10-13 22:15:52UPUP
logo WGETbot2019-10-13 22:15:27UPUP
logo Jeffrey Exif Viewer2019-10-13 22:15:01UPUP
logo Google AppsViewer2019-10-13 21:28:27UPUP
logo ImageFetcher2019-10-13 20:09:35UPUP
logo RSiteAuditor2019-10-13 18:18:49UPUP
logo faviconkit2019-10-13 18:18:49UPUP
logo Is it up2019-10-13 18:18:49UPUP
logo Seobility2019-10-02 17:14:37UPUP
logo Hexometer.com crawler2019-10-02 07:46:43UPUP
logo Google AMP crawler2019-10-02 07:43:12UPUP
logo Naver scrapbook2019-09-30 14:48:03UPUP
logo WhatCMS.org bot2019-09-30 08:17:46UP
logo Riddlerbot2019-09-24 06:43:05UPUP
logo SetCronJob2019-09-20 21:39:07UPUP
logo Webcron.org crawler2019-09-20 00:50:02UP
logo EasyCron2019-09-17 02:03:03UP
logo bingbot2019-09-13 19:23:03UPUP
logo Prerender.cloud2019-09-09 15:51:22UP
logo historious2019-09-09 15:50:30UPUP
logo hCardValidator2019-09-09 15:17:33UPUP
logo WebCookies2019-09-09 13:56:24UPUP
logo DIGMATO.com crawler2019-09-09 13:33:29UPUP
logo sniptracker2019-09-09 13:33:22UPUP
logo Protopage2019-09-09 07:10:41UP
logo SSL Labs2019-09-06 07:29:58UPUP
logo MB-SiteCrawler2019-09-04 07:18:45UPUP
logo Web Manifest Validator2019-09-04 07:18:44UPUP
logo Bad-Neighborhood2019-08-29 09:31:11UP
logo SimplyFast.info2019-08-28 10:33:16UPUP
logo Pearltrees2019-08-28 10:28:02UPUP
logo GoogleSites2019-08-21 11:55:32UPUP
logo Browsershots2019-08-21 11:44:07UPUP
logo CastFeedValidator2019-08-21 11:36:22UPUP
logo EasyBib crawler2019-08-21 10:04:18UP
logo Closure Compiler Service2019-08-21 10:04:12UPUP
logo BrowserSpyBot2019-08-21 10:04:12UP
logo wmtips.com2019-08-18 10:49:33UPUP
logo XmlSitemapGenerator2019-08-18 09:22:54UP
logo PrintFriendly.com2019-08-15 13:03:00UP
logo ddline.cn crawler2019-08-11 09:43:19UP
logo GoSquared2019-08-11 08:52:52UP
logo Tools4noobs.com Spider2019-08-10 17:35:14UP
logo Mediumbot2019-08-10 17:28:40UP
logo Robots_Tester2019-08-10 16:21:57UP
logo ssl-tools.net2019-08-10 16:10:03UPUP
logo PrivacyScore.org crawler2019-08-10 15:50:45UPUP
logo Structured Data Markup Helper2019-08-06 10:38:48UPUP
logo Stephan Kopp bot2019-08-05 13:14:59UP
logo Google Cloud AI2019-08-02 07:14:53UPUP
logo NinjaBot2019-07-19 14:32:02UP
logo 2GDPR bot2019-07-17 07:38:34UP
logo Cronjob.de bot2019-07-07 10:29:52UPUP
logo ROR Sitemap Generator2019-07-07 08:32:21UP
logo hosterstats com2019-06-25 22:01:40UPUP
logo CrawlForMe2019-06-20 08:03:11UPUP
logo Online Domain Tools2019-06-20 07:57:45UP
logo XML Schema Validator2019-06-05 18:10:01UPUP
logo XML Sitemaps Generator2019-05-30 08:37:24UP
logo Genieo Web filter2019-05-20 16:42:02UPUP
logo SiteExplorer2019-05-18 12:31:46UPUP
logo ExtLinksBot2019-05-17 21:02:18UPUP
logo probethenet.com scanner2019-05-16 01:10:36UP
logo SpyOnWeb2019-05-11 02:28:12UP
logo WWRanks.com crawler2019-05-09 03:50:36UP
logo RankingBot2019-04-29 03:03:03UPUP
logo ContentKing2019-04-27 11:08:02UPUP
logo Favicon2019-04-25 06:31:31UPDown
logo htmlyse crawler2019-04-08 10:33:45UP
logo Everyonedomainsbot2019-03-28 20:43:09UP
logo GoogleBot2019-03-27 09:35:44UPUP
logo northcutt.com crawler2019-03-26 11:34:16UPUP
logo HeartRailsBot2019-03-08 11:09:06UP
logo infohound.net crawler2019-01-04 08:04:06UPUP
logo cg-eye2018-12-27 10:08:49UP
logo Check-Domains.com bot2018-12-23 07:43:12UP
logo LongURL2018-12-08 07:23:09UP
logo Page Valet2018-12-05 10:10:34UP
logo FoundSeoTool2018-11-24 05:46:52UP

Maybe inactive robots (One year we have not heard about them)
logo RankFlex.com Webspider2018-09-07 18:36:06UP
logo iThemes crawler2018-08-24 09:12:42UP
logo topster_de-crawler2018-06-13 14:26:48UP
logo webhint crawler2018-06-07 18:37:27UP
logo Grabify.link2018-04-19 06:12:37UPUP
logo censys.io crawler2018-04-02 08:28:25UP
logo SurveyBot2018-03-24 01:23:47UP
logo TcpTools Bot2018-03-16 07:25:04UPUP
logo Office 365 viewer2017-10-13 08:44:31UPUP
logo hosterstats newgtld2017-10-07 10:02:45UPUP
logo netk6 crawler2017-08-09 06:47:30DownUP
logo Monsidobot2017-07-06 09:26:22DownUP
logo cuwhois2017-07-01 20:23:22UP
logo csirt.cz2017-06-29 08:38:50UP
logo 0xFF Domain Crawler2017-06-26 02:42:20UP
logo pdffillerbot2017-06-19 19:25:51UP
logo Mozilla Metadata Service2017-06-09 15:11:27UPUP
logo WhatsMyIP.org2017-05-29 17:25:35UPUP
logo GIDBot2017-05-29 17:22:54UP
logo Page Analyzer2017-05-29 16:12:36UP
logo DIY-SEOBot2017-05-24 12:21:39DownUP
logo Detectify bot2017-05-16 09:17:01UP
logo Whoiswebsitebot2017-04-08 05:53:34UP
logo MS Cognitive Services2017-03-28 08:17:07UP
logo metacdn2017-03-03 14:05:20UP
logo SBA Research bot2017-01-19 04:47:17UPUP
logo NeutrinoAPI2017-01-08 07:25:39UP
logo Google-HotelAdsVerifier2017-01-01 16:26:28UPUP
logo HootSuite crawler2016-09-17 04:15:21UP
logo Audisto Crawler2016-08-24 16:25:42UPUP
logo Whibse2016-08-24 15:21:05UP
logo WordPress.com bots2016-07-19 03:47:24UP
logo WP Engine2016-04-16 15:29:53UP
logo ResponseCodeTest2016-03-09 07:59:10UP
logo Siteimprove.com bot2016-01-11 03:42:51UP

Historical (Old robots, Inactive cravlers)
logo showsite crawler2019-11-10 06:10:06Down
logo Adstxtaggregator.com2019-05-02 08:29:11UPUP
logo wf_crawler2018-12-05 10:10:34Down
logo richardstoolbox crawler2018-12-01 08:24:28DownDown
logo SiteXY Webmaster tools2018-11-13 08:13:39Down
logo SputnikBot2018-07-23 10:54:10UPUP
logo SEO Browser2018-07-14 08:45:19DownUP
logo seocharger-robot2018-04-19 08:53:36DownDown
logo wscheck.com2018-02-09 12:39:38Down
logo Web-sniffer.me/1.0.02018-02-09 11:05:43DownDown
logo HTTP-Header-Abfrage2017-10-23 06:44:30Down
logo Web-sniffer2017-08-07 14:14:12DownUP
logo ganarvisitas2017-07-01 19:50:33Down
logo Scrubby2017-06-19 14:11:21UPUP
logo ghostery bot2017-06-18 11:21:10UP
logo GC3pro2017-05-29 16:02:19Down
logo Untiny2017-03-03 12:50:50DownUP
logo GetProxi.es-bot2016-07-22 07:25:58DownDown
logo MetaCommentBot2016-06-09 11:12:02Down
logo seo-nastroj.cz2015-11-25 11:40:46Down
logo SEOCentro bot2015-11-03 10:25:02UP
logo make.myUrl2015-10-07 13:01:33Down
logo Whoismindbot2015-09-01 15:21:11UPUP
logo Yahoo!2010-01-05 19:09:55UPUP
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.