Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo cron-job.org2019-03-24 08:30:57UP
logo Prerender2019-03-24 04:32:41UP
logo Googlebot2019-03-24 03:27:53UPUP
logo BCKLINKS2019-03-24 03:03:01UP
logo CronDroid2019-03-23 21:37:22UP
logo Ghost Inspector2019-03-23 18:07:22UPUP
logo Cronless2019-03-23 17:27:21UP
logo Google-speakr2019-03-23 08:27:34UP
logo s4a2019-03-23 08:10:12UP
logo masscan2019-03-23 04:33:46UP
logo archive.org_bot2019-03-22 12:17:16UPUP
logo Genieo Web filter2019-03-21 17:57:48UPUP
logo YandexBot2019-03-21 17:34:47UPUP
logo CloudFlare crawler2019-03-21 13:09:18UPUP
logo Photon2019-03-21 10:50:13UPUP
logo DuckDuckBot2019-03-20 13:49:25UPUP
logo updown.io bot2019-03-19 11:13:28UP
logo WGETbot2019-03-19 06:51:09UPUP
logo Wappalyzer2019-03-18 18:11:54UPUP
logo letsencrypt bot2019-03-18 04:32:15UP
logo WebSniffer2019-03-17 07:15:23UPUP
logo Adstxtaggregator.com2019-03-17 04:24:22UP
logo probethenet.com scanner2019-03-16 04:13:50UP
logo AdAuth2019-03-13 07:10:44UP
logo WebCookies2019-03-13 07:10:44UPUP
logo kazbtbot2019-03-13 07:10:44UPUP
logo Is it up2019-03-13 07:10:44UP
logo DareBoost2019-03-13 07:10:44UP
logo adstxtlab.com Crawler2019-03-13 07:10:43UP
logo sniptracker2019-03-13 06:08:27UPUP
logo GetLinkInfo.com2019-03-13 06:04:53UP
logo Seo Servis2019-03-13 06:03:52UPUP
logo DomainStatsBot2019-03-12 13:30:27UPUP
logo ImageFetcher2019-03-11 11:57:55UPUP
logo bitlybot2019-03-11 09:32:35UP
logo SiteCheckerBot2019-03-09 13:26:02UPUP
logo SimplyFast.info2019-03-09 01:28:06UP
logo RankingBot2019-03-08 17:53:45UPUP
logo HeartRailsBot2019-03-08 11:09:06UP
logo PowerMapper Crawler2019-03-08 10:56:04UP
logo Everyonedomainsbot2019-03-08 09:24:44UP
logo WWRanks.com crawler2019-03-07 17:20:04UP
logo Netpeak bot2019-03-07 12:42:58UPUP
logo Google-Structured-Data-Testing-Tool 2019-03-06 08:33:23UPUP
logo Structured Data Markup Helper2019-03-06 08:32:49UPUP
logo Google AMP crawler2019-03-06 08:32:15UPUP
logo ExtLinksBot2019-03-05 09:34:37UPUP
logo Online Domain Tools2019-03-03 07:39:05UP
logo Stephan Kopp bot2019-03-03 07:35:12UP
logo SnapSearch2019-03-03 07:34:27UPUP
logo Prerender.cloud2019-03-02 06:46:06UP
logo github-camo2019-03-02 06:43:21UPUP
logo Robots_Tester2019-02-28 11:19:55UP
logo Geek-Tools2019-02-20 07:20:18UP
logo wmtips.com2019-02-19 07:06:10UP
logo CrawlForMe2019-02-18 12:05:25UP
logo ipv6-test.com validator2019-02-18 10:10:08UP
logo Unshorten.It2019-02-18 09:38:56UPUP
logo URLitor.com2019-02-18 09:36:49UP
logo OrgProbe2019-02-16 17:11:05UPUP
logo MB-SiteCrawler2019-02-10 07:36:06UPUP
logo w3dt.net httphr2019-02-10 07:35:09UP
logo GAChecker2019-02-10 07:34:07UP
logo CastFeedValidator2019-02-10 07:33:39UPUP
logo historious2019-02-10 07:33:08UPUP
logo PrintFriendly.com2019-02-05 07:00:07UP
logo Bad-Neighborhood2019-02-05 06:58:46UP
logo Browsershots2019-02-05 05:59:33UPUP
logo Protopage2019-01-27 06:35:05UP
logo northcutt.com crawler2019-01-24 10:38:51UPUP
logo REDbot2019-01-24 08:54:42UPUP
logo XML Sitemaps Generator2019-01-24 08:13:31UP
logo Check-Host2019-01-24 07:56:05UP
logo TestURI crawler2019-01-24 07:54:18UP
logo EasyBib crawler2019-01-24 07:51:28UP
logo GoogleDocs2019-01-22 16:29:12UPUP
logo EasyCron2019-01-20 17:07:02UP
logo faviconkit2019-01-17 09:29:07UPUP
logo Pearltrees2019-01-13 11:03:10UPUP
logo Web Manifest Validator2019-01-13 11:00:23UPUP
logo XmlSitemapGenerator2019-01-13 10:50:33UP
logo Closure Compiler Service2019-01-13 08:53:45UPUP
logo Mergadobot2019-01-13 08:52:36UP
logo hCardValidator2019-01-13 08:48:48UPUP
logo BoardReader Favicon Fetcher2019-01-11 11:45:47UP
logo RobotsChecker2019-01-10 12:21:24UPUP
logo WURFL ImageEngine2019-01-07 07:31:12UP
logo alyze.info2019-01-06 08:13:35UPUP
logo infohound.net crawler2019-01-04 08:04:06UPUP
logo link_thumbnailer2019-01-01 14:55:28UPUP
logo cg-eye2018-12-27 10:08:49UP
logo Jeffrey Exif Viewer2018-12-27 10:07:57UPUP
logo Check-Domains.com bot2018-12-23 07:43:12UP
logo SSL Labs2018-12-19 09:10:40UPUP
logo Riddlerbot2018-12-18 19:54:31UPUP
logo BrowserSpyBot2018-12-15 11:54:36UP
logo SetCronJob2018-12-12 08:48:02UP
logo LongURL2018-12-08 07:23:09UP
logo Page Valet2018-12-05 10:10:34UP
logo Tools4noobs.com Spider2018-12-05 10:10:34UP
logo Taringa2018-12-04 06:17:00UP
logo KeyCDN bot2018-12-01 08:42:33UPUP
logo ROR Sitemap Generator2018-12-01 08:25:45UP
logo GoogleSites2018-11-30 05:00:35UPUP
logo XML Schema Validator2018-11-24 05:46:52UP
logo FoundSeoTool2018-11-24 05:46:52UP
logo htmlyse crawler2018-11-20 12:04:29UP
logo SpyOnWeb2018-10-05 16:16:34UP
logo ContentKing2018-09-12 14:08:02UPUP
logo GoSquared2018-09-12 07:17:58UP
logo DNS-Tools Header-Analyzer2018-09-12 04:13:11UPUP
logo RankFlex.com Webspider2018-09-07 18:36:06UP
logo GoogleBot2018-09-06 09:54:49UPUP
logo SiteExplorer2018-09-04 17:20:02UPUP
logo showsite crawler2018-08-25 04:33:36UP
logo iThemes crawler2018-08-24 09:12:42UP
logo YP crawler2018-08-16 08:15:25UP
logo Google AppsViewer2018-08-14 12:35:42UPUP
logo Webcron.org crawler2018-06-15 12:10:04UP
logo topster_de-crawler2018-06-13 14:26:48UP
logo webhint crawler2018-06-07 18:37:27UP
logo Cronjob.de bot2018-05-21 10:23:46UPUP
logo ssl-tools.net2018-04-19 09:08:05UPUP
logo Grabify.link2018-04-19 06:12:37UPUP
logo censys.io crawler2018-04-02 08:28:25UP

Maybe inactive robots (One year we have not heard about them)
logo SurveyBot2018-03-24 01:23:47UP
logo TcpTools Bot2018-03-16 07:25:04UPUP
logo Office 365 viewer2017-10-13 08:44:31UPUP
logo hosterstats2017-10-07 10:02:45UPUP
logo netk6 crawler2017-08-09 06:47:30DownUP
logo Monsidobot2017-07-06 09:26:22DownUP
logo cuwhois2017-07-01 20:23:22UP
logo csirt.cz2017-06-29 08:38:50UP
logo 0xFF Domain Crawler2017-06-26 02:42:20UP
logo pdffillerbot2017-06-19 19:25:51UP
logo ghostery bot2017-06-18 11:21:10UP
logo Mediumbot2017-06-13 12:34:22UP
logo Mozilla Metadata Service2017-06-09 15:11:27UPUP
logo WhatsMyIP.org2017-05-29 17:25:35UPUP
logo GIDBot2017-05-29 17:22:54UP
logo Page Analyzer2017-05-29 16:12:36UP
logo DIY-SEOBot2017-05-24 12:21:39DownUP
logo Detectify bot2017-05-16 09:17:01UP
logo Whoiswebsitebot2017-04-08 05:53:34UP
logo MS Cognitive Services2017-03-28 08:17:07UP
logo metacdn2017-03-03 14:05:20UP
logo SBA Research bot2017-01-19 04:47:17UPUP
logo NeutrinoAPI2017-01-08 07:25:39UP
logo Google-HotelAdsVerifier2017-01-01 16:26:28UPUP
logo bingbot2016-12-05 10:28:09UPUP
logo HootSuite crawler2016-09-17 04:15:21UP
logo Audisto Crawler2016-08-24 16:25:42UPUP
logo Whibse2016-08-24 15:21:05UP
logo WordPress.com bots2016-07-19 03:47:24UP
logo WP Engine2016-04-16 15:29:53UP
logo ResponseCodeTest2016-03-09 07:59:10UP
logo Siteimprove.com bot2016-01-11 03:42:51UP

Historical (Old robots, Inactive cravlers)
logo wf_crawler2018-12-05 10:10:34Down
logo richardstoolbox crawler2018-12-01 08:24:28DownDown
logo SiteXY Webmaster tools2018-11-13 08:13:39Down
logo SputnikBot2018-07-23 10:54:10UPUP
logo SEO Browser2018-07-14 08:45:19DownUP
logo seocharger-robot2018-04-19 08:53:36DownDown
logo wscheck.com2018-02-09 12:39:38Down
logo Web-sniffer.me/1.0.02018-02-09 11:05:43DownDown
logo HTTP-Header-Abfrage2017-10-23 06:44:30Down
logo Web-sniffer2017-08-07 14:14:12DownUP
logo ganarvisitas2017-07-01 19:50:33Down
logo Scrubby2017-06-19 14:11:21UPUP
logo GC3pro2017-05-29 16:02:19Down
logo Untiny2017-03-03 12:50:50DownUP
logo GetProxi.es-bot2016-07-22 07:25:58DownDown
logo MetaCommentBot2016-06-09 11:12:02Down
logo seo-nastroj.cz2015-11-25 11:40:46Down
logo SEOCentro bot2015-11-03 10:25:02UP
logo make.myUrl2015-10-07 13:01:33Down
logo Whoismindbot2015-09-01 15:21:11UPUP
logo Yahoo!2010-01-05 19:09:55UPUP
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.