Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo DotBot2021-04-11 08:38:07UPUP
logo SEMrushBot2021-04-11 08:32:55UPUP
logo AhrefsBot2021-04-11 08:12:18UPUP
logo MJ12bot2021-04-11 08:05:19UPUP
logo SentiBot2021-04-11 06:09:11UPUP
logo SEOkicks-Robot2021-04-11 04:56:46UP
logo BLEXBot2021-04-11 04:56:38UPUP
logo ZoomInfo bot2021-04-11 04:56:05UP
logo rogerbot2021-04-11 04:50:55UPUP
logo trendictionbot2021-04-11 04:50:54UPUP
logo Mediatoolkitbot2021-04-11 04:45:53UP
logo proximic2021-04-11 04:41:50UPUP
logo GrapeshotCrawler2021-04-11 04:41:49UPUP
logo uMBot2021-04-11 04:41:49UP
logo SurdotlyBot2021-04-10 03:15:04UPUP
logo ADmantX crawler2021-04-09 23:32:39UPUP
logo MTRobot2021-04-09 19:37:11DownUP
logo CriteoBot2021-04-09 17:08:21UPUP
logo LinkedInBot2021-04-09 15:20:49UP
logo linkdexbot2021-04-09 14:42:54UPUP
logo AppNexus crawler2021-04-09 08:35:39UP
logo bingbot2021-04-09 07:34:19UPUP
logo MegaIndex2021-04-09 05:52:02UPDown
logo ZoomBot2021-04-09 03:25:41DownUP
logo SMTBot2021-04-09 03:07:19UPUP
logo Google-Ads2021-04-08 03:54:23UPUP
logo Google AdSense2021-04-08 03:52:58UPUP
logo RankurBot2021-04-07 09:06:46UPUP
logo Dataprovider Spider2021-04-05 08:18:37UPUP
logo serpstatbot2021-04-05 04:20:09UPUP
logo Seostar.co bot2021-04-04 22:04:42UPUP
logo Adbeat bot2021-04-02 02:30:27UPUP
logo pr-cy.ru Bot2021-04-01 12:12:08UPUP
logo woobot2021-03-30 14:48:05UPUP
logo SERPtimizerBot2021-03-29 02:52:56UPUP
logo MicroAdBot2021-03-26 14:12:31UP
logo HubSpot Crawler2021-03-24 20:28:35UP
logo Cocolyze bot2021-03-21 09:20:38DownDown
logo Roistat Bot2021-03-12 10:57:06UP
logo DomCop Bot2021-03-12 10:33:20UPUP
logo Awario crawler2021-03-08 12:37:39UPUP
logo XoviBot2021-03-07 11:34:54UPUP
logo JamesBOT2021-03-04 01:30:36UPUP
logo MixrankBot2021-03-03 13:36:36UP
logo Brandwatch crawler2021-02-21 02:02:49UP
logo Ryte Bot2021-02-19 09:03:31UPUP
logo LinqiaBot2021-02-18 12:44:50UP
logo Google-Shopping2021-02-15 23:01:51UPUP
logo MarketingMiner Bot2021-02-15 14:05:09UP
logo deepcrawl2021-02-15 07:55:07UPUP
logo Online Domain Tools2021-02-06 12:45:06UP
logo LinkpadBot2021-01-21 10:22:59UP
logo Datanyze2021-01-21 05:40:56UPUP
logo Primis crawler2021-01-06 03:34:13UPUP
logo SeoSiteCheckup2020-12-15 11:39:21UP
logo SE Ranking bot2020-12-07 13:19:20UP
logo webgains-bot2020-12-02 10:00:29UP
logo SEOdiver2020-11-13 04:38:52UPUP
logo SEOlizer2020-10-16 02:05:03UPUP
logo GetintentCrawler2020-09-30 16:55:46UPUP
logo Hypefactors crawler2020-09-03 02:38:58UPUP
logo Rival IQ2020-09-02 14:12:45UP
logo Marfeel crawler2020-08-04 18:29:59UPUP
logo Buzzbot2020-07-12 08:59:24UP
logo Sistrix crawler2020-06-09 17:19:29UP
logo EchoboxBot2020-06-09 08:32:56UP
logo Traackr.com2020-05-26 11:35:48UP
logo SISTRIX Optimizer2020-05-13 02:09:48UPUP
logo demandbase-bot2020-05-11 06:18:28UP
logo SemtixBot2020-05-10 06:35:26UPUP
logo adstxt.com crawler2020-04-17 14:03:34UPUP

Maybe inactive robots (One year we have not heard about them)
logo VerticalLeap bot2020-03-04 05:52:35UPUP
logo AddThis.com2020-02-21 20:13:50UPUP
logo AffiliateLabz crawler2020-02-16 03:30:53UP
logo Mappy2020-02-12 05:45:04UPUP
logo SeopultContentAnalyzer2020-01-15 07:55:54UP
logo StatvooBot2020-01-14 20:19:54UPUP
logo GroupHigh2020-01-04 08:51:34UP
logo Sideqik crawler2019-12-11 21:26:43UP
logo BirilBot2019-11-15 00:10:07UPUP
logo MarketMuseBot2019-10-01 05:59:46DownUP
logo OnCrawl2019-09-23 10:12:38UPUP
logo Rigor crawler2019-09-04 10:59:26UP
logo LXRbot2019-09-04 07:18:44UPUP
logo ISOWQ2019-09-04 07:18:43UPUP
logo Pulsepoint crawler2019-09-03 07:34:19UP
logo Infegy2019-08-08 07:07:48UP
logo Adform crawler2019-06-17 06:26:48UPUP
logo monitorabot2019-06-04 05:31:05UP
logo IAB crawler2019-04-25 21:39:59UP
logo keyword-hero bot2019-02-25 07:25:28UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo lsv1_ads.txt_crawler2018-10-24 10:02:49UPUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP
logo Googlebot2016-01-12 08:04:47UPUP
logo Yahoo! JAPAN2014-09-26 06:30:29UPUP

Historical (Old robots, Inactive cravlers)
logo Ezooms2020-12-22 05:26:09UP
logo Curious George2020-10-07 13:20:42DownDown
logo 007AC92018-12-29 20:50:22DownUP
logo spbot2018-10-16 10:14:46DownUP
logo techleadzbot2018-07-18 07:39:08Down
logo Cityreview Robot2011-03-12 10:00:11DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.