Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo SEMrushBot2021-08-05 19:41:31UPUP
logo MJ12bot2021-08-05 19:37:43UPUP
logo DotBot2021-08-05 19:13:52UPUP
logo RankurBot2021-08-05 19:06:06UPUP
logo AhrefsBot2021-08-05 18:57:11UPUP
logo proximic2021-08-05 17:16:32UPUP
logo serpstatbot2021-08-05 16:01:49UPUP
logo BLEXBot2021-08-05 13:34:33UPUP
logo ZoomInfo bot2021-08-05 10:33:57UP
logo SentiBot2021-08-05 09:32:13UPUP
logo Mediatoolkitbot2021-08-05 03:24:41UP
logo trendictionbot2021-08-05 03:24:08UPUP
logo MegaIndex2021-08-05 00:26:49UPDown
logo HubSpot Crawler2021-08-04 05:46:55UP
logo Google-Ads2021-08-04 02:35:56UPUP
logo SEOkicks-Robot2021-08-03 14:07:50UP
logo SurdotlyBot2021-08-03 10:59:48UPUP
logo GrapeshotCrawler2021-08-03 10:31:20UPUP
logo ADmantX crawler2021-08-03 10:24:04UPUP
logo deepcrawl2021-08-03 02:47:32UPUP
logo uMBot2021-08-01 05:47:05UP
logo AppNexus crawler2021-08-01 05:46:34UP
logo LinkedInBot2021-07-31 08:06:24UP
logo Google AdSense2021-07-31 06:57:30UPUP
logo webgains-bot2021-07-31 05:10:19UP
logo Dataprovider Spider2021-07-31 01:57:24UPUP
logo JamesBOT2021-07-29 03:17:39UPUP
logo SMTBot2021-07-27 09:15:56UPUP
logo linkdexbot2021-07-26 16:05:08UPUP
logo DomCop Bot2021-07-25 16:11:58UPUP
logo woobot2021-07-24 18:57:07UPUP
logo Google-Shopping2021-07-19 17:36:23UPUP
logo ZoomBot2021-07-19 16:51:43DownUP
logo pr-cy.ru Bot2021-07-14 04:47:36UPUP
logo rogerbot2021-07-13 16:55:03UPUP
logo SERPtimizerBot2021-07-12 05:20:33UPUP
logo Seostar.co bot2021-07-08 19:44:20UPUP
logo Roistat Bot2021-07-06 15:56:17UP
logo Cocolyze bot2021-07-06 09:03:00DownDown
logo MixrankBot2021-07-03 21:39:35UP
logo bingbot2021-07-01 02:48:24UPUP
logo Adbeat bot2021-06-30 22:39:58UPUP
logo Ryte Bot2021-06-30 00:26:14UPUP
logo demandbase-bot2021-06-03 08:03:33UP
logo LinkpadBot2021-05-26 01:41:43DownUP
logo CriteoBot2021-05-06 23:58:10UPUP
logo MTRobot2021-04-09 19:37:11DownUP
logo MicroAdBot2021-03-26 14:12:31UP
logo Awario crawler2021-03-08 12:37:39UPUP
logo XoviBot2021-03-07 11:34:54UPUP
logo Brandwatch crawler2021-02-21 02:02:49UP
logo LinqiaBot2021-02-18 12:44:50UP
logo MarketingMiner Bot2021-02-15 14:05:09UP
logo Online Domain Tools2021-02-06 12:45:06UP
logo Datanyze2021-01-21 05:40:56UPUP
logo Primis crawler2021-01-06 03:34:13UPUP
logo SeoSiteCheckup2020-12-15 11:39:21UP
logo SE Ranking bot2020-12-07 13:19:20UP
logo SEOdiver2020-11-13 04:38:52UPUP
logo SEOlizer2020-10-16 02:05:03UPUP
logo GetintentCrawler2020-09-30 16:55:46UPUP
logo Hypefactors crawler2020-09-03 02:38:58UPUP
logo Rival IQ2020-09-02 14:12:45UP

Maybe inactive robots (One year we have not heard about them)
logo Marfeel crawler2020-08-04 18:29:59UPUP
logo Buzzbot2020-07-12 08:59:24UP
logo Sistrix crawler2020-06-09 17:19:29UP
logo EchoboxBot2020-06-09 08:32:56UP
logo Traackr.com2020-05-26 11:35:48UP
logo SISTRIX Optimizer2020-05-13 02:09:48UPUP
logo SemtixBot2020-05-10 06:35:26UPUP
logo adstxt.com crawler2020-04-17 14:03:34UPUP
logo VerticalLeap bot2020-03-04 05:52:35UPUP
logo AddThis.com2020-02-21 20:13:50UPUP
logo AffiliateLabz crawler2020-02-16 03:30:53UP
logo Mappy2020-02-12 05:45:04UPUP
logo SeopultContentAnalyzer2020-01-15 07:55:54UP
logo StatvooBot2020-01-14 20:19:54UPUP
logo GroupHigh2020-01-04 08:51:34UP
logo Sideqik crawler2019-12-11 21:26:43UP
logo BirilBot2019-11-15 00:10:07UPUP
logo MarketMuseBot2019-10-01 05:59:46DownUP
logo OnCrawl2019-09-23 10:12:38UPUP
logo LXRbot2019-09-04 07:18:44UPUP
logo ISOWQ2019-09-04 07:18:43UPUP
logo Pulsepoint crawler2019-09-03 07:34:19UP
logo Infegy2019-08-08 07:07:48UP
logo Adform crawler2019-06-17 06:26:48UPUP
logo monitorabot2019-06-04 05:31:05UP
logo IAB crawler2019-04-25 21:39:59UP
logo keyword-hero bot2019-02-25 07:25:28UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo lsv1_ads.txt_crawler2018-10-24 10:02:49UPUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP
logo Googlebot2016-01-12 08:04:47UPUP
logo Yahoo! JAPAN2014-09-26 06:30:29UPUP

Historical (Old robots, Inactive cravlers)
logo Ezooms2021-06-21 22:52:12UP
logo Curious George2020-10-07 13:20:42DownDown
logo 007AC92018-12-29 20:50:22DownUP
logo spbot2018-10-16 10:14:46DownUP
logo techleadzbot2018-07-18 07:39:08Down
logo Cityreview Robot2011-03-12 10:00:11DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.