Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo SEMrushBot2022-12-01 00:33:33UPUP
logo DotBot2022-12-01 00:33:20UPUP
logo AhrefsBot2022-11-30 22:49:30UPUP
logo SentiBot2022-11-30 16:21:33UPUP
logo MJ12bot2022-11-30 09:22:27UPUP
logo Google-Ads2022-11-30 03:07:41UPUP
logo SurdotlyBot2022-11-30 02:47:39UPUP
logo uMBot2022-11-30 02:36:45UP
logo Google AdSense2022-11-30 02:36:00UPUP
logo Mediatoolkitbot2022-11-30 02:25:52UP
logo woobot2022-11-29 23:50:59UPUP
logo BLEXBot2022-11-29 19:00:35UPUP
logo ADmantX crawler2022-11-29 18:16:50UPUP
logo HubSpot Crawler2022-11-29 16:16:05UP
logo Dataprovider Spider2022-11-29 14:13:35UPUP
logo SEOkicks-Robot2022-11-29 10:43:16UP
logo IAB crawler2022-11-29 07:20:51UPUP
logo AppNexus crawler2022-11-29 05:10:53UP
logo trendictionbot2022-11-29 04:40:39UPUP
logo ZoomInfo bot2022-11-28 17:46:16UP
logo GrapeshotCrawler2022-11-28 04:31:22UPUP
logo SISTRIX Optimizer2022-11-26 18:13:20UPUP
logo MegaIndex2022-11-26 15:44:34UPDown
logo RankurBot2022-11-26 07:09:04UPUP
logo linkdexbot2022-11-26 04:52:38UPUP
logo SERPtimizerBot2022-11-25 10:43:09UPUP
logo Ryte Bot2022-11-22 22:47:05UPUP
logo Adbeat bot2022-11-22 19:04:59UPUP
logo serpstatbot2022-11-22 16:22:51UPUP
logo Cocolyze bot2022-11-18 14:43:51DownDown
logo proximic2022-11-18 08:56:22UPUP
logo ZoomBot2022-11-18 00:48:23UPUP
logo BrightEdge Crawler2022-11-17 12:35:58UP
logo bingbot2022-11-05 23:34:52UPUP
logo CriteoBot2022-11-03 20:58:10UPUP
logo DomCop Bot2022-11-02 13:33:51UPUP
logo LinkedInBot2022-11-01 06:49:26UP
logo MixrankBot2022-10-25 08:23:30UP
logo XoviBot2022-10-23 16:17:47UPUP
logo Seostar.co bot2022-10-14 08:14:45UPUP
logo Google-Shopping2022-10-04 23:10:18UPUP
logo pr-cy.ru Bot2022-10-04 22:18:29UPUP
logo SE Ranking bot2022-10-03 04:01:24UP
logo SMTBot2022-09-27 19:41:28UPUP
logo SEOdiver2022-08-30 14:22:21UPUP
logo Awario crawler2022-07-19 20:32:34UPUP
logo rogerbot2022-07-17 18:24:33UPUP
logo Roistat Bot2022-06-23 06:06:46UP
logo Datanyze2022-06-06 18:10:14UPUP
logo webgains-bot2022-05-04 21:03:12UP
logo deepcrawl2022-04-18 22:43:59UPUP
logo KargoBot2022-03-29 06:32:20UPUP
logo SeoSiteCheckup2022-03-16 12:15:15UP
logo GetintentCrawler2022-02-19 11:46:35UPUP
logo Googlebot2022-02-15 20:37:01UPUP
logo EchoboxBot2022-01-12 20:23:13UP
logo VerticalLeap bot2022-01-11 16:25:48UPUP

Maybe inactive robots (One year we have not heard about them)
logo SEOlizer2021-11-18 07:44:30UPUP
logo Brandwatch crawler2021-09-25 19:31:10UP
logo JamesBOT2021-09-16 04:22:27UPUP
logo demandbase-bot2021-06-03 08:03:33UP
logo MicroAdBot2021-05-10 11:00:15UP
logo MTRobot2021-04-09 19:37:11DownUP
logo LinqiaBot2021-02-18 12:44:50UP
logo MarketingMiner Bot2021-02-15 14:05:09UP
logo Online Domain Tools2021-02-06 12:45:06UP
logo Primis crawler2021-01-06 03:34:13UPUP
logo Hypefactors crawler2020-09-03 02:38:58UPUP
logo Rival IQ2020-09-02 14:12:45UP
logo Marfeel crawler2020-08-04 18:29:59UPUP
logo Buzzbot2020-07-12 08:59:24UP
logo Sistrix crawler2020-06-09 17:19:29UP
logo Traackr.com2020-05-26 11:35:48UP
logo SemtixBot2020-05-10 06:35:26UPUP
logo adstxt.com crawler2020-04-17 14:03:34UPUP
logo AddThis.com2020-02-21 20:13:50UPUP
logo AffiliateLabz crawler2020-02-16 03:30:53UP
logo Mappy2020-02-12 05:45:04UPUP
logo SeopultContentAnalyzer2020-01-15 07:55:54UP
logo StatvooBot2020-01-14 20:19:54UPUP
logo GroupHigh2020-01-04 08:51:34UP
logo Sideqik crawler2019-12-11 21:26:43UP
logo BirilBot2019-11-15 00:10:07UPUP
logo MarketMuseBot2019-10-01 05:59:46DownUP
logo OnCrawl2019-09-23 10:12:38UPUP
logo LXRbot2019-09-04 07:18:44UPUP
logo ISOWQ2019-09-04 07:18:43UPUP
logo Pulsepoint crawler2019-09-03 07:34:19UP
logo Infegy2019-08-08 07:07:48UP
logo Adform crawler2019-06-17 06:26:48UPUP
logo monitorabot2019-06-04 05:31:05UP
logo keyword-hero bot2019-02-25 07:25:28UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo lsv1_ads.txt_crawler2018-10-24 10:02:49UPUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP
logo Yahoo! JAPAN2014-09-26 06:30:29UPUP

Historical (Old robots, Inactive cravlers)
logo 007AC92022-05-08 04:13:05DownUP
logo LinkpadBot2022-01-24 23:14:12DownDown
logo Ezooms2021-06-21 22:52:12UP
logo Curious George2020-10-07 13:20:42DownDown
logo spbot2018-10-16 10:14:46DownUP
logo techleadzbot2018-07-18 07:39:08Down
logo Cityreview Robot2011-03-12 10:00:11DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.