Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo MTRobot2021-01-25 17:20:35DownUP
logo SentiBot2021-01-25 16:59:23UPUP
logo DotBot2021-01-25 16:57:29UPUP
logo MJ12bot2021-01-25 16:45:42UPUP
logo SMTBot2021-01-25 16:15:10UPUP
logo SEMrushBot2021-01-25 16:00:11UPUP
logo Brandwatch crawler2021-01-25 15:56:07UP
logo AhrefsBot2021-01-25 15:25:17UPUP
logo ZoomInfo bot2021-01-25 14:55:22UP
logo BLEXBot2021-01-25 13:48:46UPUP
logo Google-Ads2021-01-25 06:15:28UPUP
logo rogerbot2021-01-25 06:06:37UPUP
logo Mediatoolkitbot2021-01-25 05:47:26UP
logo uMBot2021-01-25 05:46:23UP
logo AppNexus crawler2021-01-25 05:45:45UP
logo trendictionbot2021-01-25 05:16:43UPUP
logo Adbeat bot2021-01-25 05:03:47UPUP
logo ZoomBot2021-01-24 18:38:21DownUP
logo proximic2021-01-24 03:09:27UPUP
logo MegaIndex2021-01-23 22:24:02UPDown
logo serpstatbot2021-01-23 18:14:42UPUP
logo SurdotlyBot2021-01-23 07:40:17UPUP
logo SEOkicks-Robot2021-01-23 07:15:23UP
logo GrapeshotCrawler2021-01-23 07:14:36UPUP
logo woobot2021-01-22 06:50:37UPUP
logo MixrankBot2021-01-21 20:05:44UP
logo Dataprovider Spider2021-01-21 18:45:41UPUP
logo LinkpadBot2021-01-21 10:22:59UP
logo linkdexbot2021-01-21 07:39:21UPUP
logo Datanyze2021-01-21 05:40:56UPUP
logo JamesBOT2021-01-21 05:00:09UPUP
logo Google-Shopping2021-01-20 23:01:02UPUP
logo Cocolyze bot2021-01-20 21:02:16DownDown
logo DomCop Bot2021-01-20 17:01:58UPUP
logo Google AdSense2021-01-20 15:56:42UPUP
logo ADmantX crawler2021-01-19 00:13:21UPUP
logo HubSpot Crawler2021-01-18 13:19:32UP
logo Awario crawler2021-01-17 20:02:48UPUP
logo MarketingMiner Bot2021-01-11 14:01:45UP
logo deepcrawl2021-01-11 07:27:13UPUP
logo Primis crawler2021-01-06 03:34:13UPUP
logo XoviBot2021-01-04 15:49:05UPUP
logo bingbot2021-01-01 18:40:51UPUP
logo Roistat Bot2021-01-01 16:58:52UP
logo LinkedInBot2020-12-16 19:23:15UP
logo Ryte Bot2020-12-15 23:11:24UPUP
logo SeoSiteCheckup2020-12-15 11:39:21UP
logo LinqiaBot2020-12-10 05:18:10UP
logo SE Ranking bot2020-12-07 13:19:20UP
logo webgains-bot2020-12-02 10:00:29UP
logo pr-cy.ru Bot2020-11-13 05:06:00UPUP
logo SEOdiver2020-11-13 04:38:52UPUP
logo RankurBot2020-10-30 06:40:07UPUP
logo SEOlizer2020-10-16 02:05:03UPUP
logo SERPtimizerBot2020-10-12 10:10:02UPUP
logo GetintentCrawler2020-09-30 16:55:46UPUP
logo Hypefactors crawler2020-09-03 02:38:58UPUP
logo Rival IQ2020-09-02 14:12:45UP
logo Marfeel crawler2020-08-04 18:29:59UPUP
logo Buzzbot2020-07-12 08:59:24UP
logo Sistrix crawler2020-06-09 17:19:29UP
logo EchoboxBot2020-06-09 08:32:56UP
logo Traackr.com2020-05-26 11:35:48UP
logo SISTRIX Optimizer2020-05-13 02:09:48UPUP
logo demandbase-bot2020-05-11 06:18:28UP
logo SemtixBot2020-05-10 06:35:26UPUP
logo adstxt.com crawler2020-04-17 14:03:34UPUP
logo VerticalLeap bot2020-03-04 05:52:35UPUP
logo AddThis.com2020-02-21 20:13:50UP
logo AffiliateLabz crawler2020-02-16 03:30:53UP
logo Mappy2020-02-12 05:45:04UPUP

Maybe inactive robots (One year we have not heard about them)
logo SeopultContentAnalyzer2020-01-15 07:55:54UP
logo StatvooBot2020-01-14 20:19:54UPUP
logo GroupHigh2020-01-04 08:51:34UP
logo Sideqik crawler2019-12-11 21:26:43UP
logo BirilBot2019-11-15 00:10:07UPUP
logo MarketMuseBot2019-10-01 05:59:46DownUP
logo OnCrawl2019-09-23 10:12:38UPUP
logo Rigor crawler2019-09-04 10:59:26UP
logo LXRbot2019-09-04 07:18:44UPUP
logo ISOWQ2019-09-04 07:18:43UPUP
logo Pulsepoint crawler2019-09-03 07:34:19UP
logo Infegy2019-08-08 07:07:48UP
logo Adform crawler2019-06-17 06:26:48UPUP
logo monitorabot2019-06-04 05:31:05UP
logo IAB crawler2019-04-25 21:39:59UP
logo Online Domain Tools2019-03-03 07:11:08UP
logo keyword-hero bot2019-02-25 07:25:28UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo lsv1_ads.txt_crawler2018-10-24 10:02:49UPUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP
logo Googlebot2016-01-12 08:04:47UPUP

Historical (Old robots, Inactive cravlers)
logo Ezooms2020-12-22 05:26:09UP
logo Curious George2020-10-07 13:20:42DownDown
logo 007AC92018-12-29 20:50:22DownUP
logo spbot2018-10-16 10:14:46DownUP
logo techleadzbot2018-07-18 07:39:08Down
logo Cityreview Robot2011-03-12 10:00:11DownUP
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.