Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo SEMrushBot2020-01-20 18:23:42UPUP
logo DotBot2020-01-20 18:13:39UPUP
logo MJ12bot2020-01-20 16:36:13UPUP
logo AhrefsBot2020-01-20 16:14:18UPUP
logo Brandwatch crawler2020-01-20 15:13:38UP
logo BLEXBot2020-01-20 14:20:20UPUP
logo deepcrawl2020-01-20 07:29:12UPUP
logo Googlebot2020-01-20 07:28:37UPUP
logo Dataprovider Spider2020-01-20 07:02:43UPUP
logo proximic2020-01-20 06:38:25UPUP
logo GrapeshotCrawler2020-01-20 06:38:25UPUP
logo AppNexus crawler2020-01-20 06:22:34UP
logo Mediatoolkitbot2020-01-20 06:20:36UP
logo rogerbot2020-01-20 05:38:08UPUP
logo Mappy2020-01-20 05:37:13UPUP
logo Datanyze2020-01-20 05:36:56UPUP
logo Google-Ads2020-01-20 05:13:02UPUP
logo ADmantX crawler2020-01-20 04:21:31UPUP
logo trendictionbot2020-01-20 04:15:49UPUP
logo ZoomInfo bot2020-01-20 04:14:27UP
logo Hypefactors crawler2020-01-20 04:07:10UPUP
logo SurdotlyBot2020-01-20 02:15:16UPUP
logo LinkpadBot2020-01-20 00:24:02UP
logo MixrankBot2020-01-20 00:08:01UP
logo MegaIndex2020-01-19 19:25:26UPDown
logo linkdexbot2020-01-19 16:11:23UPUP
logo SEOkicks-Robot2020-01-19 06:51:07UP
logo SentiBot2020-01-19 05:17:29UPUP
logo SISTRIX Optimizer2020-01-18 18:56:49UPUP
logo HubSpot Crawler2020-01-18 10:17:05UP
logo uMBot2020-01-18 07:50:33UP
logo ZoomBot2020-01-18 07:31:05UPUP
logo crawler2020-01-18 07:30:31UPUP
logo JamesBOT2020-01-17 02:34:11UPUP
logo woobot2020-01-16 18:44:10UPUP
logo EchoboxBot2020-01-16 13:40:11UP
logo Rival IQ2020-01-16 06:22:45UP
logo Cocolyze bot2020-01-16 05:36:14DownUP
logo SeopultContentAnalyzer2020-01-15 07:55:54UP
logo SMTBot2020-01-15 07:25:58UPUP
logo StatvooBot2020-01-14 20:19:54UPUP
logo Adbeat bot2020-01-14 08:05:01UPUP
logo Bot2020-01-13 07:13:46UPUP
logo RankurBot2020-01-09 12:13:44UPUP
logo AddThis.com2020-01-08 05:47:26UP
logo serpstatbot2020-01-07 09:37:52UPUP
logo LinkedInBot2020-01-06 16:13:20UP
logo demandbase-bot2020-01-06 05:55:47UP
logo GroupHigh2020-01-04 08:51:34UP
logo Awario crawler2019-12-20 08:37:29UPUP
logo XoviBot2019-12-19 07:55:16UPUP
logo MarketingMiner Bot2019-12-13 17:13:58UP
logo Sideqik crawler2019-12-11 21:26:43UP
logo Sistrix crawler2019-12-04 15:21:29UP
logo VerticalLeap bot2019-12-03 16:06:00UPUP
logo SEOdiver2019-12-02 05:56:58UPUP
logo Roistat Bot2019-11-25 16:57:42UP
logo SERPtimizerBot2019-11-25 15:21:01UPUP
logo LinqiaBot2019-11-18 21:36:36UP
logo Ryte Bot2019-11-18 06:15:36UPUP
logo BirilBot2019-11-15 00:10:07UPUP
logo Google-AdWords2019-11-13 12:43:52UPUP
logo Buzzbot2019-10-26 11:10:14UP
logo SeoSiteCheckup2019-10-22 10:36:57UP
logo MarketMuseBot2019-10-01 05:59:46DownUP
logo OnCrawl2019-09-23 10:12:38UPUP
logo bot2019-09-10 10:47:21UP
logo Rigor crawler2019-09-04 10:59:26UP
logo LXRbot2019-09-04 07:18:44UPUP
logo ISOWQ2019-09-04 07:18:43UPUP
logo Pulsepoint crawler2019-09-03 07:34:19UP
logo Infegy2019-08-08 07:07:48UP
logo monitorabot2019-06-04 05:31:05UP
logo IAB crawler2019-04-25 21:39:59UP
logo Online Domain Tools2019-03-03 07:11:08UP
logo keyword-hero bot2019-02-25 07:25:28UPUP

Maybe inactive robots (One year we have not heard about them)
logo bingbot2018-12-29 05:30:41UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo lsv1_ads.txt_crawler2018-10-24 10:02:49UPUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo SE Ranking bot2018-08-28 09:10:23UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo GetintentCrawler2017-11-13 02:43:35UPUP
logo Traackr.com2017-09-05 06:44:10UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP

Historical (Old robots, Inactive cravlers)
logo Curious George2020-01-08 10:17:09DownDown
logo 007AC92018-12-29 20:50:22DownUP
logo spbot2018-10-16 10:14:46DownUP
logo Ezooms2018-10-11 23:58:36UP
logo techleadzbot2018-07-18 07:39:08Down
logo Cityreview Robot2011-03-12 10:00:11DownUP
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.