Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo DotBot2019-01-23 01:50:39UPUP
logo SEMrushBot2019-01-23 01:36:25UPUP
logo MJ12bot2019-01-23 00:55:32UPUP
logo AhrefsBot2019-01-23 00:38:12UPUP
logo SEOkicks-Robot2019-01-23 00:20:23UP
logo Mediatoolkitbot2019-01-22 20:05:14UP
logo HubSpot Crawler2019-01-22 16:07:12UP
logo Googlebot2019-01-22 16:05:10UPUP
logo Datanyze2019-01-22 15:38:16UP
logo GrapeshotCrawler2019-01-22 15:17:47UPUP
logo Dataprovider Spider2019-01-22 14:25:57UPUP
logo Mappy2019-01-22 12:30:45UPUP
logo linkdexbot2019-01-22 12:28:33UPUP
logo Infegy2019-01-22 08:29:15UP
logo Adbeat bot2019-01-22 08:05:36UPUP
logo JamesBOT2019-01-22 05:33:57UPUP
logo magpie-crawler2019-01-22 03:57:14UPUP
logo Bot2019-01-21 22:45:46UP
logo LinqiaBot2019-01-21 20:48:49UP
logo LinkedInBot2019-01-21 17:25:02UP
logo ZoomInfo bot2019-01-21 15:22:35UP
logo SurdotlyBot2019-01-21 13:28:41UPUP
logo BLEXBot2019-01-21 12:24:05UPUP
logo Pulsepoint crawler2019-01-21 11:59:41UP
logo SMTBot2019-01-21 11:20:29UPUP
logo SEOdiver2019-01-21 05:40:19UPUP
logo SentiBot2019-01-20 05:44:20UPUP
logo MegaIndex2019-01-19 08:45:45UPDown
logo trendictionbot2019-01-18 05:26:53UPUP
logo Ryte Bot2019-01-17 05:54:58UPUP
logo RankurBot2019-01-14 20:18:46UPUP
logo Buzzbot2019-01-13 23:50:47UP
logo GroupHigh2019-01-13 13:12:40UP
logo ZoomBot2019-01-11 16:13:03UPUP
logo 007AC92018-12-29 20:50:22DownUP
logo bingbot2018-12-29 05:30:41UPUP
logo XoviBot2018-12-27 04:52:46UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo keyword-hero bot2018-12-17 12:09:51UPUP
logo SeoSiteCheckup2018-12-14 08:33:44UP
logo MarketingMiner Bot2018-12-04 13:30:46UP
logo proximic2018-12-03 17:27:25UPUP
logo woobot2018-12-02 02:49:14UPUP
logo LXRbot2018-11-21 07:23:04UPUP
logo SeopultContentAnalyzer2018-11-21 07:12:45UP
logo ISOWQ2018-11-21 07:08:25UPUP
logo demandbase-bot2018-11-16 22:09:08UP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo spbot2018-10-16 10:14:46UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo deepcrawl2018-10-04 08:07:17UPUP
logo uCrawler2018-10-04 07:55:38UPUP
logo SE Ranking bot2018-08-28 09:10:23UP
logo rogerbot2018-08-24 17:07:03UPUP
logo Online Domain Tools2018-07-18 11:49:38UP
logo EchoboxBot2018-06-21 09:34:01UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Hypefactors crawler2018-04-20 08:14:23UPUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP

Maybe inactive robots (One year we have not heard about them)
logo GetintentCrawler2017-11-13 02:43:35UPUP
logo MixrankBot2017-09-14 00:46:06UP
logo Traackr.com2017-09-05 06:44:10UP
logo LinkpadBot2017-08-13 19:51:17UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo Sistrix crawler2017-06-14 07:50:46UPUP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo Awario crawler2017-05-26 10:53:47UPUP
logo AddThis.com2017-04-20 09:44:22UP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP

Historical (Old robots, Inactive cravlers)
logo Ezooms2018-10-11 23:58:36UP
logo Curious George2018-08-30 15:14:24DownDown
logo techleadzbot2018-07-18 07:39:08Down
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.