Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo AhrefsBot2019-03-21 20:39:58UPUP
logo SEMrushBot2019-03-21 20:38:17UPUP
logo DotBot2019-03-21 20:14:10UPUP
logo MJ12bot2019-03-21 19:34:46UPUP
logo ZoomInfo bot2019-03-21 16:43:58UP
logo BLEXBot2019-03-21 12:58:24UPUP
logo Googlebot2019-03-21 12:36:56UPUP
logo JamesBOT2019-03-21 12:26:23UPUP
logo MegaIndex2019-03-21 12:22:41UPDown
logo linkdexbot2019-03-21 11:41:26UPUP
logo Mappy2019-03-21 10:25:00UPUP
logo Pulsepoint crawler2019-03-21 10:17:24UP
logo SEOkicks-Robot2019-03-21 09:42:26UP
logo Infegy2019-03-21 08:32:33UP
logo XoviBot2019-03-21 08:04:14UPUP
logo Datanyze2019-03-21 07:56:42UPUP
logo Mediatoolkitbot2019-03-21 05:03:37UP
logo SMTBot2019-03-21 04:49:51UPUP
logo GrapeshotCrawler2019-03-21 01:07:33UPUP
logo proximic2019-03-20 21:46:14UPUP
logo trendictionbot2019-03-18 21:05:18UPUP
logo SEOdiver2019-03-18 05:55:05UPUP
logo Dataprovider Spider2019-03-16 20:21:03UPUP
logo SurdotlyBot2019-03-13 10:16:58UPUP
logo GroupHigh2019-03-13 09:02:53UP
logo magpie-crawler2019-03-13 02:52:57UPUP
logo SentiBot2019-03-12 17:25:23UPUP
logo Adbeat bot2019-03-12 11:09:28UPUP
logo LinqiaBot2019-03-12 07:56:40UP
logo LinkedInBot2019-03-10 12:24:31UP
logo uMBot2019-03-09 17:07:21UP
logo HubSpot Crawler2019-03-08 00:34:55UP
logo demandbase-bot2019-03-05 09:22:18UP
logo pr-cy.ru Bot2019-03-04 11:15:06UP
logo Online Domain Tools2019-03-03 07:11:08UP
logo keyword-hero bot2019-02-25 07:25:28UPUP
logo Ryte Bot2019-02-20 23:57:24UPUP
logo ZoomBot2019-02-15 14:17:48UPUP
logo RankurBot2019-02-08 06:57:15UPUP
logo woobot2019-02-01 17:01:24UPUP
logo SeoSiteCheckup2019-02-01 09:27:48UP
logo Rigor crawler2019-01-24 08:18:09UP
logo Buzzbot2019-01-13 23:50:47UP
logo 007AC92018-12-29 20:50:22DownUP
logo bingbot2018-12-29 05:30:41UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo MarketingMiner Bot2018-12-04 13:30:46UP
logo LXRbot2018-11-21 07:23:04UPUP
logo SeopultContentAnalyzer2018-11-21 07:12:45UP
logo ISOWQ2018-11-21 07:08:25UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo spbot2018-10-16 10:14:46UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo deepcrawl2018-10-04 08:07:17UPUP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo SE Ranking bot2018-08-28 09:10:23UP
logo rogerbot2018-08-24 17:07:03UPUP
logo EchoboxBot2018-06-21 09:34:01UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Hypefactors crawler2018-04-20 08:14:23UPUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP

Maybe inactive robots (One year we have not heard about them)
logo Semasio crawler2018-03-02 17:33:00UP
logo GetintentCrawler2017-11-13 02:43:35UPUP
logo MixrankBot2017-09-14 00:46:06UP
logo Traackr.com2017-09-05 06:44:10UP
logo LinkpadBot2017-08-13 19:51:17UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo Sistrix crawler2017-06-14 07:50:46UPUP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo Awario crawler2017-05-26 10:53:47UPUP
logo AddThis.com2017-04-20 09:44:22UP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP

Historical (Old robots, Inactive cravlers)
logo Curious George2019-03-06 10:05:19DownDown
logo Ezooms2018-10-11 23:58:36UP
logo techleadzbot2018-07-18 07:39:08Down
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.