Resources > UA list: crawlers

Udger database includes detailed information about ever single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo SEMrushBot2018-11-18 19:20:42UPUP
logo BLEXBot2018-11-18 19:14:30UPUP
logo DotBot2018-11-18 18:49:07UPUP
logo AhrefsBot2018-11-18 18:46:57UPUP
logo MJ12bot2018-11-18 18:23:58UPUP
logo GrapeshotCrawler2018-11-18 16:46:18UPUP
logo Googlebot2018-11-18 05:57:26UPUP
logo linkdexbot2018-11-18 05:55:31UPUP
logo Datanyze2018-11-18 05:37:33UP
logo Pulsepoint crawler2018-11-18 05:22:07UP
logo Mappy2018-11-18 05:05:03UPUP
logo MegaIndex2018-11-18 02:33:34UPDown
logo magpie-crawler2018-11-17 23:16:33UPUP
logo Infegy2018-11-17 07:25:22UP
logo Mediatoolkitbot2018-11-17 06:01:57UP
logo Adbeat bot2018-11-17 05:10:11UPUP
logo Dataprovider Spider2018-11-16 22:12:40UPUP
logo demandbase-bot2018-11-16 22:09:08UP
logo LinkedInBot2018-11-16 21:01:16UP
logo SMTBot2018-11-16 14:51:32UPUP
logo HubSpot Crawler2018-11-16 14:09:34UP
logo SEOkicks-Robot2018-11-16 04:21:43UP
logo SentiBot2018-11-15 12:45:49UPUP
logo Enolyst Crawler2018-11-15 09:20:50UPUP
logo proximic2018-11-15 05:04:10UPUP
logo Ryte Bot2018-11-14 22:26:26UPUP
logo SurdotlyBot2018-11-14 09:48:51UPUP
logo XoviBot2018-11-14 08:14:56UPUP
logo RankurBot2018-11-13 15:49:33UPUP
logo GroupHigh2018-11-12 18:33:54UP
logo Bot2018-11-12 15:51:37UP
logo ZoomBot2018-11-12 13:12:45UPUP
logo SEOdiver2018-11-12 06:26:32UPUP
logo MarketingMiner Bot2018-11-08 07:14:45UP
logo LinqiaBot2018-11-07 07:22:51UP
logo JamesBOT2018-11-06 06:32:11UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo trendictionbot2018-11-02 07:24:14UPUP
logo woobot2018-10-24 10:07:10UPUP
logo Buzzbot2018-10-22 23:34:39UP
logo ZoomInfo bot2018-10-18 19:34:54UP
logo SBooksNet2018-10-16 11:28:09UPUP
logo spbot2018-10-16 10:14:46UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo deepcrawl2018-10-04 08:07:17UPUP
logo uCrawler2018-10-04 07:55:38UPUP
logo SeopultContentAnalyzer2018-09-24 15:54:57UP
logo SE Ranking bot2018-08-28 09:10:23UP
logo rogerbot2018-08-24 17:07:03UPUP
logo Online Domain Tools2018-07-18 11:49:38UP
logo techleadzbot2018-07-18 07:39:08UP
logo 007AC92018-07-08 14:16:41UPUP
logo EchoboxBot2018-06-21 09:34:01UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo LXRbot2018-05-17 10:31:45UP
logo Hypefactors crawler2018-04-20 08:14:23UPUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo ISOWQ2018-02-05 11:05:25UPUP

Maybe inactive robots (One year we have not heard about them)
logo GetintentCrawler2017-11-13 02:43:35UPUP
logo MixrankBot2017-09-14 00:46:06UP
logo Traackr.com2017-09-05 06:44:10UP
logo LinkpadBot2017-08-13 19:51:17UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo Sistrix crawler2017-06-14 07:50:46UPUP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo Awario crawler2017-05-26 10:53:47UPUP
logo AddThis.com2017-04-20 09:44:22UP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo bingbot2016-06-28 15:58:53UPUP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP

Historical (Old robots, Inactive cravlers)
logo Ezooms2018-10-11 23:58:36UP
logo Curious George2018-08-30 15:14:24DownDown
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.