Resources > UA list: crawlers

Udger database includes detailed information about ever single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)

Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus

Crawlers (Robots)Last seenbot URLProducer URL
logo DotBot2018-07-16 14:30:07UPUP
logo SEMrushBot2018-07-16 14:27:28UPUP
logo AhrefsBot2018-07-16 13:51:08UPUP
logo MJ12bot2018-07-16 13:02:54UPUP
logo SurdotlyBot2018-07-16 11:34:50UPUP
logo linkdexbot2018-07-16 10:29:04UPUP
logo Infegy2018-07-16 10:17:07UP
logo Googlebot2018-07-16 07:46:41UPUP
logo magpie-crawler2018-07-16 07:36:37UPUP
logo SEOdiver2018-07-16 05:53:32UPUP
logo SEOkicks-Robot2018-07-16 04:04:12UP
logo spbot2018-07-15 23:05:23UPUP
logo Dataprovider Spider2018-07-15 18:49:21UPUP
logo LinkedInBot2018-07-15 10:55:05UP
logo Adbeat bot2018-07-15 09:42:55UPUP
logo SentiBot2018-07-15 08:20:00UPUP
logo BLEXBot2018-07-15 08:18:10UPUP
logo Mappy2018-07-14 21:54:40UPUP
logo Datanyze2018-07-14 04:14:58UP
logo Mediatoolkitbot2018-07-13 18:53:01UP
logo Pulsepoint crawler2018-07-13 06:56:09UP
logo GroupHigh2018-07-11 19:56:58UP
logo RankurBot2018-07-11 17:00:11UPUP
logo ZoomInfo bot2018-07-11 07:26:24UP
logo SMTBot2018-07-10 21:09:22UPUP
logo MegaIndex2018-07-10 14:31:58UPDown
logo ZoomBot2018-07-10 05:44:44UPUP
logo uCrawler2018-07-10 03:01:41UPUP
logo 007AC92018-07-08 14:16:41UPUP
logo woobot2018-07-08 09:43:41UPUP
logo Enolyst Crawler2018-06-27 12:31:49UPUP
logo JamesBOT2018-06-25 08:05:21UPUP
logo rogerbot2018-06-25 06:28:24UPUP
logo XoviBot2018-06-21 11:10:25UPUP
logo LinqiaBot2018-06-21 10:15:10UP
logo EchoboxBot2018-06-21 09:34:01UP
logo GrapeshotCrawler2018-06-19 18:30:19UPUP
logo trendictionbot2018-06-19 08:27:11UPUP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo HubSpot Crawler2018-06-10 17:43:04UP
logo deepcrawl2018-05-31 11:05:29UPUP
logo LXRbot2018-05-17 10:31:45UP
logo proximic2018-05-17 02:10:05UPUP
logo techleadzbot2018-05-12 03:12:01UP
logo Hypefactors crawler2018-04-20 08:14:23UPUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo Bot2018-02-13 16:31:27UP
logo ISOWQ2018-02-05 11:05:25UPUP
logo Buzzbot2018-01-31 15:12:02UP
logo GetintentCrawler2017-11-13 02:43:35UPUP
logo Companybook Crawler2017-11-08 09:43:38UP
logo MixrankBot2017-09-14 00:46:06UP
logo Traackr.com2017-09-05 06:44:10UP
logo LinkpadBot2017-08-13 19:51:17UP
logo DJEcoBot2017-07-25 17:38:24UP

Maybe inactive robots (One year we have not heard about them)
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo Sistrix crawler2017-06-14 07:50:46UPUP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo Awario crawler2017-05-26 10:53:47UPUP
logo AddThis.com2017-04-20 09:44:22UP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SeopultContentAnalyzer2016-10-26 12:52:07UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo Online Domain Tools2016-08-31 16:00:59UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo bingbot2016-06-28 15:58:53UPUP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP

Historical (Old robots, Inactive cravlers)
logo Curious George2016-10-09 06:21:53DownDown
logo Ezooms2014-04-15 00:03:57UP
Among our clients
View more...
 Dailymotion SA  
 Akamai Technologies, Inc.  
 PayPal Holdings, Inc.