Resources > UA list: crawlers

Udger database includes detailed information about every single user agent and operating system

Select list type: Browsers, email clients ... | Operating systems | Devices| Crawlers (Robots)


Category: All - Search engines - Marketing - Screenshots - Monitors - Feeds - Link checkers - Scrapers - Tools - Speed test - Vulnerability/Virus


Crawlers (Robots)Last seenbot URLProducer URL
logo DotBot2021-12-03 07:46:42UPUP
logo SEMrushBot2021-12-03 07:44:20UPUP
logo AhrefsBot2021-12-03 07:22:24UPUP
logo MJ12bot2021-12-03 06:54:20UPUP
logo ZoomInfo bot2021-12-03 06:17:03UP
logo SentiBot2021-12-03 05:07:16UPUP
logo Google-Ads2021-12-03 03:22:10UPUP
logo BLEXBot2021-12-03 03:19:05UPUP
logo trendictionbot2021-12-03 03:14:19UPUP
logo proximic2021-12-03 03:13:15UPUP
logo Mediatoolkitbot2021-12-03 03:13:14UP
logo AppNexus crawler2021-12-03 03:13:12UP
logo serpstatbot2021-12-03 01:00:49UPUP
logo MegaIndex2021-12-02 22:00:46UPDown
logo Dataprovider Spider2021-12-02 21:35:05UPUP
logo Google AdSense2021-12-02 09:13:31UPUP
logo ADmantX crawler2021-12-02 08:45:01UPUP
logo uMBot2021-12-02 08:38:51UP
logo GrapeshotCrawler2021-12-02 06:56:22UPUP
logo Google-Shopping2021-12-01 23:04:35UPUP
logo RankurBot2021-12-01 15:08:35UPUP
logo linkdexbot2021-12-01 11:58:24UPUP
logo woobot2021-12-01 10:53:47UPUP
logo SurdotlyBot2021-12-01 09:15:21UPUP
logo SMTBot2021-12-01 08:05:25UPUP
logo SERPtimizerBot2021-11-30 06:34:44UPUP
logo ZoomBot2021-11-29 06:33:57DownUP
logo Adbeat bot2021-11-28 04:25:44UPUP
logo SEOkicks-Robot2021-11-27 05:07:13UP
logo Datanyze2021-11-26 11:36:34UPUP
logo webgains-bot2021-11-24 15:06:32UP
logo Ryte Bot2021-11-23 22:56:08UPUP
logo bingbot2021-11-20 05:36:38UPUP
logo SEOlizer2021-11-18 07:44:30UPUP
logo HubSpot Crawler2021-11-13 21:22:06UP
logo Seostar.co bot2021-11-13 10:21:42UPUP
logo CriteoBot2021-11-09 20:34:55UPUP
logo MixrankBot2021-11-09 18:30:25UP
logo Roistat Bot2021-11-09 15:22:08UP
logo pr-cy.ru Bot2021-10-16 08:14:07UPUP
logo Awario crawler2021-10-16 08:01:02UPUP
logo SISTRIX Optimizer2021-10-08 21:40:53UPUP
logo SEOdiver2021-10-04 14:22:19UPUP
logo GetintentCrawler2021-10-03 15:03:44UPUP
logo deepcrawl2021-09-20 06:05:37UPUP
logo JamesBOT2021-09-16 04:22:27UPUP
logo DomCop Bot2021-09-07 16:02:43UPUP
logo Cocolyze bot2021-08-24 18:49:18DownDown
logo LinkedInBot2021-07-31 08:06:24UP
logo rogerbot2021-07-13 16:55:03UPUP
logo demandbase-bot2021-06-03 08:03:33UP
logo LinkpadBot2021-05-26 01:41:43DownUP
logo MTRobot2021-04-09 19:37:11DownUP
logo MicroAdBot2021-03-26 14:12:31UP
logo XoviBot2021-03-07 11:34:54UPUP
logo Brandwatch crawler2021-02-21 02:02:49UP
logo LinqiaBot2021-02-18 12:44:50UP
logo MarketingMiner Bot2021-02-15 14:05:09UP
logo Online Domain Tools2021-02-06 12:45:06UP
logo Primis crawler2021-01-06 03:34:13UPUP
logo SeoSiteCheckup2020-12-15 11:39:21UP
logo SE Ranking bot2020-12-07 13:19:20UP

Maybe inactive robots (One year we have not heard about them)
logo Hypefactors crawler2020-09-03 02:38:58UPUP
logo Rival IQ2020-09-02 14:12:45UP
logo Marfeel crawler2020-08-04 18:29:59UPUP
logo Buzzbot2020-07-12 08:59:24UP
logo Sistrix crawler2020-06-09 17:19:29UP
logo EchoboxBot2020-06-09 08:32:56UP
logo Traackr.com2020-05-26 11:35:48UP
logo SemtixBot2020-05-10 06:35:26UPUP
logo adstxt.com crawler2020-04-17 14:03:34UPUP
logo VerticalLeap bot2020-03-04 05:52:35UPUP
logo AddThis.com2020-02-21 20:13:50UPUP
logo AffiliateLabz crawler2020-02-16 03:30:53UP
logo Mappy2020-02-12 05:45:04UPUP
logo SeopultContentAnalyzer2020-01-15 07:55:54UP
logo StatvooBot2020-01-14 20:19:54UPUP
logo GroupHigh2020-01-04 08:51:34UP
logo Sideqik crawler2019-12-11 21:26:43UP
logo BirilBot2019-11-15 00:10:07UPUP
logo MarketMuseBot2019-10-01 05:59:46DownUP
logo OnCrawl2019-09-23 10:12:38UPUP
logo LXRbot2019-09-04 07:18:44UPUP
logo ISOWQ2019-09-04 07:18:43UPUP
logo Pulsepoint crawler2019-09-03 07:34:19UP
logo Infegy2019-08-08 07:07:48UP
logo Adform crawler2019-06-17 06:26:48UPUP
logo monitorabot2019-06-04 05:31:05UP
logo IAB crawler2019-04-25 21:39:59UP
logo keyword-hero bot2019-02-25 07:25:28UPUP
logo Enolyst Crawler2018-12-26 07:01:37UPUP
logo LeadCrunch crawler2018-11-04 12:23:57DownUP
logo lsv1_ads.txt_crawler2018-10-24 10:02:49UPUP
logo SBooksNet2018-10-16 11:28:09UPUP
logo Companybook Crawler2018-10-14 18:15:33UP
logo uCrawler2018-10-04 07:55:38UPUP
logo Eyeotabot2018-09-28 12:00:30UP
logo IndustryIndexBot2018-06-13 04:52:12DownUP
logo Digincore bot2018-04-18 01:49:55DownUP
logo Codewise bot2018-04-17 07:49:20UPUP
logo orion-semantics.com2018-04-09 06:42:06UP
logo Semasio crawler2018-03-02 17:33:00UP
logo DJEcoBot2017-07-25 17:38:24UP
logo epicbot2017-07-06 11:33:41UPUP
logo Seologies2017-07-04 08:08:32UP
logo Goodzer2017-06-19 13:59:39UP
logo cXensebot2017-06-08 05:04:05UP
logo electricmonk2017-06-02 12:07:26UPUP
logo StorygizeBot2017-03-30 13:05:54UP
logo SalesIntelligent2017-02-16 06:07:22UP
logo mbot2017-01-22 08:28:57UP
logo SiteAnalyzerBot2016-09-29 07:28:04UP
logo HybridBot2016-09-09 06:44:57UP
logo RankvalBot2016-08-26 09:22:52UP
logo Yieldbot2016-08-25 18:45:15UP
logo UXCrawlerBot2016-08-24 06:15:06UP
logo Dex Media Bot2016-08-22 14:17:29UP
logo SmabblerBot2016-08-01 16:37:50UP
logo mfibot2016-06-29 16:51:19UP
logo Multiviewbot2016-06-22 11:34:01UP
logo Seoterritory.com2016-01-28 11:40:51UP
logo Googlebot2016-01-12 08:04:47UPUP
logo Yahoo! JAPAN2014-09-26 06:30:29UPUP

Historical (Old robots, Inactive cravlers)
logo Ezooms2021-06-21 22:52:12UP
logo Curious George2020-10-07 13:20:42DownDown
logo 007AC92018-12-29 20:50:22DownUP
logo spbot2018-10-16 10:14:46DownUP
logo techleadzbot2018-07-18 07:39:08Down
logo Cityreview Robot2011-03-12 10:00:11DownUP
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.