| Producer | Unknown Author |
| Other robots of the same producer | 1M7bot, AAABot, AASA-Bot, ABEvalBot, AccompanyBot, adaptive-bot, AdBot, AdsrvrBot, AdsTxtBot, AdsTxtCrawler, AdsTxtCrawlerTP, advanced_crawler, Adventurer, AlexionResearchBot, alienfarm, ALittle Client, AliyunSecBot, AntBot, AnyBot, Apache-Smuggler, aranhabot, Aream Crawler, AteniumBot, Autoconfig Test from USTC, autoemailspider, BacklinkSpider, BackScanX, badbot, BananaBot, bang2012, bbot, BDBot, Bender, Bimbot, BorneoBot, Bot, bot;, BotPoke, brands-bot, brands-bot-logo, browserClientA, BSbot, CandidateCrawler, cc_bot, Centro Ads.txt Crawler, centurybot, CF-UC User Agent, chimebot, ChimeUnfurlAgent, clark-crawler, CLcrawler, Clearscopebot, CMS-Checker, CompanyCrawler, CoreBot, CrawlBot, Crawler, Crawler-IP-Fetcher, crawler_eb_germany, CrawlyProjectCrawler, curb, Custom-AsyncHttpClient, CustomScanner, CXK_Bot, dark_NeXus_Qbot, DARPResearchBot, DAutoBot, DaveCrawler, Desync-Exploit, DF Bot, Dmbot, DnBCrawler, DomainAuditor, Dormouse, DownloaderChrome, ds-robot, edansbot, Elisabot, EmailWolf, env-checker, EnvScanner, ErisBot, fake_bot, FAST-WebCrawler, fedcrawl, Fellow Links Parser Robot, fidget-spinner-bot, FlfBaldrBot, FlorKz., Friendly testing bot, friendly-spider, FriendlyCrawler, FriendlyRssReader, Friendly_Crawler, Fuze_Bot, g2crawler, gaeskeun_bot, GeneralWebsiteSpider, Gensparkbot, GlobalGoalsDirectoryBot, GlobalWebSearch, Golfe, GoodBot, google resource, GoogleRot, GoParserBot, GoRedirectChecker, GoScanner, gregcrawler, Grover, gschaid bot, Guest, HanaleiBot, HappyWing, HAProxy-Smuggler, HawaiiBot, Headless Chrome, Headless Edge, HealthCheckBot, Hello World, hopgoblin, HostHeaderScanner, howBot, IBM Crawler, ImageBot, ImageMind, Implcit:AdsTxt-Scrapr, Info bot, ip9max, ISSCyberRiskCrawler, jaddjabot, JSACrawlerBot, jurgendata, K/b-scanner, KauaiBot, KauaiSlowBot, Keerthi Bot, keys-so-bot, LanaiBot, libredtail-http, linabot, link-geo-country, linus-torvalds-loves-you, Linux Gnu (cow), LMCSearchBot, loadtest, lolbot, loli_spider, LookoutBot, lunabot, Magellan, magicsearchdev, MassScanner, MauiBot, MetadataScraper, MiniWebCrawler, mj-wordpress-crawler, MJBot, ModelContextProtocol, Monibot, MoonBot, More, Mozilla, My Nutch Spider, my-tiny-bot, MyBot, MyCrawler, MyEducationalCrawler, n8n-serp-crawler, Navy Federal, nbertaupete95, NetAPI, newspaper, newswtbot, Nexgate Ruby Client, Nginx-Smuggler, Nicecrawler, NinjaAIBot, NiueBot, Nutch Spider, nvdorz, OgScrper, OIDC-Fetcher, Orbbot, p40Bot, parisbot, PDFBot, PhantomBot, PhxBot, PlamoExplorer, PoeSearchBot, polaris botnet, polite-crawler, PoliteCrawl, PopScreen Bot, PrivateBot, PS_Daily, QBOT, r00ts3c-owned-you, RainBot, Rankabot, Rely Bot, ResearchBot, researchxoftheweb, Robot, robots-ai-permissions, robots-bulk-crawler, robots.py, rss-feed-index-bot, RssReaderBot, RW_Crawler, SaluteBot, ScamadviserExternalHit, SCAN, ScannerBot, sc_bot, search-engine-indexer, Searcherweb, Searcherxweb, SearchExpress, SEBot-WA, sempi.tech bot, sendgrid-scanner, SeoCherryBot, seoscanners.net bot, SeoulBot, sexy-spider, ShapBot, ShellBot, site-checker, SkyworkSpider, SlaccaleBot, SmartBotCrawler, Snap URL Preview Service, Spider, Spider_Bot, SQ-Scanner, SQLi-Scanner, SSSSBot, StactBot, Storm-crawler, studyBot, SummalyBot, SuperBot, SuperFastScraper, SuperMegaHyperColossalMassiveGiganticAstronomicalM, SyncSearch, TakeoverScanner, TechNewsBot, tes-cocrawler, Test, Test Certificate Info, test-bot, TestBot, TestCrawler, TestUserAgent, The Knowledge AI, TheInternetSearch, Theophrastus, thesis-research-bot, ThinkChaos, Timing-Analysis, TinyBotTestUA, TinyTestBot, TinyTestBoty, TMM Crawler, TprAdsTxtCrawler, Tranco Crawler, TrendsmapResolver, Triplechecker, Trokambot, TSpider, Unknown bot, UppinaMonitor, UrlTest, v0bot, VDP-Scanner, ViberBot, VsuSearchSpider, WAF-Bypass-Test, WanScannerBot, WarpBot, Web Crawler, web-crawler, WebBot, WebCrawler, WebRankSpider, websusebot, web_fetcher, WF search, WhatStuffWhereBot, white-analyz-bug, wise, Wordup-1, Wordupindexinfo1, WorksOgCrawler, WorldBot, wpbot, WPCheckBot, WPDetector, xfa1, XTC BOTNET, YFF35, your-search-bot, YunSecurityBot, Yuuperbot, ZAKREGEX-Scanner, zebra-v2-bot, Zephuli-Bot, zzhbot, _1z_bot, _zbot |
| Bot URL | |
| Status | Active |
Known variants
|
| Useragentstring | Gwene/1.0 (The gwene.org rss-to-news gateway) Googlebot
|
| Category | Web scraper |
| First seen | 2022-12-01 10:19:43 |
| Last seen | 2025-12-05 07:39:42 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-06-08 14:59:08 |
| Last seen | 2025-12-05 04:43:51 |
| IP addresses | 18,308 |
| Walk from |
| 47.128.113.161 | ec2-47-128-113-161.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.37.181 | ec2-47-128-37-181.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.49.72 | ec2-47-128-49-72.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.57.52 | ec2-47-128-57-52.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.99.118 | ec2-47-128-99-118.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.118.23 | ec2-47-128-118-23.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.120.189 | ec2-47-128-120-189.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.17.4 | ec2-47-128-17-4.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.19.235 | ec2-47-128-19-235.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.24.84 | ec2-47-128-24-84.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2023-06-05 18:28:24 |
| Last seen | 2025-12-05 04:30:43 |
| IP addresses | 21,097 |
| Walk from |
| 47.128.20.30 | ec2-47-128-20-30.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.27.101 | ec2-47-128-27-101.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.35.36 | ec2-47-128-35-36.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.109.89 | ec2-47-128-109-89.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.19.177 | ec2-47-128-19-177.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.32.155 | ec2-47-128-32-155.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.98.228 | ec2-47-128-98-228.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.54.218 | ec2-47-128-54-218.ap-southeast-1.compute.amazonaws.com |  | AU |  |
| 47.128.56.114 | ec2-47-128-56-114.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.113.53 | ec2-47-128-113-53.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
|
| Category | Web scraper |
| First seen | 2018-03-30 07:29:59 |
| Last seen | 2025-12-04 06:17:42 |
| IP addresses | 2,671 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 (+http://search.msn.com/msnbot.htm\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:11:26 |
| Last seen | 2025-12-01 04:53:29 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2025-11-30 10:14:59 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/\xA1\xB1; )
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2025-11-30 05:11:33 |
| IP addresses | 17 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2018-04-18 12:36:23 |
| Last seen | 2025-11-29 06:58:46 |
| IP addresses | 334 |
| Walk from |
|
|
| Useragentstring | (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2024-05-17 13:46:13 |
| Last seen | 2025-11-27 09:44:59 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | iaskspider/2.0(+http://iask.com/help/help_index.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-16 15:01:10 |
| Last seen | 2025-11-27 09:44:58 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4201.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2021-09-02 05:11:43 |
| Last seen | 2025-11-26 09:28:15 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Sogou Push Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:04 |
| Last seen | 2025-11-26 06:29:33 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2020-03-15 08:15:41 |
| Last seen | 2025-11-25 04:16:25 |
| IP addresses | 1,614 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 (+http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2011-01-23 15:09:17 |
| Last seen | 2025-11-23 14:58:46 |
| IP addresses | 121 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
|
| Category | Web scraper |
| First seen | 2024-06-03 03:05:24 |
| Last seen | 2025-11-22 06:04:47 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-02-05 21:44:31 |
| Last seen | 2025-11-21 07:01:01 |
| IP addresses | 23 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/88.0.4324.175 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-07-04 04:59:45 |
| Last seen | 2025-11-20 07:35:07 |
| IP addresses | 105 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:19 |
| Last seen | 2025-11-19 13:24:38 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Googlebot/2.1
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2025-05-25 13:42:04 |
| Last seen | 2025-11-18 03:46:45 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | CCBot
|
| Category | Web scraper |
| First seen | 2025-02-12 19:53:02 |
| Last seen | 2025-11-11 17:35:28 |
| IP addresses | 1,233 |
| Walk from |
|
|
| Useragentstring | msnbot/0.11 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-03-18 10:43:48 |
| Last seen | 2025-11-03 01:41:39 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Googlebot-News
|
| Category | Web scraper |
| First seen | 2020-12-22 05:17:05 |
| Last seen | 2025-11-01 18:43:53 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-16 14:35:30 |
| Last seen | 2025-10-31 05:49:10 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | AdsBot-Google ( http://www.google.com/adsbot.html)
|
| Category | Web scraper |
| First seen | 2020-09-02 16:18:57 |
| Last seen | 2025-10-30 09:07:55 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-06-19 14:11:31 |
| Last seen | 2025-10-25 03:58:14 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\x09
|
| Category | Web scraper |
| First seen | 2019-05-22 04:20:20 |
| Last seen | 2025-10-20 22:00:49 |
| IP addresses | 491 |
| Walk from |
|
|
| Useragentstring | msnbot/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2020-03-26 12:49:59 |
| Last seen | 2025-10-18 18:28:27 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
|
| Category | Web scraper |
| First seen | 2018-10-09 02:34:15 |
| Last seen | 2025-10-13 17:17:34 |
| IP addresses | 168 |
| Walk from |
|
|
| Useragentstring | grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)
|
| Category | Web scraper |
| First seen | 2020-07-18 20:02:13 |
| Last seen | 2025-10-07 05:02:08 |
| IP addresses | 18 |
| Walk from |
|
|
| Useragentstring | facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)
|
| Category | Web scraper |
| First seen | 2020-06-20 05:58:53 |
| Last seen | 2025-10-02 03:34:45 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Baiduspider ( http://www.baidu.com/search/spider.htm)
|
| Category | Web scraper |
| First seen | 2020-01-02 10:43:07 |
| Last seen | 2025-09-26 16:28:39 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-02-15 02:57:31 |
| Last seen | 2025-09-24 10:34:54 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| First seen | 2018-04-26 16:22:53 |
| Last seen | 2025-09-22 16:28:56 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Gaisbot/3.0 (robot@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php)
|
| Category | Web scraper |
| First seen | 2020-02-06 05:51:00 |
| Last seen | 2025-09-21 14:48:15 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | GPTBot
|
| Category | Web scraper |
| First seen | 2025-09-18 00:14:39 |
| Last seen | 2025-09-19 08:09:39 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | msnbot-media/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-01-10 22:19:16 |
| Last seen | 2025-09-09 19:37:05 |
| IP addresses | 15 |
| Walk from |
|
|
| Useragentstring | FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)
|
| Category | Web scraper |
| First seen | 2022-05-02 06:09:58 |
| Last seen | 2025-09-09 07:05:45 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 11; Pixel 5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.70 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-09-04 04:17:50 |
| Last seen | 2025-09-09 05:59:51 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | compatible; Googlebot/2.1; +http://www.google.com/bot.htm
|
| Category | Web scraper |
| First seen | 2025-09-06 23:33:39 |
| Last seen | 2025-09-06 23:33:39 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Bingbot/2.0
|
| Category | Web scraper |
| First seen | 2025-07-10 05:51:02 |
| Last seen | 2025-09-04 04:45:06 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 ( http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-06-25 03:05:08 |
| Last seen | 2025-08-31 05:26:41 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.6668.71 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-08-24 14:42:58 |
| Last seen | 2025-08-24 15:52:15 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.4 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25
|
| Category | Web scraper |
| First seen | 2020-02-19 08:19:32 |
| Last seen | 2025-08-20 21:57:57 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-03-20 15:27:32 |
| Last seen | 2025-08-20 07:31:13 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-02-05 11:05:11 |
| Last seen | 2025-08-13 11:45:35 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.10) Gecko/20100623 Iceweasel/3.5.10 (like Firefox/3.5.10) Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2022-12-01 09:44:51 |
| Last seen | 2025-08-11 16:06:15 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Y!J-DLC/1.0 (https://support.yahoo-net.jp/PccSearch/s/article/H000007955)
|
| Category | Web scraper |
| First seen | 2024-11-11 06:32:44 |
| Last seen | 2025-07-23 05:24:35 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e YisouSpider/5.0 Safari/602.
|
| Category | Web scraper |
| First seen | 2025-07-11 06:18:22 |
| Last seen | 2025-07-11 06:31:22 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Facebot
|
| Category | Web scraper |
| First seen | 2021-07-14 04:42:54 |
| Last seen | 2025-06-28 16:32:43 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexNews/4.0; +http://yandex.com/bots)
|
| Category | Web scraper |
| First seen | 2020-07-01 05:51:44 |
| Last seen | 2025-06-13 13:31:05 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot-Video/1.0; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-06-12 17:57:50 |
| Last seen | 2025-06-12 17:57:50 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-09-14 20:06:01 |
| Last seen | 2025-06-10 04:23:45 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | BaiduSpider
|
| Category | Web scraper |
| First seen | 2022-09-03 03:05:42 |
| Last seen | 2025-06-05 11:30:27 |
| IP addresses | 64 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexBot/3.0; +<http://yandex.com/bots>)
|
| Category | Web scraper |
| First seen | 2025-05-25 13:40:57 |
| Last seen | 2025-05-25 13:40:57 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-07-05 04:31:51 |
| Last seen | 2025-05-16 19:18:29 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/136.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-05-14 14:46:10 |
| Last seen | 2025-05-14 14:46:10 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/87.0.4280.90 Safari/537.36,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2025-04-30 06:30:04 |
| Last seen | 2025-04-30 06:30:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | gptbot
|
| Category | Web scraper |
| First seen | 2025-04-29 15:28:28 |
| Last seen | 2025-04-29 15:28:28 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 Baiduspider+(+http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2025-04-10 04:20:04 |
| Last seen | 2025-04-10 04:20:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; Y!J-BRY/YATSH crawler; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
|
| Category | Web scraper |
| First seen | 2025-03-31 12:11:01 |
| Last seen | 2025-03-31 12:11:01 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Blogtrottr/2.1 (+https://blogtrottr.com/)
|
| Category | Web scraper |
| First seen | 2025-03-18 18:21:55 |
| Last seen | 2025-03-24 16:26:44 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | CriteoBot/0.1
|
| Category | Web scraper |
| First seen | 2025-03-20 23:18:13 |
| Last seen | 2025-03-20 23:18:13 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-12-16 17:58:46 |
| Last seen | 2025-03-13 13:23:51 |
| IP addresses | 32 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0;+http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2019-09-14 06:14:20 |
| Last seen | 2025-03-08 09:11:49 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-03-04 09:13:40 |
| Last seen | 2025-03-04 09:13:40 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Twitterbot
|
| Category | Web scraper |
| First seen | 2020-12-25 05:21:58 |
| Last seen | 2025-02-18 22:48:10 |
| IP addresses | 42 |
| Walk from |
| 185.171.31.35 | 185.171.31.35 | | DE |  |
| 3.252.218.14 | ec2-3-252-218-14.eu-west-1.compute.amazonaws.com |  | IE |  |
| 52.17.111.171 | ec2-52-17-111-171.eu-west-1.compute.amazonaws.com |  | IE |  |
| 3.248.204.118 | ec2-3-248-204-118.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.244.227.33 | ec2-34-244-227-33.eu-west-1.compute.amazonaws.com |  | IE |  |
| 18.201.208.0 | ec2-18-201-208-0.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.242.60.96 | ec2-34-242-60-96.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.254.191.77 | ec2-34-254-191-77.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.245.64.192 | ec2-34-245-64-192.eu-west-1.compute.amazonaws.com |  | IE |  |
| 3.252.141.124 | ec2-3-252-141-124.eu-west-1.compute.amazonaws.com |  | IE |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | GPTBot/1.0
|
| Category | Web scraper |
| First seen | 2025-01-13 05:19:56 |
| Last seen | 2025-02-16 17:42:24 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google Favicon
|
| Category | Web scraper |
| First seen | 2025-02-07 17:01:39 |
| Last seen | 2025-02-16 07:28:16 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Yandex
|
| Category | Web scraper |
| First seen | 2025-02-14 19:08:16 |
| Last seen | 2025-02-14 19:08:28 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Exabot
|
| Category | Web scraper |
| First seen | 2025-02-07 09:06:24 |
| Last seen | 2025-02-07 14:48:23 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | googlebot
|
| Category | Web scraper |
| First seen | 2020-10-13 18:45:00 |
| Last seen | 2025-01-29 15:28:00 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.4; +http://www.ymwears.cn)
|
| Category | Web scraper |
| First seen | 2025-01-02 07:02:44 |
| Last seen | 2025-01-16 01:24:50 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://docs.perplexity.ai/docs/perplexity-bot)
|
| Category | Web scraper |
| First seen | 2024-08-02 03:32:26 |
| Last seen | 2025-01-14 04:15:03 |
| IP addresses | 1,497 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/
|
| Category | Web scraper |
| First seen | 2024-10-01 05:14:06 |
| Last seen | 2025-01-09 06:02:32 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 7.0; SM-G930V Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36 (compatible; Google-Read-Aloud; +https://support.google.com/webmasters/answer/1061943
|
| Category | Web scraper |
| First seen | 2025-01-05 04:41:16 |
| Last seen | 2025-01-05 04:41:16 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | yandex bot
|
| Category | Web scraper |
| First seen | 2024-12-18 19:36:08 |
| Last seen | 2024-12-18 19:36:08 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 16_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Mobile/15E148 Safari/604.1 (compatible; Yeti/1.1; +https://naver.me/spd)
|
| Category | Web scraper |
| First seen | 2024-05-28 05:58:19 |
| Last seen | 2024-12-10 06:24:22 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | bingbot
|
| Category | Web scraper |
| First seen | 2019-03-29 13:20:11 |
| Last seen | 2024-11-28 09:33:29 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2016-07-20 00:20:12 |
| Last seen | 2024-11-26 13:27:57 |
| IP addresses | 42 |
| Walk from |
|
|
| Useragentstring | User-Agent: Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/fc0b683 warc/v0.8.53
|
| Category | Web scraper |
| First seen | 2024-11-13 10:07:36 |
| Last seen | 2024-11-13 10:07:36 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/fc0b683 warc/v0.8.53
|
| Category | Web scraper |
| First seen | 2024-11-01 06:09:10 |
| Last seen | 2024-11-06 04:15:20 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.110 Mobile Safari/537.36 (compatible; Google-AMPHTML)
|
| Category | Web scraper |
| First seen | 2024-11-03 12:48:02 |
| Last seen | 2024-11-03 12:48:02 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.5183.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2024-10-29 22:28:12 |
| Last seen | 2024-10-29 22:28:12 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Googlebot/2.1;compatible;+http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2024-10-25 23:14:35 |
| Last seen | 2024-10-25 23:14:35 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Googlebot/2.1)
|
| Category | Web scraper |
| First seen | 2024-10-25 23:06:49 |
| Last seen | 2024-10-25 23:06:49 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/121.0.6167.184 Safari/537.36
|
| Category | Web scraper |
| First seen | 2024-10-16 06:19:36 |
| Last seen | 2024-10-25 09:16:37 |
| IP addresses | 8 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/88.0.4288.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2024-10-21 16:40:52 |
| Last seen | 2024-10-21 16:40:52 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.6167.184 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2024-08-02 16:07:58 |
| Last seen | 2024-10-21 09:27:49 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.5286.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2024-10-20 18:08:59 |
| Last seen | 2024-10-20 18:08:59 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4703.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2024-09-26 19:00:50 |
| Last seen | 2024-09-26 19:00:50 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/103.0.9999.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2024-09-20 11:57:21 |
| Last seen | 2024-09-20 11:57:21 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Googlebot (+http://www.google.com/bot.html))
|
| Category | Web scraper |
| First seen | 2024-03-15 11:16:48 |
| Last seen | 2024-09-12 17:57:09 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | AwarioSmartBot/1.0
|
| Category | Web scraper |
| First seen | 2024-09-11 14:48:04 |
| Last seen | 2024-09-11 14:48:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +https://www.cloudflare.com/always-online) AppleWebKit/534.34
|
| Category | Web scraper |
| First seen | 2024-09-09 10:41:32 |
| Last seen | 2024-09-09 10:41:32 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1.1-beta (+http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2024-08-27 05:52:48 |
| Last seen | 2024-09-03 09:41:29 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2016-08-18 16:05:46 |
| Last seen | 2024-08-12 08:15:12 |
| IP addresses | 83 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider-render/2.0; Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.1 Safari/537.36
|
| Category | Web scraper |
| First seen | 2022-09-19 05:24:52 |
| Last seen | 2024-08-10 07:07:01 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2019-10-02 08:33:42 |
| Last seen | 2024-08-06 07:47:35 |
| IP addresses | 124 |
| Walk from |
|
|
| Useragentstring | google
|
| Category | Web scraper |
| First seen | 2016-06-30 03:50:19 |
| Last seen | 2024-07-29 04:19:15 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:89.0) Gecko/20100101 Firefox/89.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2024-07-25 04:31:17 |
| Last seen | 2024-07-25 04:31:17 |
| IP addresses | 1 |
| Walk from |
|