| Producer | Unknown Author |
| Other robots of the same producer | 1M7bot, AAABot, AASA-Bot, ABEvalBot, AccompanyBot, adaptive-bot, AdBot, AdsBot, AdsrvrBot, AdsTxtBot, AdsTxtCrawler, AdsTxtCrawlerTP, advanced_crawler, Adventurer, AI-Security-Scanner, AlexionResearchBot, AlgorandSearchBot, alienfarm, ALittle Client, AliyunSecBot, altsvc-probe, AntBot, AnyBot, Apache-Smuggler, Aranet-SearchBot, aranhabot, Aream Crawler, AteniumBot, AtlasBot, Authorized-BugBounty-Env-Scanner, Autoconfig Test from USTC, autoemailspider, BacklinkBot, BacklinkCrawler, BacklinkSpider, BackScanX, badbot, BananaBot, bang2012, bbot, BDBot, Bender, Bimbot, BitFire-IconUpscaler, BlazeBot, BorneoBot, Bot, bot;, BotPoke, br-crawler, brands-bot, brands-bot-logo, browserClientA, BSbot, BusinessNameBot, CAISearchBot, CandidateCrawler, capsfusion-downloader, cc_bot, Centro Ads.txt Crawler, centurybot, CerebroBot, CF-UC User Agent, chimebot, ChimeUnfurlAgent, clark-crawler, ClawBot, CLcrawler, Clearscopebot, CMS-Checker, CommonCrawlNutchBot, CompanyCrawler, ComplianceChecker, ConvomeshBot, CoreBot, CrawlBot, Crawler, Crawler test, Crawler-IP-Fetcher, crawler_eb_germany, CrawlyProjectCrawler, Ctrl0Worker, curb, Custom-AsyncHttpClient, CustomScanner, CXK_Bot, dark_NeXus_Qbot, DARPResearchBot, DAutoBot, DaveCrawler, Desync-Exploit, devlo-celeste-domain-waterfall, DF Bot, Dispatch, Dmbot, DnBCrawler, DNSCrawler, domain-profiler, DomainAuditor, DomainChecker, DomainCrawler, DomainScoutBot, DomainShield, Dormouse, DownloaderChrome, ds-robot, edansbot, Elisabot, EmailWolf, employer-address-finder, env-checker, EnvScanner, ErisBot, ExaticsBot, expo-research-bot, fake_bot, FAST-WebCrawler, fedcrawl, FeedBot, FeedValidator, Fellow Links Parser Robot, fidget-spinner-bot, FileSearchTools, FlfBaldrBot, FlorKz., Friendly testing bot, friendly-spider, FriendlyCrawler, FriendlyRssReader, Friendly_Crawler, Fuze_Bot, g2crawler, gaeskeun_bot, GeneralWebsiteSpider, Gensparkbot, GlobalGoalsDirectoryBot, GlobalWebSearch, Golfe, GoodBot, google resource, GoogleRot, GoParserBot, GoRedirectChecker, Gort, GoScanner, gregcrawler, Grover, gschaid bot, Guest, HanaleiBot, HappyWing, HAProxy-Smuggler, HawaiiBot, Headless Chrome, Headless Edge, HealthCheckBot, heimdall, Hello World, hopgoblin, HostHeaderScanner, howBot, HubSeedsBot, IBM Crawler, ImageBot, ImageMind, IMATA-Bot, IMJ-CompanyPage-Scraper, Implcit:AdsTxt-Scrapr, Info bot, IntelligenceCollector, ip9max, ISSCyberRiskCrawler, jaddjabot, jinming-test-hf-dataset-to-hdfs, JSACrawlerBot, JSCrawler, jurgendata, K/b-scanner, KauaiBot, KauaiSlowBot, Keerthi Bot, keys-so-bot, keyword-monitor, LanaiBot, LetrixLabs, libredtail-http, linabot, link-geo-country, linus-torvalds-loves-you, Linux Gnu (cow), LinuxGetSsl, LiteLLM-Scanner, LLMS-Txt-Scanner, LMCSearchBot, loadtest, LogMonitorBot, lolbot, loli_spider, LookoutBot, LumeWebScan, lunabot, Magellan, magicsearchdev, MarkdownWorker, MassScanner, MauiBot, MetadataScraper, metaphor-data-pipeline, MiniWebCrawler, mj-wordpress-crawler, MJBot, ModelContextProtocol, Monibot, MoonBot, More, Mozilla, My Nutch Spider, my-tiny-bot, MyBB-Archive-Bot, MyBot, MyCheckerBot, MyCrawler, MyEducationalCrawler, n8n-serp-crawler, NapBot, Navy Federal, nbertaupete95, NetAPI, newspaper, newswtbot, Nexgate Ruby Client, Nginx-Smuggler, Nicecrawler, NinjaAIBot, NiueBot, Nutch Spider, nvdorz, OgScrper, OIDC-Fetcher, OnlyHTML, OpenInternet-Discovery, OpenTheBoxBot, OpstimalBot, Orbbot, OSeans7Bot, OSSPVTracking, p40Bot, parisbot, parquet-filter-downloader, PDFBot, PhantomBot, PhxBot, pimeyes-downloader-api, PlamoExplorer, PoeSearchBot, polaris botnet, polite-crawler, PoliteCrawl, PopScreen Bot, pqc-http-scan, PragmaticSecurity-Scanner, PrivacyPolicyBot, PrivateBot, ProductLookoutBot, PromptingBot, ProxyPool-Scanner, ProxyTest, PS_Daily, QBOT, quick_checker, r00ts3c-owned-you, RainBot, Rankabot, recon-engine, ReconBot, Relevant, Rely Bot, research crawler, ResearchBot, researchxoftheweb, Robot, robots-ai-permissions, robots-bulk-crawler, robots-scanner, robots.py, RootCrawl-Crawler, rss-feed-index-bot, RssReaderBot, runtime-resources-research, RW_Crawler, S-Scanner, SaluteBot, ScamadviserExternalHit, SCAN, ScannerBot, sc_bot, Seamus, search-engine-indexer, Searcherweb, Searcherxweb, SearchExpress, SEBot-WA, SecurityResearchBot, security_txt_analysis, sempi.tech bot, sendgrid-scanner, SeoCherryBot, seoscanners.net bot, SeoulBot, servicefilter, sexy-spider, ShapBot, ShellBot, SimpleAsyncPageCrawler, site-checker, SitemapBot, SitemapCrawler.de crawler, SkynetBot, SkyworkSpider, SlaccaleBot, SmartBotCrawler, smol-tiny-tarantula, Snap URL Preview Service, Social Listening API, SocialMediaScrapperv2, SOcrawl, some agent, Spider, Spider_Bot, SQ-Scanner, SQLi-Scanner, SSSSBot, StactBot, Storm-crawler, studyBot, SummalyBot, Supabase crawler, SupaGuard, SuperBot, SuperFastScraper, SuperMegaHyperColossalMassiveGiganticAstronomicalM, SyncSearch, TakeoverScanner, TDM-Checker, TDMScanner, TechDetect, TechNewsBot, tes-cocrawler, Test, Test Certificate Info, test-bot, TestBot, TestCrawler, TestUserAgent, The Knowledge AI, TheInternetSearch, Theophrastus, thesis-research-bot, ThinkChaos, ThresselScanner, Timing-Analysis, TinyBotTestUA, TinyTestBot, TinyTestBoty, TLSScanner, TMM Crawler, TprAdsTxtCrawler, Tranco Crawler, TrendsmapResolver, Triplechecker, Trokambot, TSpider, UCP-Discovery, Unknown bot, UppinaMonitor, UrlTest, v0bot, vague, VDP-Scanner, VexelSearchBot, ViberBot, VisionSet, VsuSearchSpider, WAF-Bypass-Test, WanScannerBot, WarpBot, Web Crawler, web-crawler, WebBot, WebCrawler, WebRankSpider, WebsiteFeeder, websusebot, web_fetcher, WF search, WhatStuffWhereBot, white-analyz-bug, wise, WooCommerce-Detector, Wordup-1, Wordupindexinfo1, WorksOgCrawler, WorldBot, wpbot, WPCheckBot, WPDetector, WPScanner, xfa1, XTC BOTNET, YFF35, your-search-bot, YunSecurityBot, Yuuperbot, ZAKREGEX-Scanner, zebra-v2-bot, Zephuli-Bot, ZeroBot, zzhbot, _1z_bot, _zbot |
| Bot URL | |
| Status | Active |
Known variants
|
| Useragentstring | Gwene/1.0 (The gwene.org rss-to-news gateway) Googlebot
|
| Category | Web scraper |
| First seen | 2022-12-01 10:19:43 |
| Last seen | 2026-05-04 11:09:52 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Exabot
|
| Category | Web scraper |
| First seen | 2025-02-07 09:06:24 |
| Last seen | 2026-05-04 10:46:10 |
| IP addresses | 162 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.6668.71 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-08-24 14:42:58 |
| Last seen | 2026-05-04 10:16:01 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2023-06-05 18:28:24 |
| Last seen | 2026-05-04 09:00:16 |
| IP addresses | 21,125 |
| Walk from |
| 47.128.53.211 | ec2-47-128-53-211.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.125.125 | ec2-47-128-125-125.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.27 | ec2-47-128-61-27.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.41 | ec2-47-128-61-41.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.59 | ec2-47-128-61-59.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.62 | ec2-47-128-61-62.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.83 | ec2-47-128-61-83.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.92 | ec2-47-128-61-92.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.33 | ec2-47-128-61-33.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.38 | ec2-47-128-61-38.ap-southeast-1.compute.amazonaws.com |  | AU |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
|
| Category | Web scraper |
| First seen | 2018-03-30 07:29:59 |
| Last seen | 2026-05-04 05:53:07 |
| IP addresses | 3,559 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-06-08 14:59:08 |
| Last seen | 2026-05-04 05:51:47 |
| IP addresses | 18,323 |
| Walk from |
| 47.128.61.255 | ec2-47-128-61-255.ap-southeast-1.compute.amazonaws.com |  | AU |  |
| 47.128.61.36 | ec2-47-128-61-36.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.38 | ec2-47-128-61-38.ap-southeast-1.compute.amazonaws.com |  | AU |  |
| 47.128.61.95 | ec2-47-128-61-95.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.62.107 | ec2-47-128-62-107.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.26 | ec2-47-128-61-26.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.69 | ec2-47-128-61-69.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.74 | ec2-47-128-61-74.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.250 | ec2-47-128-61-250.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.62.1 | ec2-47-128-62-1.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ThreatOpsBot/1.0; +https://threatops.fusion/bot) FeedFetcher-Google
|
| Category | Web scraper |
| First seen | 2026-05-03 23:39:51 |
| Last seen | 2026-05-03 23:39:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-03 20:46:47 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2026-04-29 15:21:53 |
| Last seen | 2026-05-03 20:46:47 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Applebot/0.1; +http://www.apple.com/go/applebot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:47 |
| Last seen | 2026-05-03 20:46:47 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:05 |
| Last seen | 2026-05-03 20:46:47 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Meta-ExternalAgent/1.1; +https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-03 20:46:46 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; GoogleOther; +https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:48 |
| Last seen | 2026-05-03 20:46:46 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:34 |
| Last seen | 2026-05-03 20:46:46 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:08 |
| Last seen | 2026-05-03 20:46:46 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/88.0.4324.175 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-07-04 04:59:45 |
| Last seen | 2026-05-03 20:01:29 |
| IP addresses | 125 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.199 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 17:18:48 |
| Last seen | 2026-04-30 14:13:51 |
| IP addresses | 8 |
| Walk from |
|
|
| Useragentstring | AdsBot-Google ( http://www.google.com/adsbot.html)
|
| Category | Web scraper |
| First seen | 2020-09-02 16:18:57 |
| Last seen | 2026-04-28 17:02:34 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-16 14:35:30 |
| Last seen | 2026-04-23 21:22:13 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.224 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 21:06:06 |
| Last seen | 2026-04-23 10:01:49 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-07-05 04:31:51 |
| Last seen | 2026-04-21 12:50:01 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| First seen | 2018-04-26 16:22:53 |
| Last seen | 2026-04-20 07:16:28 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2018-04-18 12:36:23 |
| Last seen | 2026-04-19 22:17:15 |
| IP addresses | 335 |
| Walk from |
|
|
| Useragentstring | msnbot/0.11 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-03-18 10:43:48 |
| Last seen | 2026-04-19 05:18:10 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; BingIndexCrawler/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-14 04:57:33 |
| Last seen | 2026-04-15 09:02:44 |
| IP addresses | 60 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\x09
|
| Category | Web scraper |
| First seen | 2019-05-22 04:20:20 |
| Last seen | 2026-04-15 07:46:23 |
| IP addresses | 494 |
| Walk from |
|
|
| Useragentstring | iaskspider/2.0(+http://iask.com/help/help_index.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-16 15:01:10 |
| Last seen | 2026-04-14 22:06:59 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 10; Mobile; rv:68.0) Gecko/68.0 Firefox/68.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2026-04-06 06:43:25 |
| Last seen | 2026-04-09 14:45:04 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/145.0.7572.2 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-09 12:11:34 |
| Last seen | 2026-04-09 12:11:34 |
| IP addresses | 1 |
| Walk from |
| 92.169.7.81 | lfbn-idf2-1-1504-81.w92-169.abo.wanadoo.fr | | FR |  |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1)
|
| Category | Web scraper |
| First seen | 2026-02-01 08:18:54 |
| Last seen | 2026-04-08 15:37:31 |
| IP addresses | 4 |
| Walk from |
|
|
| Useragentstring | (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2024-05-17 13:46:13 |
| Last seen | 2026-04-06 21:05:37 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2026-04-06 16:19:07 |
| Last seen | 2026-04-06 16:19:07 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/spd).
|
| Category | Web scraper |
| First seen | 2026-04-02 06:06:27 |
| Last seen | 2026-04-02 06:06:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (GoogleBot; compatible; Robots.txt checker/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-12 18:05:32 |
| Last seen | 2026-03-30 15:45:37 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2020-03-15 08:15:41 |
| Last seen | 2026-03-30 04:36:02 |
| IP addresses | 1,614 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4201.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2021-09-02 05:11:43 |
| Last seen | 2026-03-29 08:16:58 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | msnbot/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2020-03-26 12:49:59 |
| Last seen | 2026-03-25 17:32:03 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Facebot
|
| Category | Web scraper |
| First seen | 2021-07-14 04:42:54 |
| Last seen | 2026-03-25 09:51:49 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-03-24 06:07:43 |
| Last seen | 2026-03-24 06:07:43 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
|
| Category | Web scraper |
| First seen | 2024-06-03 03:05:24 |
| Last seen | 2026-03-19 21:06:18 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Sogou Push Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:04 |
| Last seen | 2026-03-17 04:25:21 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexNews/4.0; +http://yandex.com/bots)
|
| Category | Web scraper |
| First seen | 2020-07-01 05:51:44 |
| Last seen | 2026-03-16 13:46:05 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 (+http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2011-01-23 15:09:17 |
| Last seen | 2026-03-09 21:26:02 |
| IP addresses | 122 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-03-02 22:43:12 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 16_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Mobile/15E148 Safari/604.1 (compatible; Yeti/1.1; +https://naver.me/spd)
|
| Category | Web scraper |
| First seen | 2024-05-28 05:58:19 |
| Last seen | 2026-02-28 14:15:34 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/142.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-12-23 22:44:04 |
| Last seen | 2026-02-26 21:43:48 |
| IP addresses | 51 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 (+http://search.msn.com/msnbot.htm\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:11:26 |
| Last seen | 2026-02-25 08:03:11 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | GPTBot
|
| Category | Web scraper |
| First seen | 2025-09-18 00:14:39 |
| Last seen | 2026-02-24 05:27:44 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/\xA1\xB1; )
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-02-20 07:39:40 |
| IP addresses | 17 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; Baiduspider-render/2.0; http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2026-02-02 16:11:53 |
| Last seen | 2026-02-13 05:21:08 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:19 |
| Last seen | 2026-02-05 16:15:35 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2016-08-18 16:05:46 |
| Last seen | 2026-02-02 18:17:15 |
| IP addresses | 84 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Vigil/1.0; +http://vigil-app.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-01-29 04:51:27 |
| Last seen | 2026-01-29 04:51:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-07-02 18:16:35 |
| Last seen | 2026-01-24 09:19:43 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LinkedInBot/1.0; +http://www.linkedin.com) Mobile Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-01-21 15:12:51 |
| Last seen | 2026-01-21 15:12:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Googlebot-News
|
| Category | Web scraper |
| First seen | 2020-12-22 05:17:05 |
| Last seen | 2026-01-21 04:46:36 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | googlebot
|
| Category | Web scraper |
| First seen | 2020-10-13 18:45:00 |
| Last seen | 2026-01-15 06:16:23 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.7390.122 Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-01-15 05:31:48 |
| Last seen | 2026-01-15 05:31:48 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | BaiduSpider
|
| Category | Web scraper |
| First seen | 2022-09-03 03:05:42 |
| Last seen | 2026-01-09 05:44:46 |
| IP addresses | 65 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-02-05 21:44:31 |
| Last seen | 2025-12-16 08:53:03 |
| IP addresses | 24 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Googlebot/2.1
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2025-05-25 13:42:04 |
| Last seen | 2025-11-18 03:46:45 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | CCBot
|
| Category | Web scraper |
| First seen | 2025-02-12 19:53:02 |
| Last seen | 2025-11-11 17:35:28 |
| IP addresses | 1,233 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-06-19 14:11:31 |
| Last seen | 2025-10-25 03:58:14 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
|
| Category | Web scraper |
| First seen | 2018-10-09 02:34:15 |
| Last seen | 2025-10-13 17:17:34 |
| IP addresses | 168 |
| Walk from |
|
|
| Useragentstring | grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)
|
| Category | Web scraper |
| First seen | 2020-07-18 20:02:13 |
| Last seen | 2025-10-07 05:02:08 |
| IP addresses | 18 |
| Walk from |
|
|
| Useragentstring | facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)
|
| Category | Web scraper |
| First seen | 2020-06-20 05:58:53 |
| Last seen | 2025-10-02 03:34:45 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Baiduspider ( http://www.baidu.com/search/spider.htm)
|
| Category | Web scraper |
| First seen | 2020-01-02 10:43:07 |
| Last seen | 2025-09-26 16:28:39 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-02-15 02:57:31 |
| Last seen | 2025-09-24 10:34:54 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Gaisbot/3.0 (robot@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php)
|
| Category | Web scraper |
| First seen | 2020-02-06 05:51:00 |
| Last seen | 2025-09-21 14:48:15 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | msnbot-media/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-01-10 22:19:16 |
| Last seen | 2025-09-09 19:37:05 |
| IP addresses | 15 |
| Walk from |
|
|
| Useragentstring | FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)
|
| Category | Web scraper |
| First seen | 2022-05-02 06:09:58 |
| Last seen | 2025-09-09 07:05:45 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 11; Pixel 5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.70 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-09-04 04:17:50 |
| Last seen | 2025-09-09 05:59:51 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | compatible; Googlebot/2.1; +http://www.google.com/bot.htm
|
| Category | Web scraper |
| First seen | 2025-09-06 23:33:39 |
| Last seen | 2025-09-06 23:33:39 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Bingbot/2.0
|
| Category | Web scraper |
| First seen | 2025-07-10 05:51:02 |
| Last seen | 2025-09-04 04:45:06 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 ( http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-06-25 03:05:08 |
| Last seen | 2025-08-31 05:26:41 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.4 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25
|
| Category | Web scraper |
| First seen | 2020-02-19 08:19:32 |
| Last seen | 2025-08-20 21:57:57 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-03-20 15:27:32 |
| Last seen | 2025-08-20 07:31:13 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-02-05 11:05:11 |
| Last seen | 2025-08-13 11:45:35 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.10) Gecko/20100623 Iceweasel/3.5.10 (like Firefox/3.5.10) Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2022-12-01 09:44:51 |
| Last seen | 2025-08-11 16:06:15 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Y!J-DLC/1.0 (https://support.yahoo-net.jp/PccSearch/s/article/H000007955)
|
| Category | Web scraper |
| First seen | 2024-11-11 06:32:44 |
| Last seen | 2025-07-23 05:24:35 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e YisouSpider/5.0 Safari/602.
|
| Category | Web scraper |
| First seen | 2025-07-11 06:18:22 |
| Last seen | 2025-07-11 06:31:22 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot-Video/1.0; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-06-12 17:57:50 |
| Last seen | 2025-06-12 17:57:50 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-09-14 20:06:01 |
| Last seen | 2025-06-10 04:23:45 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexBot/3.0; +<http://yandex.com/bots>)
|
| Category | Web scraper |
| First seen | 2025-05-25 13:40:57 |
| Last seen | 2025-05-25 13:40:57 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/136.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-05-14 14:46:10 |
| Last seen | 2025-05-14 14:46:10 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/87.0.4280.90 Safari/537.36,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2025-04-30 06:30:04 |
| Last seen | 2025-04-30 06:30:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | gptbot
|
| Category | Web scraper |
| First seen | 2025-04-29 15:28:28 |
| Last seen | 2025-04-29 15:28:28 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 Baiduspider+(+http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2025-04-10 04:20:04 |
| Last seen | 2025-04-10 04:20:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; Y!J-BRY/YATSH crawler; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
|
| Category | Web scraper |
| First seen | 2025-03-31 12:11:01 |
| Last seen | 2025-03-31 12:11:01 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Blogtrottr/2.1 (+https://blogtrottr.com/)
|
| Category | Web scraper |
| First seen | 2025-03-18 18:21:55 |
| Last seen | 2025-03-24 16:26:44 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | CriteoBot/0.1
|
| Category | Web scraper |
| First seen | 2025-03-20 23:18:13 |
| Last seen | 2025-03-20 23:18:13 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-12-16 17:58:46 |
| Last seen | 2025-03-13 13:23:51 |
| IP addresses | 32 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0;+http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2019-09-14 06:14:20 |
| Last seen | 2025-03-08 09:11:49 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-03-04 09:13:40 |
| Last seen | 2025-03-04 09:13:40 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Twitterbot
|
| Category | Web scraper |
| First seen | 2020-12-25 05:21:58 |
| Last seen | 2025-02-18 22:48:10 |
| IP addresses | 42 |
| Walk from |
| 185.171.31.35 | 185.171.31.35 | | DE |  |
| 3.252.218.14 | ec2-3-252-218-14.eu-west-1.compute.amazonaws.com |  | IE |  |
| 52.17.111.171 | ec2-52-17-111-171.eu-west-1.compute.amazonaws.com |  | IE |  |
| 3.248.204.118 | ec2-3-248-204-118.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.244.227.33 | ec2-34-244-227-33.eu-west-1.compute.amazonaws.com |  | IE |  |
| 18.201.208.0 | ec2-18-201-208-0.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.242.60.96 | ec2-34-242-60-96.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.254.191.77 | ec2-34-254-191-77.eu-west-1.compute.amazonaws.com |  | IE |  |
| 34.245.64.192 | ec2-34-245-64-192.eu-west-1.compute.amazonaws.com |  | IE |  |
| 3.252.141.124 | ec2-3-252-141-124.eu-west-1.compute.amazonaws.com |  | IE |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | GPTBot/1.0
|
| Category | Web scraper |
| First seen | 2025-01-13 05:19:56 |
| Last seen | 2025-02-16 17:42:24 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google Favicon
|
| Category | Web scraper |
| First seen | 2025-02-07 17:01:39 |
| Last seen | 2025-02-16 07:28:16 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Yandex
|
| Category | Web scraper |
| First seen | 2025-02-14 19:08:16 |
| Last seen | 2025-02-14 19:08:28 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | getstream.io/opengraph-bot (like TwitterBot) facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
|
| Category | Web scraper |
| First seen | 2025-01-16 18:18:09 |
| Last seen | 2025-01-16 18:18:09 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.4; +http://www.ymwears.cn)
|
| Category | Web scraper |
| First seen | 2025-01-02 07:02:44 |
| Last seen | 2025-01-16 01:24:50 |
| IP addresses | 1 |
| Walk from |
|