| Producer | Unknown Author |
| Other robots of the same producer | 1M7bot, aa-prod-public-product, AAABot, AASA-Bot, AbandonedSiteFinder, ABEvalBot, AccompanyBot, AcquisitionScout, AdaptaBot, adaptive-bot, AdBot, ads-txt-crawler, AdsBot, AdsrvrBot, AdsTxtBot, AdsTxtCrawler, AdsTxtCrawlerTP, advanced_crawler, Adventurer, aeverly, agent-browser, AI-Security-Scanner, AIDA-Research, AionBot, AlbacrossCompanyEnricher, AlexionResearchBot, AlgorandSearchBot, alienfarm, ALittle Client, AliyunSecBot, alphaapi crawler, altsvc-probe, Amuninni-WixFinder, Analyzer, AntBot, AnyBot, Apache-Smuggler, app-ads-crawler, Aranet-SearchBot, aranhabot, Aream Crawler, AskyBot, assetlinks-scanner, AstroSafeDomainCategoryEvidence, AteniumBot, AteveSearchSourceUrlDiscovery, atlas, AtlasResearchBot, Authorized-BugBounty-Env-Scanner, Autoconfig Test from USTC, autoemailspider, AutoRes-Crawler, Aviator-WebFetch, awi-research-crawler, BacklinkBot, BacklinkCrawler, BacklinkSpider, BackScanX, badbot, BananaBot, bang2012, bbot, BDBot, BeansLLM-CorpusBot, Bender, BesaCrawler, Bimbot, BitFire-IconUpscaler, BlazeBot, BlohaBot, bloom-crawler, BlueBot-scout-url, BorneoBot, Bot, bot-research, Bot/Crawler, bot;, BotPoke, br-crawler, brands-bot, brands-bot-logo, BridgeDeskAI-PublicBusinessResearch, brightdata-datacomp-calibration, brightdata-serpapi-mcp, browserClientA, BSbot, BusinessNameBot, BuyersCloudBot, cached-search-image-fetcher, CAISearchBot, CaliWatch, CanadianOrganizationDirectoryCrawler, CandidateCrawler, capsfusion-downloader, CareerPageBot, CCMetaBot, CCrawl, cc_bot, Centro Ads.txt Crawler, centurybot, CerebroBot, CF-UC User Agent, chatui-agent, chimebot, ChimeUnfurlAgent, CitationAuditBot, ClaimChartBot, clark-crawler, ClawBot, CLcrawler, Clearscopebot, CMS-Checker, CMS-Security-Auditor, CMSInventory, CmsScaner/net8, code-docs-corpus, CodeMMPretrainCrawler, CommonCrawlNutchBot, company-domain-enricher, company-financial-miner, CompanyCrawler, CompanyKnowledgeCollector, CompassBot, ComplianceChecker, ConceptBurstBot, ContactBot, ContentBot, ContextFlow-Research, ConvomeshBot, CoreBot, CrawlBot, Crawler, Crawler test, Crawler-IP-Fetcher, crawler-purpose-audit, crawler-verification-research, CrawlerFr, CrawlerID, crawler_eb_germany, CrawlmBot, CrawlyProjectCrawler, crusader-worker, CT-WP-Scanner, CTI-Engram-UrlFollow, Ctrl0Worker, CUBES-OC2-ContactDiscovery, CuratedSearchBot, curb, Custom-AsyncHttpClient, CustomerIranOpenSourceResearch, CustomScanner, CXK_Bot, CyberSitemapRepositoryBot, dark_NeXus_Qbot, DARPResearchBot, Databot, datacomp-scraper, DatacompMetadataIngestion, DataFoundationResearch, dataset-acq, DAutoBot, DaveCrawler, DeepResearch, Desync-Exploit, Detectobot, devlo-celeste-domain-waterfall, DF Bot, Dispatch, DMARC-Research-Bot, Dmbot, DnBCrawler, DNSCrawler, docs-proofreader, domain-harvester, domain-info, domain-language-checker, domain-profiler, DomainAtlas, DomainAuditor, domainbox-domain-snapshot, DomainChecker, DomainCrawler, DomainEvidenceBot, DomainFilter, DomainIntelBot, DomainMetadataChecker, DomainScoutBot, Dormouse, DownloaderChrome, DropCatcher, ds-robot, edansbot, EdgeChangePasswordResearchCrawler, EFML-crawler, Elisabot, EmailFinderBot, EmailURLExtractor, EmailWolf, employer-address-finder, env-checker, EnvScanner, ErisBot, ExaticsBot, exp-oi2-scrape3, ExpiBot, expo-research-bot, factbase-robots, fake_bot, Farez-Sorter, FAST-WebCrawler, fastcrawl, FastCrawler, FavicoHub, fedcrawl, FeedBot, FeedValidator, Fellow Links Parser Robot, fidget-spinner-bot, FileSearchTools, FindAPIs-HealthChecker, FirstSeenBot, FLAI-WebScraper, FlfBaldrBot, FlorKz., FormURLResearchBot, FriendLinkSurveyBot, Friendly testing bot, friendly-spider, FriendlyCrawler, FriendlyRssReader, Friendly_Crawler, fsd-crawler, Fuze_Bot, g2crawler, gaeskeun_bot, GASiteResearch, GDPRScreeningBot, GeneralCrawlBot, GeneralWebsiteSpider, Gensparkbot, Georgia Tech README Security Research Crawler, GlobalGoalsDirectoryBot, GlobalWebSearch, Golfe, GoodBot, GoodReports-Compliance-Audit, google resource, Googlebot-Style, GoogleRot, GoParserBot, GoRedirectChecker, Gort, GoScanner, Govini-DQ-Checker, gregcrawler, Grover, gschaid bot, Guest, HanaleiBot, HappyWing, HAProxy-Smuggler, HawaiiBot, Headless Chrome, Headless Edge, HealthCheckBot, heimdall, Hello World, HighVolumeNewsSourceDiscovery, hopgoblin, HostChecker, HostHeaderScanner, HostQuality, howBot, HSD-Public-Business-Contact-Research, HTTPHeadersCheck, HubSeedsBot, HUNT-Bot, hypertok-recap-datacomp1b, IBM Crawler, icmp-tcp-oracle-probe, ImageBot, ImageMind, IMATA-Bot, IMJ-CompanyPage-Scraper, Implcit:AdsTxt-Scrapr, IndusFirehose, Info bot, IntelligenceCollector, internal-testing-crawler, ip9max, ipcrawl-exposure-scanner, jaddjabot, Jedi-Hound, Jetfuel-VLM-Raw-Fetch, jinming-test-hf-dataset-to-hdfs, JRCBot, JSACrawlerBot, JSCrawler, jurgendata, K/b-scanner, kagibot, KauaiBot, Keerthi Bot, keoki-ucp-probe, keys-so-bot, keyword-monitor, KONTUR_RF, LanaiBot, LeadFeed, LetrixLabs, libredtail-http, linabot, link-geo-country, LinkOps-Liveness, LinkScanProcessor, linus-torvalds-loves-you, Linux Gnu (cow), LinuxGetSsl, LiteLLM-Scanner, little-loops-link-checker, live-forum-pipeline, LiveScanner, LLMS-Txt-Scanner, llmstxt-survey, llmstxtScannerBot, LMCSearchBot, loadtest, local-knowledge-graph, LocalDomainCrawler, LocalSearch, localsearch-homepage-enricher, LogMonitorBot, lolbot, loli_spider, longcontext-sourcing, LookoutBot, LuisSearchBot, LumeWebScan, lunabot, Magellan, magicsearchdev, MailBot, MarkdownWorker, marketing-crawler, MassScanner, MathPicDatasetCrawler, MauiBot, MB-AML-Research-Pipeline, Mend Importer, MeridianBot, metabase-cve-2026-72898-detect, MetadataScraper, metaphor-data-pipeline, migration-signal-crawler, MiniSearchBot, MiniWebCrawler, mj-wordpress-crawler, MJBot, ModelContextProtocol, Monibot, monitor-telegram-clone-realtime, MoonBot, More, Mozilla, msh-pdf-origin-canary, msh-pdfmin, MtakBot, My Nutch Spider, my-tiny-bot, MyBB-Archive-Bot, MyBot, MyCheckerBot, MyCrawler, MyEducationalCrawler, n8n-serp-crawler, nameserver-checker-http-validator, NapBot, NavCrawl, Navy Federal, nbertaupete95, NDDHunter, net-research-scan, NetAPI, NeuroPipeline-OfferVerifier, NewsletterFormResearchBot, newspaper, newswtbot, Nexgate Ruby Client, Nginx-Smuggler, Nicecrawler, NinjaAIBot, NiueBot, Noliae Crawler, notebot, NRDbot, NsearchBot, Nutch Spider, NVBot, nvdorz, Nx-zDHub, OgScrper, OIDC-Fetcher, onex-datacomp-lance, OnlyHTML, OpenInternet-Discovery, OpenTheBoxBot, OpstimalBot, Orbbot, OSeans7Bot, osint research, OSSPVTracking, OutreachFilter, p40Bot, paper-reproduce-check-asset-url, paper-with-code-stage11, parisbot, parquet-filter-downloader, passkey-domain-check, PathToProject-WPMD-Research, PDFBot, PersodiaResearchBot, PhantomBot, PhxBot, pimeyes-downloader-api, PinjaOSINTBot, PisarBot, pixmo-cap-convert, PlamoExplorer, PoeSearchBot, polaris botnet, polite-crawler, PoliteCrawl, Polon, Pomothy-Bot, PopScreen Bot, pqc-http-scan, PrecisionBot, PrivacyPolicyBot, PrivateBot, ProductLookoutBot, ProfileGrid-5995-mass-async, PromptingBot, ProspectCrawler, Prospex, proxyhunter, ProxyPool-Scanner, ProxyTest, ProxyWingPublicContactCrawler, PS_Daily, PUBGProductResearchBot, QBOT, quick_checker, QuiverRasterResearch, r00ts3c-owned-you, RainBot, Rankabot, reasonix-web-fetch, recon-engine, ReconBot, RecordedFuture Global Inventory Crawler, redirect-scanner, Relevant, Rely Bot, research crawler, research dataset crawler, research-crawler, ResearchBot, researchxoftheweb, RevicBot, ReyilBot, ris-bot, Robot, robots-ai-permissions, robots-bulk-crawler, robots-scanner, robots-survey, robots-txt-audit, robots-txt-research, robots.py, RobotsArchiveBot, RobotsTxtCheck, RobotsTxtScraper, RootCrawl-Crawler, rss-discovery-crawler, rss-feed-index-bot, RSSCollector, RSSReader, RssReaderBot, runtime-resources-research, rust_sniffer, RW_Crawler, S-Scanner, S2.0Bot, S33DBot, SaluteBot, ScamadviserExternalHit, SCAN, ScannerBot, ScanProxy, scrap, scraper, sc_bot, sealdexbot, Seamus, search-agent, search-engine-indexer, searchdb, SearchEngineBot, Searcherweb, Searcherxweb, SearchExpress, SEBot-WA, SecurityAudit, SecurityHeaderAnalyzer, SecurityResearchBot, security_txt_analysis, sempi.tech bot, sendgrid-scanner, senthor-research, SeoCherryBot, seoscanners.net bot, SeoulBot, SequentryBrandRadarMVP, SerpCrawler, servicefilter, sexy-spider, sftp-scanner, ShellBot, SignalLabCrawler, SimpleAsyncPageCrawler, site-checker, sitemap-parser-rs, SitemapBot, SitemapCrawler, SitemapCrawler.de crawler, SitemapReader, siteradar, SkillGymCorpusBot, SkynetBot, SkyworkSpider, SlaccaleBot, SlateGTM-ReadMe-MCP-Audit, SmartBotCrawler, smol-tiny-tarantula, Snap URL Preview Service, Social Listening API, SocialMediaScrapperv2, SOcrawl, some agent, SourcingEngineBot, SpamBot, Spider, Spider_Bot, SQ-Scanner, SQLi-Scanner, SSSSBot, StactBot, Storm-crawler, StrawberryBot, studyBot, Supabase crawler, SupaGuard, SuperBot, SuperFastScraper, superfetch, SuperMegaHyperColossalMassiveGiganticAstronomicalM, supply-crawler, SurPhish-Reproduction-Crawler, SynapicCrawl, SyncSearch, t2i-data-curation, TakeoverScanner, TDM-Checker, TDMScanner, TechDetect, TechNewsBot, TechScanBot, terrabot-owned-you, tes-cocrawler, Test, Test Certificate Info, test-bot, TestBot, TestCrawler, TestSearchSpider, TestUserAgent, The Knowledge AI, TheInternetSearch, Theophrastus, thesis-research-bot, thin-cw-lance-import, ThinkChaos, ThresselScanner, Tier1Bot, Timing-Analysis, Tiny Crawler 101, Tiny-Crawler-101, TinyBotTestUA, TinyTestBot, TinyTestBoty, TK-Metrics-SourceAudit, tld-netprobe, TLM-Audit-Scanner, TLSScanner, TMM Crawler, ToolissBot, toriset-llm-scraper, tphotobot, TprAdsTxtCrawler, Tranco Crawler, tranco-crawler, TrendsmapResolver, Triplechecker, Trokambot, TrustedSearchBot, TSpider, UAScrapper, UCP-Discovery, uk-nhs-data, ultimate_sitemap_parser, Unite-ResolveUrl, UniversalSeedIntelligenceAgent, Unknown bot, UppinaMonitor, URLBuilder, UrlTest, UrukyFaviconProxy, v0bot, vague, VariableRatio-PublicAssetResearch, VDP-Scanner, ViberBot, VICIdial-Recon-Classifier, Village-Technographics-Seed, VisionSet, VsuSearchSpider, vuln_scanner, WAF-Bypass-Test, WanScannerBot, WarmBadge-Trawler, warmup-scraper, WarpBot, Web Crawler, web-crawler, webapp-mapper, WebBot, webcollage, WebCrawler, webflow-staging-diff, WebMCPIndexBot, WebRankSpider, WebScraperBot, website-candidate-fetch-enricher, WebsiteFeeder, websusebot, web_fetcher, WF search, WhatStuffWhereBot, white-analyz-bug, wise, WooCommerce-Detector, Wordup-1, Wordupindexinfo1, WorksOgCrawler, WorldBot, WP-Safe-Scanner, wpbot, WPCheckBot, WPDataResearchBot, WPDetector, WPScanner, xbugalertBot, xfa1, xovicio-ai-classifier, XTC BOTNET, YFF35, your-search-bot, Ytools, YunSecurityBot, Yuuperbot, ZAKREGEX-Scanner, zebra-v2-bot, Zephuli-Bot, zero-tier-classifier, ZeroBot, zzhbot, _1z_bot, _zbot |
| Bot URL | |
| Status | Active |
Known variants
|
| Useragentstring | Gwene/1.0 (The gwene.org rss-to-news gateway) Googlebot
|
| Category | Web scraper |
| First seen | 2022-12-01 10:19:43 |
| Last seen | 2026-09-18 11:11:54 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2023-06-05 18:28:24 |
| Last seen | 2026-09-18 04:22:43 |
| IP addresses | 21,156 |
| Walk from |
| 47.128.61.57 | ec2-47-128-61-57.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.38 | ec2-47-128-61-38.ap-southeast-1.compute.amazonaws.com |  | AU |  |
| 47.128.61.45 | ec2-47-128-61-45.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.71 | ec2-47-128-61-71.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.62.10 | ec2-47-128-62-10.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.107 | ec2-47-128-62-107.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.27 | ec2-47-128-61-27.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.8 | ec2-47-128-61-8.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.81 | ec2-47-128-61-81.ap-southeast-1.compute.amazonaws.com |  | US |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-06-08 14:59:08 |
| Last seen | 2026-09-18 04:22:42 |
| IP addresses | 18,326 |
| Walk from |
| 47.128.61.25 | ec2-47-128-61-25.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.250 | ec2-47-128-61-250.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.253 | ec2-47-128-61-253.ap-southeast-1.compute.amazonaws.com |  | AU |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.88 | ec2-47-128-61-88.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.92 | ec2-47-128-61-92.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.99 | ec2-47-128-61-99.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.62.1 | ec2-47-128-62-1.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.27 | ec2-47-128-61-27.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.29 | ec2-47-128-61-29.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
|
| Category | Web scraper |
| First seen | 2018-03-30 07:29:59 |
| Last seen | 2026-09-18 04:22:41 |
| IP addresses | 5,158 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/7.0 Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe)
|
| Category | Web scraper |
| First seen | 2026-08-03 22:51:07 |
| Last seen | 2026-09-18 04:20:13 |
| IP addresses | 78 |
| Walk from |
| 47.128.109.62 | ec2-47-128-109-62.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.144 | ec2-47-128-62-144.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.127.177 | ec2-47-128-127-177.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.20.180 | ec2-47-128-20-180.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.125.205 | ec2-47-128-125-205.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.60.227 | ec2-47-128-60-227.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.116.7 | ec2-47-128-116-7.ap-southeast-1.compute.amazonaws.com |  | ? |  |
| 47.128.33.201 | ec2-47-128-33-201.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.25.126 | ec2-47-128-25-126.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.39.241 | ec2-47-128-39-241.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Baiduspider+(+http://www.baidu.com/search/spider.htm);google|baiduspider|baidu|spider|sogou|bing|yahoo|soso|sosospider|360spider|youdao|jikeSpider;)
|
| Category | Web scraper |
| First seen | 2024-04-16 05:34:33 |
| Last seen | 2026-09-17 11:07:00 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)
|
| Category | Web scraper |
| First seen | 2026-04-29 17:22:15 |
| Last seen | 2026-09-17 09:27:45 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ChatGPT-User/1.0; +https://openai.com/bot)
|
| Category | Web scraper |
| First seen | 2026-04-29 17:21:27 |
| Last seen | 2026-09-17 07:57:47 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; GoogleTourBot/1.0; DNS scan web check)
|
| Category | Web scraper |
| First seen | 2026-08-14 23:50:47 |
| Last seen | 2026-09-15 22:55:31 |
| IP addresses | 4 |
| Walk from |
|
|
| Useragentstring | Sogou Push Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:04 |
| Last seen | 2026-09-09 21:59:50 |
| IP addresses | 14 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.7258.156 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-07-15 15:16:17 |
| Last seen | 2026-09-08 11:43:05 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2026-04-29 15:21:53 |
| Last seen | 2026-08-29 08:02:39 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 16_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Mobile/15E148 Safari/604.1 (compatible; Yeti/1.1; +https://naver.me/spd)
|
| Category | Web scraper |
| First seen | 2024-05-28 05:58:19 |
| Last seen | 2026-08-28 14:26:04 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:34 |
| Last seen | 2026-08-28 14:03:03 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:05 |
| Last seen | 2026-08-28 14:03:02 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:08 |
| Last seen | 2026-08-28 14:03:02 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:12 |
| Last seen | 2026-08-28 14:02:59 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Applebot/0.1; +http://www.apple.com/go/applebot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:47 |
| Last seen | 2026-08-28 14:02:57 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe)
|
| Category | Web scraper |
| First seen | 2026-07-31 09:25:54 |
| Last seen | 2026-08-25 05:48:08 |
| IP addresses | 147 |
| Walk from |
| 47.128.61.47 | ec2-47-128-61-47.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.255 | ec2-47-128-61-255.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.94 | ec2-47-128-61-94.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.65 | ec2-47-128-61-65.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.104 | ec2-47-128-62-104.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.82 | ec2-47-128-61-82.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.80 | ec2-47-128-61-80.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.26 | ec2-47-128-61-26.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.46 | ec2-47-128-61-46.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-08-02 09:41:33 |
| Last seen | 2026-08-25 05:47:08 |
| IP addresses | 108 |
| Walk from |
| 47.128.61.52 | ec2-47-128-61-52.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.98 | ec2-47-128-61-98.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.40 | ec2-47-128-61-40.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.62 | ec2-47-128-61-62.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.84 | ec2-47-128-61-84.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.74 | ec2-47-128-61-74.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.89 | ec2-47-128-61-89.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.4 | ec2-47-128-61-4.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.103 | ec2-47-128-62-103.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-08-24 21:48:42 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-02-05 21:44:31 |
| Last seen | 2026-08-12 05:41:38 |
| IP addresses | 29 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/88.0.4324.175 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-07-04 04:59:45 |
| Last seen | 2026-08-07 09:21:54 |
| IP addresses | 259 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/147.0.7727.102 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-08-06 11:47:10 |
| Last seen | 2026-08-06 11:47:10 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Bytespider
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2026-08-03 23:15:09 |
| Last seen | 2026-08-03 23:15:09 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +mailto:support@anthropic.com
|
| Category | Web scraper |
| First seen | 2026-06-03 01:55:44 |
| Last seen | 2026-08-03 12:25:33 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2016-07-20 00:20:12 |
| Last seen | 2026-07-29 07:46:19 |
| IP addresses | 157 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html) X-Middleton/1
|
| Category | Web scraper |
| First seen | 2026-07-28 17:40:18 |
| Last seen | 2026-07-28 17:40:18 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.199 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 17:18:48 |
| Last seen | 2026-07-27 06:40:14 |
| IP addresses | 32 |
| Walk from |
|
|
| Useragentstring | (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2024-05-17 13:46:13 |
| Last seen | 2026-07-23 22:21:12 |
| IP addresses | 8 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-12-16 17:58:46 |
| Last seen | 2026-07-23 11:32:30 |
| IP addresses | 33 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\x09
|
| Category | Web scraper |
| First seen | 2019-05-22 04:20:20 |
| Last seen | 2026-07-22 10:51:49 |
| IP addresses | 495 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2016-08-18 16:05:46 |
| Last seen | 2026-07-22 06:55:28 |
| IP addresses | 85 |
| Walk from |
|
|
| Useragentstring | iaskspider/2.0(+http://iask.com/help/help_index.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-16 15:01:10 |
| Last seen | 2026-07-20 08:39:46 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2020-03-15 08:15:41 |
| Last seen | 2026-07-19 21:03:01 |
| IP addresses | 1,616 |
| Walk from |
|
|
| Useragentstring | msnbot/0.11 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-03-18 10:43:48 |
| Last seen | 2026-07-19 14:35:32 |
| IP addresses | 14 |
| Walk from |
|
|
| Useragentstring | SemrushBot-EO
|
| Category | Web scraper |
| First seen | 2026-05-24 01:40:56 |
| Last seen | 2026-07-18 01:13:35 |
| IP addresses | 61 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.224 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 21:06:06 |
| Last seen | 2026-07-17 11:46:53 |
| IP addresses | 17 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; DuckDuckBot/1.1; +http://duckduckgo.com/duckduckbot.html)
|
| Category | Web scraper |
| First seen | 2026-06-25 09:51:35 |
| Last seen | 2026-07-17 05:18:03 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | msnbot/1.0 (+http://search.msn.com/msnbot.htm\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:11:26 |
| Last seen | 2026-07-10 22:12:52 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-02-15 02:57:31 |
| Last seen | 2026-07-02 06:44:59 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
|
| Category | Web scraper |
| First seen | 2024-06-03 03:05:24 |
| Last seen | 2026-07-02 06:44:04 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1)
|
| Category | Web scraper |
| First seen | 2026-02-01 08:18:54 |
| Last seen | 2026-06-30 15:31:47 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | WebKit (kompatibel; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-06-29 18:59:19 |
| Last seen | 2026-06-29 18:59:19 |
| IP addresses | 4 |
| Walk from |
|
|
| Useragentstring | mkgp-data-pipeline/0.1 (+https://commoncrawl.org/)
|
| Category | Web scraper |
| First seen | 2026-06-29 13:23:26 |
| Last seen | 2026-06-29 13:23:26 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)
|
| Category | Web scraper |
| First seen | 2020-06-20 05:58:53 |
| Last seen | 2026-06-29 07:36:55 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-06-19 14:11:31 |
| Last seen | 2026-06-28 18:15:35 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)
|
| Category | Web scraper |
| First seen | 2020-07-18 20:02:13 |
| Last seen | 2026-06-27 00:57:06 |
| IP addresses | 19 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/\xA1\xB1; )
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-06-25 21:49:19 |
| IP addresses | 19 |
| Walk from |
|
|
| Useragentstring | Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-16 14:35:30 |
| Last seen | 2026-06-25 18:13:36 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; TelegramBot/1.0 like Linux)
|
| Category | Web scraper |
| First seen | 2026-06-09 18:09:28 |
| Last seen | 2026-06-25 15:56:32 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | AdsBot-Google ( http://www.google.com/adsbot.html)
|
| Category | Web scraper |
| First seen | 2020-09-02 16:18:57 |
| Last seen | 2026-06-19 13:34:12 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Googlebot-News
|
| Category | Web scraper |
| First seen | 2020-12-22 05:17:05 |
| Last seen | 2026-06-17 14:36:20 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Exabot
|
| Category | Web scraper |
| First seen | 2025-02-07 09:06:24 |
| Last seen | 2026-06-16 09:58:12 |
| IP addresses | 339 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 ( http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-06-25 03:05:08 |
| Last seen | 2026-06-14 23:02:47 |
| IP addresses | 14 |
| Walk from |
|
|
| Useragentstring | msnbot-media/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-01-10 22:19:16 |
| Last seen | 2026-06-14 10:06:40 |
| IP addresses | 16 |
| Walk from |
|
|
| Useragentstring | Gaisbot/3.0 (robot@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php)
|
| Category | Web scraper |
| First seen | 2020-02-06 05:51:00 |
| Last seen | 2026-06-10 05:05:13 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)
|
| Category | Web scraper |
| First seen | 2022-05-02 06:09:58 |
| Last seen | 2026-06-10 05:05:09 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LocalLightUdgerCrawler/1.0; +https://udger.com/resources/ua-list/crawlers)
|
| Category | Web scraper |
| First seen | 2026-06-05 14:10:53 |
| Last seen | 2026-06-05 14:10:53 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| First seen | 2018-04-26 16:22:53 |
| Last seen | 2026-05-30 08:17:46 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; GoogleOther; +https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:48 |
| Last seen | 2026-05-22 10:54:30 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; CohereBot/1.0; +https://cohere.com/bot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:45 |
| Last seen | 2026-05-22 10:43:58 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-19 07:08:33 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-05-16 14:03:01 |
| Last seen | 2026-05-16 14:03:01 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Meta-ExternalAgent/1.1; +https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-15 12:24:44 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Googlebot/2.1 (+http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2011-01-23 15:09:17 |
| Last seen | 2026-05-14 22:20:20 |
| IP addresses | 122 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:19 |
| Last seen | 2026-05-12 03:08:26 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexNews/4.0; +http://yandex.com/bots)
|
| Category | Web scraper |
| First seen | 2020-07-01 05:51:44 |
| Last seen | 2026-05-06 15:34:48 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.6668.71 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-08-24 14:42:58 |
| Last seen | 2026-05-04 14:39:29 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ThreatOpsBot/1.0; +https://threatops.fusion/bot) FeedFetcher-Google
|
| Category | Web scraper |
| First seen | 2026-05-03 23:39:51 |
| Last seen | 2026-05-03 23:39:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-07-05 04:31:51 |
| Last seen | 2026-04-21 12:50:01 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2018-04-18 12:36:23 |
| Last seen | 2026-04-19 22:17:15 |
| IP addresses | 335 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; BingIndexCrawler/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-14 04:57:33 |
| Last seen | 2026-04-15 09:02:44 |
| IP addresses | 60 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 10; Mobile; rv:68.0) Gecko/68.0 Firefox/68.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2026-04-06 06:43:25 |
| Last seen | 2026-04-09 14:45:04 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/145.0.7572.2 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-09 12:11:34 |
| Last seen | 2026-04-09 12:11:34 |
| IP addresses | 1 |
| Walk from |
| 92.169.7.81 | lfbn-idf2-1-1504-81.w92-169.abo.wanadoo.fr | | FR |  |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2026-04-06 16:19:07 |
| Last seen | 2026-04-06 16:19:07 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/spd).
|
| Category | Web scraper |
| First seen | 2026-04-02 06:06:27 |
| Last seen | 2026-04-02 06:06:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (GoogleBot; compatible; Robots.txt checker/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-12 18:05:32 |
| Last seen | 2026-03-30 15:45:37 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4201.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2021-09-02 05:11:43 |
| Last seen | 2026-03-29 08:16:58 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | msnbot/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2020-03-26 12:49:59 |
| Last seen | 2026-03-25 17:32:03 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Facebot
|
| Category | Web scraper |
| First seen | 2021-07-14 04:42:54 |
| Last seen | 2026-03-25 09:51:49 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-03-24 06:07:43 |
| Last seen | 2026-03-24 06:07:43 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/142.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-12-23 22:44:04 |
| Last seen | 2026-02-26 21:43:48 |
| IP addresses | 51 |
| Walk from |
|
|
| Useragentstring | GPTBot
|
| Category | Web scraper |
| First seen | 2025-09-18 00:14:39 |
| Last seen | 2026-02-24 05:27:44 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; Baiduspider-render/2.0; http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2026-02-02 16:11:53 |
| Last seen | 2026-02-13 05:21:08 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Vigil/1.0; +http://vigil-app.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-01-29 04:51:27 |
| Last seen | 2026-01-29 04:51:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-07-02 18:16:35 |
| Last seen | 2026-01-24 09:19:43 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LinkedInBot/1.0; +http://www.linkedin.com) Mobile Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-01-21 15:12:51 |
| Last seen | 2026-01-21 15:12:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | googlebot
|
| Category | Web scraper |
| First seen | 2020-10-13 18:45:00 |
| Last seen | 2026-01-15 06:16:23 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.7390.122 Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-01-15 05:31:48 |
| Last seen | 2026-01-15 05:31:48 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | BaiduSpider
|
| Category | Web scraper |
| First seen | 2022-09-03 03:05:42 |
| Last seen | 2026-01-09 05:44:46 |
| IP addresses | 65 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Googlebot/2.1
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2025-05-25 13:42:04 |
| Last seen | 2025-11-18 03:46:45 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | CCBot
|
| Category | Web scraper |
| First seen | 2025-02-12 19:53:02 |
| Last seen | 2025-11-11 17:35:28 |
| IP addresses | 1,233 |
| Walk from |
|
|
| Useragentstring | acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
|
| Category | Web scraper |
| First seen | 2018-10-09 02:34:15 |
| Last seen | 2025-10-13 17:17:34 |
| IP addresses | 168 |
| Walk from |
|
|
| Useragentstring | Baiduspider ( http://www.baidu.com/search/spider.htm)
|
| Category | Web scraper |
| First seen | 2020-01-02 10:43:07 |
| Last seen | 2025-09-26 16:28:39 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 11; Pixel 5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.70 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-09-04 04:17:50 |
| Last seen | 2025-09-09 05:59:51 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | compatible; Googlebot/2.1; +http://www.google.com/bot.htm
|
| Category | Web scraper |
| First seen | 2025-09-06 23:33:39 |
| Last seen | 2025-09-06 23:33:39 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Bingbot/2.0
|
| Category | Web scraper |
| First seen | 2025-07-10 05:51:02 |
| Last seen | 2025-09-04 04:45:06 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.4 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25
|
| Category | Web scraper |
| First seen | 2020-02-19 08:19:32 |
| Last seen | 2025-08-20 21:57:57 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-03-20 15:27:32 |
| Last seen | 2025-08-20 07:31:13 |
| IP addresses | 10 |
| Walk from |
|