| Producer | Unknown Author |
| Other robots of the same producer | 1M7bot, aa-prod-public-product, AAABot, AASA-Bot, AbandonedSiteFinder, ABEvalBot, academic-research-check, accesson-ir-sweep, AccompanyBot, AcquisitionScout, AdaptaBot, adaptive-bot, AdBot, adobeone-datasets, ads-txt-crawler, AdsBot, AdsrvrBot, AdsTxtBot, AdsTxtCrawler, AdsTxtCrawlerTP, AduoResearchBot, advanced_crawler, Adventurer, aeverly, agent-browser, AgentBot, AgentCenterSearch, AI-Security-Scanner, AIDA-Research, AionBot, AiryisBot, AIWebFactoryResearch, AlbacrossCompanyEnricher, AlexionResearchBot, AlgorandSearchBot, alienfarm, ALittle Client, alphaapi crawler, altsvc-probe, AmigadexBot, Amuninni-WixFinder, Analyzer, AntBot, AntParserFootprintCollector, AnyBot, Apache-Smuggler, ApcosysBot, app-ads-crawler, Aranet-SearchBot, aranhabot, ArdwellResearch, Aream Crawler, ArinEdge-RSS-Directory-Research, AskyBot, assetlinks-scanner, AstroSafeDomainCategoryEvidence, AtenasAcervoCrawler, AteniumBot, AteveSearchSourceUrlDiscovery, atlas, AtlasResearchBot, AudienceExplorerBot, AuditBot, authorized-ai-gateway-fingerprint, Authorized-BugBounty-Env-Scanner, authorized-security-test, Autoconfig Test from USTC, autoemailspider, AutoRes-Crawler, Aviator-WebFetch, awi-research-crawler, AxiomaBot, BacklinkBot, BacklinkCrawler, BacklinkSpider, BackScanX, badbot, BananaBot, bang2012, bbot, BDBot, BeansLLM-CorpusBot, Bender, BesaCrawler, BFB2B-StoreIndex, BibleCRM-bot, Bimbot, BitFire-IconUpscaler, BlazeBot, BlohaBot, bloom-crawler, BlueBot-scout-url, BorneoBot, Bot, bot-research, Bot/Crawler, bot;, BotPoke, bounty-funnel-service, br-crawler, brands-bot, brands-bot-logo, BridgeDeskAI-PublicBusinessResearch, brightdata-datacomp-calibration, brightdata-serpapi-mcp, BrokenBacklinksBot, browserClientA, BSbot, BusinessNameBot, BuyersCloudBot, cached-search-image-fetcher, CAISearchBot, CaliWatch, CanadianOrganizationDirectoryCrawler, CandidateCrawler, CanonTouch-VL-Replay, CanvistaDirectoryResearch, capsfusion-downloader, caption-dataset-download, CareerPageBot, CCMetaBot, CCrawl, cc_bot, Centro Ads.txt Crawler, centurybot, CerebroBot, CF-UC User Agent, CFA3-Donor-Source-Graph, CGrab, chatui-agent, chimebot, ChimeUnfurlAgent, CitationAuditBot, ClaimChartBot, clark-crawler, ClawBot, CLcrawler, Clearout-Backlink, Clearscopebot, CMS-Checker, CMS-Security-Auditor, CMSInventory, CmsScaner/net8, code-docs-corpus, CodeMMPretrainCrawler, CommonCrawlNutchBot, company-domain-enricher, company-financial-miner, CompanyCrawler, CompanyExplorerWebsiteResearch, CompanyInternalSearchBot, CompanyKnowledgeCollector, CompanyResearch, CompassBot, ComplianceChecker, ConceptBurstBot, contact-finder, ContactBot, ContentBot, ContextFlow-Research, ConvomeshBot, Core11LocalResearch, CoreBot, CrawlBot, Crawler, Crawler test, Crawler-IP-Fetcher, crawler-purpose-audit, crawler-verification-research, CrawlerFr, CrawlerID, crawler_eb_germany, CrawlmBot, CrawlyProjectCrawler, crusader-worker, CS6913-Hw1-Crawler, CT-WP-Scanner, CTI-Engram-UrlFollow, Ctrl0Worker, CUBES-OC2-ContactDiscovery, CuratedSearchBot, curb, Custom-AsyncHttpClient, CustomerIranOpenSourceResearch, CustomScanner, cve-2026-87902-poc, CXK_Bot, CyberSitemapRepositoryBot, CyScan, dark_NeXus_Qbot, DARPResearchBot, Databot, DatacenterIntelligenceBot, datacomp-scraper, DataComp-storage-pilot, DatacompMetadataIngestion, DataFoundationResearch, DataGlobal, dataset-acq, DAutoBot, DaveCrawler, DeepResearch, Desync-Exploit, Detectobot, devlo-celeste-domain-waterfall, DF Bot, diderot-bot, Dispatch, DMARC-Research-Bot, Dmbot, DnBCrawler, DNSCrawler, DocIndex, docs-proofreader, domain-harvester, domain-info, domain-language-checker, domain-miner, domain-profiler, DomainAtlas, DomainAuditor, domainbox-domain-snapshot, DomainChecker, DomainCrawler, DomainEvidenceBot, DomainFilter, Domainfinder, domainfinder-access-study, DomainIntelBot, DomainMetadataChecker, DomainResearch, DomainScoutBot, dopis-bot, Dormouse, DownloaderChrome, DropCatcher, ds-robot, dwnupd, EcommerceDetector, EcommercePaymentGatewayDetector, edansbot, EdgeChangePasswordResearchCrawler, EFML-crawler, Elisabot, EmailFinderBot, EmailURLExtractor, EmailWolf, employer-address-finder, EngineBot, env-checker, EnvScanner, ErisBot, exa-reader, ExaticsBot, exp-oi2-scrape3, ExpiBot, expo-research-bot, EYEWORLD-Python-Research, factbase-robots, fake_bot, falcon-pixmo-cap-vqa, Farez-Sorter, FartcoinResearchBot, FAST-WebCrawler, fastcrawl, FastCrawler, FavicoHub, faviconiverse-redux, fedcrawl, FeedBot, FeedProcessor, FeedValidator, Fellow Links Parser Robot, fidget-spinner-bot, FileSearchTools, FindAPIs-HealthChecker, FirmableBot, FirstSeenBot, FLAI-WebScraper, FlfBaldrBot, FlorKz., FocusedCrawler, FormURLResearchBot, fresh-domain-watch, FriendLinkSurveyBot, Friendly testing bot, friendly-spider, FriendlyCrawler, FriendlyRssReader, Friendly_Crawler, fsd-crawler, Fuze_Bot, g2crawler, gaeskeun_bot, GASiteResearch, GazetteerBot, GdeVkusnayaEdaCrawler, GDPRScreeningBot, GeneralCrawlBot, GeneralWebsiteSpider, Gensparkbot, Georgia Tech README Security Research Crawler, GlobalFirmCrawler, GlobalGoalsDirectoryBot, GlobalWebSearch, Go Web Pentest Tool, Golfe, GoodBot, GoodReports-Compliance-Audit, google resource, Googlebot-Style, GoogleRot, GoParserBot, GoRedirectChecker, Gort, GoScanner, Govini-DQ-Checker, gregcrawler, Grover, gschaid bot, Guest, HalesiaPublicBusinessResearch, Halloy, HanaleiBot, HappyWing, HAProxy-Smuggler, HawaiiBot, Headless Chrome, Headless Edge, HealthCheckBot, heimdall, Hello World, HEXORA-Bot, HighVolumeNewsSourceDiscovery, hopgoblin, HostChecker, HostHeaderScanner, HostQuality, howBot, HSD-Public-Business-Contact-Research, HTTPHeadersCheck, HubSeedsBot, HUNT-Bot, HW4-Crawler, hypertok-recap-datacomp1b, IBM Crawler, icmp-tcp-oracle-probe, IF-source-quality-review, image-sites-research, ImageBot, ImageMind, IMATA-Bot, imgprefilter, IMJ-CompanyPage-Scraper, Implcit:AdsTxt-Scrapr, IndusFirehose, IndustrialIntelligenceBot, Info bot, IntelligenceCollector, internal-testing-crawler, ip9max, ipcrawl-exposure-scanner, IPdb-MetaRAG, jaddjabot, JarvisBot, Jedi-Hound, Jetfuel-Public-Dataset-Acquisition, Jetfuel-VLM-Raw-Fetch, jinming-test-hf-dataset-to-hdfs, jobs-crawler, JRCBot, JSACrawlerBot, JSCrawler, jurgendata, K/b-scanner, kagibot, KauaiBot, KBCnetContactBot, Keerthi Bot, keoki-ucp-probe, keys-so-bot, keyword-monitor, KONTUR_RF, KulaNews Feed Ingestion, LanaiBot, LanternBot, latents-to-cortex, LeadFeed, LeadFinderBot, LeadGennyBot, LemmaBot, LetrixLabs, libredtail-http, libretto-research, linabot, link-geo-country, LinkHunter, LinkOps-Liveness, LinkResearchBot, LinkScanProcessor, linus-torvalds-loves-you, Linux Gnu (cow), LinuxGetSsl, LiteLLM-Scanner, little-loops-link-checker, live-forum-pipeline, LiveScanner, LLMS-Txt-Scanner, llmstxt-survey, llmstxtScannerBot, LMCSearchBot, loadtest, local-knowledge-graph, LocalDomainCrawler, LocalIndexBot, LocalSearch, localsearch-homepage-enricher, LogMonitorBot, lolbot, loli_spider, longcontext-sourcing, LookoutBot, LuisSearchBot, LumeWebScan, lunabot, m1m-builder, Magellan, magicsearchdev, MailBot, MailCrawler, MaoxiaoWaterfallBot, MapDBWebsiteReview, MapOfTheInternet-StudentProject, MarkdownWorker, marketing-crawler, MassScanner, MathPicDatasetCrawler, MauiBot, maxx-citation-check, MB-AML-Research-Pipeline, Mend Importer, MeridianBot, metabase-cve-2026-72898-detect, MetadataScraper, metaphor-data-pipeline, migration-signal-crawler, MiniSearchBot, MiniWebCrawler, mj-wordpress-crawler, MJBot, MochiImageCrawler, ModelContextProtocol, molmo_replay-dataset-fetch, Monibot, monitor-telegram-clone-realtime, MoonBot, More, Mozilla, MrAtomic, msh-pdf-origin-canary, msh-pdfmin, MtakBot, MultimodalCrawler, My Nutch Spider, my-tiny-bot, MyBB-Archive-Bot, MyBot, MyCheckerBot, MyCrawler, MyEducationalCrawler, myrss-newsmeta, n8n-serp-crawler, namazu-cache-plus-ceph-body, nameserver-checker-http-validator, NapBot, NavCrawl, Navy Federal, nbertaupete95, NCKU-CSIE-WebMining-HW4-Crawler, NDDHunter, NebulaCVE, needle-monocle, net-research-scan, NetAPI, NeuroPipeline-OfferVerifier, NewsletterCatalogResearch, NewsletterFormResearchBot, newspaper, newswtbot, Nexgate Ruby Client, Nginx-Smuggler, Nicecrawler, NinjaAIBot, NiueBot, Noliae Crawler, notebot, NRDbot, NsearchBot, NumeosScoutObservatory, Nutch Spider, NVBot, nvdorz, Nx-zDHub, odin-scanner, OgScrper, OIDC-Fetcher, onex-datacomp-lance, OnlyHTML, OpenInternet-Discovery, OpenTheBoxBot, OpstimalBot, Orbbot, OSeans7Bot, osint research, OSSPVTracking, OutreachFilter, p40Bot, PageSourceSearchBot, PaigeHeraldBot, paper-reproduce-check-asset-url, paper-with-code-stage11, paramscan, parisbot, parquet-filter-downloader, PartnerScout, passkey-domain-check, PathToProject-WPMD-Research, PDFBot, PersodiaResearchBot, PersonalSearchBot, PhantomBot, PHP2Shell Exposure Auditor, PhxBot, pimeyes-downloader-api, PinjaOSINTBot, PisarBot, pixmo-cap-convert, pixmo-dataset-mirror, PixMo-Research-ImageCollector, PlamoExplorer, PoeSearchBot, polaris botnet, polite-crawler, PoliteCrawl, Polon, Pomothy-Bot, PopScreen Bot, pqc-http-scan, PrecisionBot, PriceTrackBot, PrivacyPolicyBot, PrivateBot, ProductLookoutBot, ProfileGrid-5995-mass-async, PromptingBot, ProspectCrawler, Prospex, PROWL-CompanyIntel, proxyhunter, ProxyPool-Scanner, ProxyTest, ProxyWingPublicContactCrawler, pshunt, PS_Daily, PUBGProductResearchBot, PublicBusinessRoleCollector, PublicSitemapPresenceResearch, pulley, PullWorkerRobotsDomain, PurchaseDetectorBot, QBOT, QOPFinder, QuantomataResearch, quick_checker, QuiverRasterResearch, r00ts3c-owned-you, RainBot, Rankabot, RealCyber-enricher, reasonix-web-fetch, recon-engine, ReconBot, RecordedFuture Global Inventory Crawler, redirect-scanner, ReeseCalderBot, RegistrarComplianceChecker, Relevant, Rely Bot, research, research crawler, research dataset crawler, research-crawler, research-script, ResearchBot, researchxoftheweb, RetroDocumentResearch, RevenueResearchBot, RevicBot, ReyilBot, ris-bot, Robot, robots-ai-permissions, robots-bulk-crawler, robots-scanner, robots-survey, robots-txt-audit, robots-txt-research, robots.py, robots.txt check, RobotsArchiveBot, RobotsScanner, RobotsTxtCheck, RobotsTxtScraper, RootCrawl-Crawler, rss-discovery-crawler, rss-feed-index-bot, RSSCollector, RSSReader, RssReaderBot, runtime-resources-research, rust-scrape, rust_sniffer, RW_Crawler, S-Scanner, S2.0Bot, S33DBot, SA-collector, SA-ZA-Accessibility-Collector, SaluteBot, ScamadviserExternalHit, SCAN, ScannerBot, ScanProxy, scout-research, scrap, scraper, Scrapper, sc_bot, sealdexbot, Seamus, search-agent, search-engine-indexer, searchdb, SearchEngineBot, Searcherweb, Searcherxweb, SearchExpress, SEBot-WA, SecScout, security-txt-discovery, SecurityAudit, SecurityHeaderAnalyzer, SecurityResearchBot, security_txt_analysis, sempi.tech bot, sendgrid-scanner, senthor-research, SeoCherryBot, SeoPieceProspectBot, seoscanners.net bot, SeoulBot, SequentryBrandRadarMVP, SerpCrawler, servicefilter, sexy-spider, sftp-scanner, ShellBot, SidekickAI Content Extractor, SignalLabCrawler, SimpleAsyncPageCrawler, site-checker, SiteDiscoveryBot, sitemap-parser-rs, SitemapBot, SitemapCrawler, SitemapCrawler.de crawler, SitemapReader, SitemapTitles, siteradar, SkillGymCorpusBot, SkynetBot, SkyworkSpider, SlaccaleBot, SlateGTM-ReadMe-MCP-Audit, SmartBotCrawler, smol-tiny-tarantula, SMRI-dataset-image-fetch, Snap URL Preview Service, SnipePublicResearch, Social Listening API, SocialMediaScrapperv2, SOcrawl, some agent, SourcingEngineBot, SpamBot, Spider, Spider_Bot, SQ-Scanner, SQLi-Scanner, SQLSpider, SSSSBot, StactBot, Storm-crawler, StrawberryBot, studyBot, subprocessor-reader, Supabase crawler, SupaGuard, SuperBot, SuperFastScraper, superfetch, SuperMegaHyperColossalMassiveGiganticAstronomicalM, supply-crawler, SurPhish-Reproduction-Crawler, sweep, swg-lab-probe, SynapicCrawl, SyncSearch, t2i-data-curation, TakeoverScanner, Tangent-check, TaxonomyResearchBot, TDCLabObserv8, TDM-Checker, TDMScanner, TechDetect, TechNewsBot, TechScanBot, TerminalCompanyFacilities, TernCrawler, terrabot-owned-you, tes-cocrawler, Test, Test Certificate Info, test-bot, TestBot, TestCrawler, TestSearchSpider, TestUserAgent, TflowSitemapBot, The Knowledge AI, TheInternetSearch, Theophrastus, thesis-research-bot, thin-cw-lance-import, ThinkChaos, ThirdQuestionReconciliation, ThreadLabsResearch, ThresselScanner, ThunkIt, Tier1Bot, Timing-Analysis, Tiny Crawler 101, Tiny-Crawler-101, TinyBotTestUA, TinyTestBot, TinyTestBoty, titlegrabber, TK-Metrics-SourceAudit, tld-netprobe, TLM-Audit-Scanner, TLSScanner, TMM Crawler, ToolissBot, toriset-llm-scraper, tphotobot, TprAdsTxtCrawler, Tranco Crawler, tranco-crawler, TrancoHTTPSMonitor, TransfusionResearchBot, TrendsmapResolver, TreuhandTeamfinder, Triplechecker, Trokambot, TrustedSearchBot, TSpider, UAScrapper, UCP-Discovery, uk-nhs-data, ultimate_sitemap_parser, Unite-ResolveUrl, UniversalSeedIntelligenceAgent, Unknown bot, UppinaMonitor, url-factory, URLBuilder, URLCleaner, UrlTest, v0bot, vague, VariableRatio-PublicAssetResearch, VDP-Scanner, verifiedbots-research, ViberBot, VICIdial-Recon-Classifier, Village-Technographics-Seed, VisibilityStack-Verify, VisionSet, VsuSearchSpider, vuln_scanner, WAF-Bypass-Test, WanScannerBot, WarmBadge-Trawler, warmup-scraper, WarpBot, Watermark, Web Crawler, web-crawler, web-image-collection-research, webapp-mapper, WebAtlasPrototype, WebBot, webcollage, WebCrawler, webflow-staging-diff, webindexer-bot, WebMCPIndexBot, WebRankSpider, WebScraperBot, WebSearchBot, webshopok-kutatas, WebSiphon bot, website-candidate-fetch-enricher, website-finder-kit, WebsiteFeeder, WebsucheBot, websusebot, web_fetcher, WF search, WhatStuffWhereBot, white-analyz-bug, WifiDoctorResearch, wise, WooCommerce-Detector, Wordup-1, Wordupindexinfo1, WorksOgCrawler, WorldBot, wp-cve-2026-87902-validator, WP-Safe-Scanner, wpbot, WPCheckBot, WPDataResearchBot, WPDetector, WPDirectoryBot, WPScanner, xbugalertBot, xfa1, xovicio-ai-classifier, XTC BOTNET, YFF35, your-search-bot, YTMeta-ImageBenchmark, Ytools, YunSecurityBot, Yuuperbot, ZAKREGEX-Scanner, ZanusLeadsBot, zebra-v2-bot, Zephuli-Bot, zero-tier-classifier, ZeroBot, zzhbot, _1z_bot, _zbot |
| Bot URL | |
| Status | Active |
Known variants
|
| Useragentstring | Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:08 |
| Last seen | 2026-11-02 13:18:57 |
| IP addresses | 11 |
| Walk from |
| 18.97.9.100 | ec2-18-97-9-100.compute-1.amazonaws.com |  | US |  |
| 18.97.9.102 | ec2-18-97-9-102.compute-1.amazonaws.com |  | US |  |
| 18.97.9.97 | ec2-18-97-9-97.compute-1.amazonaws.com |  | US |  |
| 18.97.9.96 | ec2-18-97-9-96.compute-1.amazonaws.com |  | US |  |
| 18.97.9.103 | ec2-18-97-9-103.compute-1.amazonaws.com |  | US |  |
| 18.97.9.98 | ec2-18-97-9-98.compute-1.amazonaws.com |  | US |  |
| 18.97.9.101 | ec2-18-97-9-101.compute-1.amazonaws.com |  | US |  |
| 18.97.9.99 | ec2-18-97-9-99.compute-1.amazonaws.com |  | US |  |
| 34.53.213.175 | 175.213.53.34.bc.googleusercontent.com |  | US |  |
| 34.16.195.6 | 6.195.16.34.bc.googleusercontent.com |  | US |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Gwene/1.0 (The gwene.org rss-to-news gateway) Googlebot
|
| Category | Web scraper |
| First seen | 2022-12-01 10:19:43 |
| Last seen | 2026-11-02 13:13:08 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 7_1_2 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/7.0 Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe)
|
| Category | Web scraper |
| First seen | 2026-08-03 22:51:07 |
| Last seen | 2026-11-02 08:35:24 |
| IP addresses | 123 |
| Walk from |
| 47.128.35.137 | ec2-47-128-35-137.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.98.40 | ec2-47-128-98-40.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.59.151 | ec2-47-128-59-151.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.96.119 | ec2-47-128-96-119.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.121.245 | ec2-47-128-121-245.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.40.227 | ec2-47-128-40-227.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.25.126 | ec2-47-128-25-126.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.36.159 | ec2-47-128-36-159.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.112.140 | ec2-47-128-112-140.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.26.99 | ec2-47-128-26-99.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-06-08 14:59:08 |
| Last seen | 2026-11-02 06:20:41 |
| IP addresses | 18,325 |
| Walk from |
| 47.128.61.51 | ec2-47-128-61-51.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.253 | ec2-47-128-61-253.ap-southeast-1.compute.amazonaws.com |  | AU |  |
| 47.128.61.57 | ec2-47-128-61-57.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.81 | ec2-47-128-61-81.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.99 | ec2-47-128-61-99.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.96 | ec2-47-128-61-96.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.44 | ec2-47-128-61-44.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.251 | ec2-47-128-61-251.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.37 | ec2-47-128-61-37.ap-southeast-1.compute.amazonaws.com |  | US |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
|
| Category | Web scraper |
| First seen | 2018-03-30 07:29:59 |
| Last seen | 2026-11-02 04:48:37 |
| IP addresses | 5,785 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2023-06-05 18:28:24 |
| Last seen | 2026-11-02 04:43:48 |
| IP addresses | 21,160 |
| Walk from |
| 47.128.61.251 | ec2-47-128-61-251.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.32 | ec2-47-128-61-32.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.74 | ec2-47-128-61-74.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.62.0 | ec2-47-128-62-0.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.108 | ec2-47-128-62-108.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.58 | ec2-47-128-61-58.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.49 | ec2-47-128-61-49.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.86 | ec2-47-128-61-86.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.95 | ec2-47-128-61-95.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.93 | ec2-47-128-61-93.ap-southeast-1.compute.amazonaws.com |  | US |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)
|
| Category | Web scraper |
| First seen | 2026-04-29 17:22:15 |
| Last seen | 2026-11-01 17:36:56 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Meta-WebIndexer/1.0; +https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
| Category | Web scraper |
| First seen | 2026-10-11 08:29:07 |
| Last seen | 2026-11-01 17:36:56 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36
|
| Category | Web scraper |
| First seen | 2026-10-24 18:56:20 |
| Last seen | 2026-11-01 17:36:56 |
| IP addresses | 5 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; GoogleTourBot/1.0; DNS scan web check)
|
| Category | Web scraper |
| First seen | 2026-08-14 23:50:47 |
| Last seen | 2026-11-01 03:11:02 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4201.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2021-09-02 05:11:43 |
| Last seen | 2026-10-29 05:06:37 |
| IP addresses | 8 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ChatGPT-User/1.0; +https://openai.com/bot)
|
| Category | Web scraper |
| First seen | 2026-04-29 17:21:27 |
| Last seen | 2026-10-25 04:43:15 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 (+http://search.msn.com/msnbot.htm\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:11:26 |
| Last seen | 2026-10-21 22:51:36 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/139.0.7258.156 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-07-15 15:16:17 |
| Last seen | 2026-10-21 08:20:29 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.224 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 21:06:06 |
| Last seen | 2026-10-20 12:23:34 |
| IP addresses | 18 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.199 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 17:18:48 |
| Last seen | 2026-10-19 06:42:13 |
| IP addresses | 35 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
|
| Category | Web scraper |
| First seen | 2024-06-03 03:05:24 |
| Last seen | 2026-10-17 13:48:27 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/117.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-10-15 18:12:25 |
| Last seen | 2026-10-15 18:12:25 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/147.0.7727.102 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-08-06 11:47:10 |
| Last seen | 2026-10-12 16:51:32 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/107.0.5281.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-09-21 18:53:30 |
| Last seen | 2026-10-09 09:21:31 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.0 Safari/605.1.15 (Applebot/0.1)
|
| Category | Web scraper |
| First seen | 2026-09-17 07:57:50 |
| Last seen | 2026-10-09 04:21:31 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.06 (KHTML, like Gecko; Google Web Preview) Chrome/131.0.6778.269 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-10-07 12:00:02 |
| Last seen | 2026-10-07 12:00:02 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2020-03-15 08:15:41 |
| Last seen | 2026-09-29 05:36:57 |
| IP addresses | 1,616 |
| Walk from |
|
|
| Useragentstring | Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-16 14:35:30 |
| Last seen | 2026-09-23 22:06:03 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 (+http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2011-01-23 15:09:17 |
| Last seen | 2026-09-21 22:45:40 |
| IP addresses | 122 |
| Walk from |
|
|
| Useragentstring | Baiduspider+(+http://www.baidu.com/search/spider.htm);google|baiduspider|baidu|spider|sogou|bing|yahoo|soso|sosospider|360spider|youdao|jikeSpider;)
|
| Category | Web scraper |
| First seen | 2024-04-16 05:34:33 |
| Last seen | 2026-09-17 11:07:00 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Sogou Push Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:04 |
| Last seen | 2026-09-09 21:59:50 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2026-04-29 15:21:53 |
| Last seen | 2026-08-29 08:02:39 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 16_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Mobile/15E148 Safari/604.1 (compatible; Yeti/1.1; +https://naver.me/spd)
|
| Category | Web scraper |
| First seen | 2024-05-28 05:58:19 |
| Last seen | 2026-08-28 14:26:04 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:34 |
| Last seen | 2026-08-28 14:03:03 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:05 |
| Last seen | 2026-08-28 14:03:02 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:12 |
| Last seen | 2026-08-28 14:02:59 |
| IP addresses | 4 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Applebot/0.1; +http://www.apple.com/go/applebot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:47 |
| Last seen | 2026-08-28 14:02:57 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe)
|
| Category | Web scraper |
| First seen | 2026-07-31 09:25:54 |
| Last seen | 2026-08-25 05:48:08 |
| IP addresses | 147 |
| Walk from |
| 47.128.61.47 | ec2-47-128-61-47.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.255 | ec2-47-128-61-255.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.94 | ec2-47-128-61-94.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.65 | ec2-47-128-61-65.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.104 | ec2-47-128-62-104.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.82 | ec2-47-128-61-82.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.80 | ec2-47-128-61-80.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.26 | ec2-47-128-61-26.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.46 | ec2-47-128-61-46.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; https://bytedance.sg.larkoffice.com/docx/K5bxdypulop3IIxrJb0lOjLVgFe) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-08-02 09:41:33 |
| Last seen | 2026-08-25 05:47:08 |
| IP addresses | 108 |
| Walk from |
| 47.128.61.52 | ec2-47-128-61-52.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.98 | ec2-47-128-61-98.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.40 | ec2-47-128-61-40.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.62 | ec2-47-128-61-62.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.84 | ec2-47-128-61-84.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.74 | ec2-47-128-61-74.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.89 | ec2-47-128-61-89.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.4 | ec2-47-128-61-4.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.62.103 | ec2-47-128-62-103.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-08-24 21:48:42 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-02-05 21:44:31 |
| Last seen | 2026-08-12 05:41:38 |
| IP addresses | 29 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/88.0.4324.175 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-07-04 04:59:45 |
| Last seen | 2026-08-07 09:21:54 |
| IP addresses | 259 |
| Walk from |
|
|
| Useragentstring | Bytespider
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2026-08-03 23:15:09 |
| Last seen | 2026-08-03 23:15:09 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +mailto:support@anthropic.com
|
| Category | Web scraper |
| First seen | 2026-06-03 01:55:44 |
| Last seen | 2026-08-03 12:25:33 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2016-07-20 00:20:12 |
| Last seen | 2026-07-29 07:46:19 |
| IP addresses | 157 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html) X-Middleton/1
|
| Category | Web scraper |
| First seen | 2026-07-28 17:40:18 |
| Last seen | 2026-07-28 17:40:18 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2024-05-17 13:46:13 |
| Last seen | 2026-07-23 22:21:12 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-12-16 17:58:46 |
| Last seen | 2026-07-23 11:32:30 |
| IP addresses | 33 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\x09
|
| Category | Web scraper |
| First seen | 2019-05-22 04:20:20 |
| Last seen | 2026-07-22 10:51:49 |
| IP addresses | 495 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2016-08-18 16:05:46 |
| Last seen | 2026-07-22 06:55:28 |
| IP addresses | 85 |
| Walk from |
|
|
| Useragentstring | iaskspider/2.0(+http://iask.com/help/help_index.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-16 15:01:10 |
| Last seen | 2026-07-20 08:39:46 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | msnbot/0.11 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-03-18 10:43:48 |
| Last seen | 2026-07-19 14:35:32 |
| IP addresses | 14 |
| Walk from |
|
|
| Useragentstring | SemrushBot-EO
|
| Category | Web scraper |
| First seen | 2026-05-24 01:40:56 |
| Last seen | 2026-07-18 01:13:35 |
| IP addresses | 61 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; DuckDuckBot/1.1; +http://duckduckgo.com/duckduckbot.html)
|
| Category | Web scraper |
| First seen | 2026-06-25 09:51:35 |
| Last seen | 2026-07-17 05:18:03 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-02-15 02:57:31 |
| Last seen | 2026-07-02 06:44:59 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1)
|
| Category | Web scraper |
| First seen | 2026-02-01 08:18:54 |
| Last seen | 2026-06-30 15:31:47 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | WebKit (kompatibel; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-06-29 18:59:19 |
| Last seen | 2026-06-29 18:59:19 |
| IP addresses | 4 |
| Walk from |
|
|
| Useragentstring | mkgp-data-pipeline/0.1 (+https://commoncrawl.org/)
|
| Category | Web scraper |
| First seen | 2026-06-29 13:23:26 |
| Last seen | 2026-06-29 13:23:26 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)
|
| Category | Web scraper |
| First seen | 2020-06-20 05:58:53 |
| Last seen | 2026-06-29 07:36:55 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-06-19 14:11:31 |
| Last seen | 2026-06-28 18:15:35 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)
|
| Category | Web scraper |
| First seen | 2020-07-18 20:02:13 |
| Last seen | 2026-06-27 00:57:06 |
| IP addresses | 19 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/\xA1\xB1; )
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-06-25 21:49:19 |
| IP addresses | 19 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; TelegramBot/1.0 like Linux)
|
| Category | Web scraper |
| First seen | 2026-06-09 18:09:28 |
| Last seen | 2026-06-25 15:56:32 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | AdsBot-Google ( http://www.google.com/adsbot.html)
|
| Category | Web scraper |
| First seen | 2020-09-02 16:18:57 |
| Last seen | 2026-06-19 13:34:12 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Googlebot-News
|
| Category | Web scraper |
| First seen | 2020-12-22 05:17:05 |
| Last seen | 2026-06-17 14:36:20 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Exabot
|
| Category | Web scraper |
| First seen | 2025-02-07 09:06:24 |
| Last seen | 2026-06-16 09:58:12 |
| IP addresses | 339 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 ( http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-06-25 03:05:08 |
| Last seen | 2026-06-14 23:02:47 |
| IP addresses | 14 |
| Walk from |
|
|
| Useragentstring | msnbot-media/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-01-10 22:19:16 |
| Last seen | 2026-06-14 10:06:40 |
| IP addresses | 16 |
| Walk from |
|
|
| Useragentstring | FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)
|
| Category | Web scraper |
| First seen | 2022-05-02 06:09:58 |
| Last seen | 2026-06-10 05:05:09 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LocalLightUdgerCrawler/1.0; +https://udger.com/resources/ua-list/crawlers)
|
| Category | Web scraper |
| First seen | 2026-06-05 14:10:53 |
| Last seen | 2026-06-05 14:10:53 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| First seen | 2018-04-26 16:22:53 |
| Last seen | 2026-05-30 08:17:46 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; GoogleOther; +https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:48 |
| Last seen | 2026-05-22 10:54:30 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; CohereBot/1.0; +https://cohere.com/bot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:45 |
| Last seen | 2026-05-22 10:43:58 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-19 07:08:33 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-05-16 14:03:01 |
| Last seen | 2026-05-16 14:03:01 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Meta-ExternalAgent/1.1; +https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-15 12:24:44 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:19 |
| Last seen | 2026-05-12 03:08:26 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexNews/4.0; +http://yandex.com/bots)
|
| Category | Web scraper |
| First seen | 2020-07-01 05:51:44 |
| Last seen | 2026-05-06 15:34:48 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.6668.71 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-08-24 14:42:58 |
| Last seen | 2026-05-04 14:39:29 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ThreatOpsBot/1.0; +https://threatops.fusion/bot) FeedFetcher-Google
|
| Category | Web scraper |
| First seen | 2026-05-03 23:39:51 |
| Last seen | 2026-05-03 23:39:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-07-05 04:31:51 |
| Last seen | 2026-04-21 12:50:01 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2018-04-18 12:36:23 |
| Last seen | 2026-04-19 22:17:15 |
| IP addresses | 335 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; BingIndexCrawler/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-14 04:57:33 |
| Last seen | 2026-04-15 09:02:44 |
| IP addresses | 60 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 10; Mobile; rv:68.0) Gecko/68.0 Firefox/68.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2026-04-06 06:43:25 |
| Last seen | 2026-04-09 14:45:04 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/145.0.7572.2 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-09 12:11:34 |
| Last seen | 2026-04-09 12:11:34 |
| IP addresses | 1 |
| Walk from |
| 92.169.7.81 | lfbn-idf2-1-1504-81.w92-169.abo.wanadoo.fr | | FR |  |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2026-04-06 16:19:07 |
| Last seen | 2026-04-06 16:19:07 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/spd).
|
| Category | Web scraper |
| First seen | 2026-04-02 06:06:27 |
| Last seen | 2026-04-02 06:06:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (GoogleBot; compatible; Robots.txt checker/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-12 18:05:32 |
| Last seen | 2026-03-30 15:45:37 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | msnbot/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2020-03-26 12:49:59 |
| Last seen | 2026-03-25 17:32:03 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Facebot
|
| Category | Web scraper |
| First seen | 2021-07-14 04:42:54 |
| Last seen | 2026-03-25 09:51:49 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-03-24 06:07:43 |
| Last seen | 2026-03-24 06:07:43 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/142.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-12-23 22:44:04 |
| Last seen | 2026-02-26 21:43:48 |
| IP addresses | 51 |
| Walk from |
|
|
| Useragentstring | GPTBot
|
| Category | Web scraper |
| First seen | 2025-09-18 00:14:39 |
| Last seen | 2026-02-24 05:27:44 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; Baiduspider-render/2.0; http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2026-02-02 16:11:53 |
| Last seen | 2026-02-13 05:21:08 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Vigil/1.0; +http://vigil-app.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-01-29 04:51:27 |
| Last seen | 2026-01-29 04:51:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-07-02 18:16:35 |
| Last seen | 2026-01-24 09:19:43 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LinkedInBot/1.0; +http://www.linkedin.com) Mobile Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-01-21 15:12:51 |
| Last seen | 2026-01-21 15:12:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | googlebot
|
| Category | Web scraper |
| First seen | 2020-10-13 18:45:00 |
| Last seen | 2026-01-15 06:16:23 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.7390.122 Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-01-15 05:31:48 |
| Last seen | 2026-01-15 05:31:48 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | BaiduSpider
|
| Category | Web scraper |
| First seen | 2022-09-03 03:05:42 |
| Last seen | 2026-01-09 05:44:46 |
| IP addresses | 65 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Googlebot/2.1
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2025-05-25 13:42:04 |
| Last seen | 2025-11-18 03:46:45 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | CCBot
|
| Category | Web scraper |
| First seen | 2025-02-12 19:53:02 |
| Last seen | 2025-11-11 17:35:28 |
| IP addresses | 1,233 |
| Walk from |
|
|
| Useragentstring | acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
|
| Category | Web scraper |
| First seen | 2018-10-09 02:34:15 |
| Last seen | 2025-10-13 17:17:34 |
| IP addresses | 168 |
| Walk from |
|
|
| Useragentstring | Baiduspider ( http://www.baidu.com/search/spider.htm)
|
| Category | Web scraper |
| First seen | 2020-01-02 10:43:07 |
| Last seen | 2025-09-26 16:28:39 |
| IP addresses | 10 |
| Walk from |
|