| Producer | Unknown Author |
| Other robots of the same producer | 1M7bot, AAABot, AASA-Bot, ABEvalBot, AccompanyBot, AdaptaBot, adaptive-bot, AdBot, AdsBot, AdsrvrBot, AdsTxtBot, AdsTxtCrawler, AdsTxtCrawlerTP, advanced_crawler, Adventurer, AI-Security-Scanner, AlexionResearchBot, AlgorandSearchBot, alienfarm, ALittle Client, AliyunSecBot, altsvc-probe, AntBot, AnyBot, Apache-Smuggler, Aranet-SearchBot, aranhabot, Aream Crawler, AteniumBot, AtlasBot, Authorized-BugBounty-Env-Scanner, Autoconfig Test from USTC, autoemailspider, Aviator-WebFetch, BacklinkBot, BacklinkCrawler, BacklinkSpider, BackScanX, badbot, BananaBot, bang2012, bbot, BDBot, Bender, Bimbot, BitFire-IconUpscaler, BlazeBot, BlohaBot, BorneoBot, Bot, bot;, BotPoke, br-crawler, brands-bot, brands-bot-logo, brightdata-serpapi-mcp, browserClientA, BSbot, BusinessNameBot, CAISearchBot, CandidateCrawler, capsfusion-downloader, CCMetaBot, cc_bot, Centro Ads.txt Crawler, centurybot, CerebroBot, CF-UC User Agent, chimebot, ChimeUnfurlAgent, clark-crawler, ClawBot, CLcrawler, Clearscopebot, CMS-Checker, CommonCrawlNutchBot, CompanyCrawler, ComplianceChecker, ConvomeshBot, CoreBot, CrawlBot, Crawler, Crawler test, Crawler-IP-Fetcher, crawler_eb_germany, CrawlyProjectCrawler, CTI-Engram-UrlFollow, Ctrl0Worker, curb, Custom-AsyncHttpClient, CustomScanner, CXK_Bot, dark_NeXus_Qbot, DARPResearchBot, DataFoundationResearch, DAutoBot, DaveCrawler, Desync-Exploit, devlo-celeste-domain-waterfall, DF Bot, Dispatch, Dmbot, DnBCrawler, DNSCrawler, domain-profiler, DomainAuditor, DomainChecker, DomainCrawler, DomainFilter, DomainIntelBot, DomainScoutBot, DomainShield, Dormouse, DownloaderChrome, DropCatcher, ds-robot, edansbot, Elisabot, EmailWolf, employer-address-finder, env-checker, EnvScanner, ErisBot, ExaticsBot, expo-research-bot, fake_bot, FAST-WebCrawler, fastcrawl, fedcrawl, FeedBot, FeedValidator, Fellow Links Parser Robot, fidget-spinner-bot, FileSearchTools, FindAPIs-HealthChecker, FLAI-WebScraper, FlfBaldrBot, FlorKz., Friendly testing bot, friendly-spider, FriendlyCrawler, FriendlyRssReader, Friendly_Crawler, fsd-crawler, Fuze_Bot, g2crawler, gaeskeun_bot, GeneralWebsiteSpider, Gensparkbot, GlobalGoalsDirectoryBot, GlobalWebSearch, Golfe, GoodBot, google resource, GoogleRot, GoParserBot, GoRedirectChecker, Gort, GoScanner, gregcrawler, Grover, gschaid bot, Guest, HanaleiBot, HappyWing, HAProxy-Smuggler, HawaiiBot, Headless Chrome, Headless Edge, HealthCheckBot, heimdall, Hello World, hopgoblin, HostHeaderScanner, HostQuality, howBot, HubSeedsBot, IBM Crawler, ImageBot, ImageMind, IMATA-Bot, IMJ-CompanyPage-Scraper, Implcit:AdsTxt-Scrapr, Info bot, IntelligenceCollector, ip9max, ISSCyberRiskCrawler, jaddjabot, jinming-test-hf-dataset-to-hdfs, JSACrawlerBot, JSCrawler, jurgendata, K/b-scanner, KauaiBot, KauaiSlowBot, Keerthi Bot, keys-so-bot, keyword-monitor, LanaiBot, LetrixLabs, libredtail-http, linabot, link-geo-country, linus-torvalds-loves-you, Linux Gnu (cow), LinuxGetSsl, LiteLLM-Scanner, little-loops-link-checker, live-forum-pipeline, LLMS-Txt-Scanner, LMCSearchBot, loadtest, LocalDomainCrawler, LogMonitorBot, lolbot, loli_spider, LookoutBot, LumeWebScan, lunabot, Magellan, magicsearchdev, MailBot, MarkdownWorker, marketing-crawler, MassScanner, MauiBot, MetadataScraper, metaphor-data-pipeline, MiniWebCrawler, mj-wordpress-crawler, MJBot, ModelContextProtocol, Monibot, MoonBot, More, Mozilla, My Nutch Spider, my-tiny-bot, MyBB-Archive-Bot, MyBot, MyCheckerBot, MyCrawler, MyEducationalCrawler, n8n-serp-crawler, NapBot, Navy Federal, nbertaupete95, NDDHunter, NetAPI, newspaper, newswtbot, Nexgate Ruby Client, Nginx-Smuggler, Nicecrawler, NinjaAIBot, NiueBot, NsearchBot, Nutch Spider, NVBot, nvdorz, OgScrper, OIDC-Fetcher, OnlyHTML, OpenInternet-Discovery, OpenTheBoxBot, OpstimalBot, Orbbot, OSeans7Bot, osint research, OSSPVTracking, p40Bot, parisbot, parquet-filter-downloader, PDFBot, PersodiaResearchBot, PhantomBot, PhxBot, pimeyes-downloader-api, PinjaOSINTBot, PlamoExplorer, PoeSearchBot, polaris botnet, polite-crawler, PoliteCrawl, Pomothy-Bot, PopScreen Bot, pqc-http-scan, PrivacyPolicyBot, PrivateBot, ProductLookoutBot, PromptingBot, ProxyPool-Scanner, ProxyTest, PS_Daily, QBOT, quick_checker, r00ts3c-owned-you, RainBot, Rankabot, recon-engine, ReconBot, Relevant, Rely Bot, research crawler, research dataset crawler, ResearchBot, researchxoftheweb, RevicBot, ris-bot, Robot, robots-ai-permissions, robots-bulk-crawler, robots-scanner, robots-survey, robots.py, RobotsArchiveBot, RootCrawl-Crawler, rss-discovery-crawler, rss-feed-index-bot, RssReaderBot, runtime-resources-research, RW_Crawler, S-Scanner, SaluteBot, ScamadviserExternalHit, SCAN, ScannerBot, sc_bot, Seamus, search-engine-indexer, searchdb, SearchEngineBot, Searcherweb, Searcherxweb, SearchExpress, SEBot-WA, SecurityHeaderAnalyzer, SecurityResearchBot, security_txt_analysis, sempi.tech bot, sendgrid-scanner, senthor-research, SeoCherryBot, seoscanners.net bot, SeoulBot, SequentryBrandRadarMVP, servicefilter, sexy-spider, sftp-scanner, ShapBot, ShellBot, SimpleAsyncPageCrawler, site-checker, SitemapBot, SitemapCrawler, SitemapCrawler.de crawler, SkynetBot, SkyworkSpider, SlaccaleBot, SmartBotCrawler, smol-tiny-tarantula, Snap URL Preview Service, Social Listening API, SocialMediaScrapperv2, SOcrawl, some agent, Spider, Spider_Bot, SQ-Scanner, SQLi-Scanner, SSSSBot, StactBot, Stape, Storm-crawler, StrawberryBot, studyBot, SummalyBot, Supabase crawler, SupaGuard, SuperBot, SuperFastScraper, SuperMegaHyperColossalMassiveGiganticAstronomicalM, SyncSearch, TakeoverScanner, TDM-Checker, TDMScanner, TechDetect, TechNewsBot, terrabot-owned-you, tes-cocrawler, Test, Test Certificate Info, test-bot, TestBot, TestCrawler, TestUserAgent, The Knowledge AI, TheInternetSearch, Theophrastus, thesis-research-bot, ThinkChaos, ThresselScanner, Timing-Analysis, TinyBotTestUA, TinyTestBot, TinyTestBoty, TLSScanner, TMM Crawler, toriset-llm-scraper, TprAdsTxtCrawler, Tranco Crawler, TrendsmapResolver, Triplechecker, Trokambot, TSpider, UAScrapper, UCP-Discovery, Unite-ResolveUrl, UniversalSeedIntelligenceAgent, Unknown bot, UppinaMonitor, UrlTest, v0bot, vague, VDP-Scanner, VexelSearchBot, ViberBot, VisionSet, VsuSearchSpider, WAF-Bypass-Test, WanScannerBot, WarpBot, Web Crawler, web-crawler, WebBot, WebCrawler, WebRankSpider, WebScraperBot, website-candidate-fetch-enricher, WebsiteFeeder, websusebot, web_fetcher, WF search, WhatStuffWhereBot, white-analyz-bug, wise, WooCommerce-Detector, Wordup-1, Wordupindexinfo1, WorksOgCrawler, WorldBot, wpbot, WPCheckBot, WPDetector, WPScanner, xfa1, XTC BOTNET, YFF35, your-search-bot, Ytools, YunSecurityBot, Yuuperbot, ZAKREGEX-Scanner, zebra-v2-bot, Zephuli-Bot, ZeroBot, zzhbot, _1z_bot, _zbot |
| Bot URL | |
| Status | Active |
Known variants
|
| Useragentstring | Gwene/1.0 (The gwene.org rss-to-news gateway) Googlebot
|
| Category | Web scraper |
| First seen | 2022-12-01 10:19:43 |
| Last seen | 2026-06-18 20:23:55 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2023-06-05 18:28:24 |
| Last seen | 2026-06-18 18:00:09 |
| IP addresses | 21,126 |
| Walk from |
| 47.128.61.4 | ec2-47-128-61-4.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.125.130 | ec2-47-128-125-130.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.9 | ec2-47-128-61-9.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.59 | ec2-47-128-61-59.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.89 | ec2-47-128-61-89.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.255 | ec2-47-128-61-255.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.73 | ec2-47-128-61-73.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.93 | ec2-47-128-61-93.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.62.10 | ec2-47-128-62-10.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.253 | ec2-47-128-61-253.ap-southeast-1.compute.amazonaws.com |  | SG |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2016-07-20 00:20:12 |
| Last seen | 2026-06-18 15:26:57 |
| IP addresses | 78 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-02-05 21:44:31 |
| Last seen | 2026-06-18 10:57:41 |
| IP addresses | 25 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/88.0.4324.175 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-07-04 04:59:45 |
| Last seen | 2026-06-18 08:11:05 |
| IP addresses | 180 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
|
| Category | Web scraper |
| First seen | 2018-03-30 07:29:59 |
| Last seen | 2026-06-18 05:48:02 |
| IP addresses | 4,385 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-06-08 14:59:08 |
| Last seen | 2026-06-18 05:42:35 |
| IP addresses | 18,323 |
| Walk from |
| 47.128.61.25 | ec2-47-128-61-25.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.76 | ec2-47-128-61-76.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.57 | ec2-47-128-61-57.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.37 | ec2-47-128-61-37.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.43 | ec2-47-128-61-43.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.31 | ec2-47-128-61-31.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.35 | ec2-47-128-61-35.ap-southeast-1.compute.amazonaws.com |  | SG |  |
| 47.128.61.40 | ec2-47-128-61-40.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.44 | ec2-47-128-61-44.ap-southeast-1.compute.amazonaws.com |  | US |  |
| 47.128.61.46 | ec2-47-128-61-46.ap-southeast-1.compute.amazonaws.com |  | US |  |
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More) |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/\xA1\xB1; )
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-06-17 22:17:35 |
| IP addresses | 19 |
| Walk from |
|
|
| Useragentstring | facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)
|
| Category | Web scraper |
| First seen | 2020-06-20 05:58:53 |
| Last seen | 2026-06-17 15:20:22 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Googlebot-News
|
| Category | Web scraper |
| First seen | 2020-12-22 05:17:05 |
| Last seen | 2026-06-17 14:36:20 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Exabot
|
| Category | Web scraper |
| First seen | 2025-02-07 09:06:24 |
| Last seen | 2026-06-16 09:58:12 |
| IP addresses | 350 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.199 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 17:18:48 |
| Last seen | 2026-06-15 10:14:45 |
| IP addresses | 27 |
| Walk from |
|
|
| Useragentstring | iaskspider/2.0(+http://iask.com/help/help_index.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-16 15:01:10 |
| Last seen | 2026-06-15 06:01:04 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 ( http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-06-25 03:05:08 |
| Last seen | 2026-06-14 23:02:47 |
| IP addresses | 15 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:12 |
| Last seen | 2026-06-14 16:34:44 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:34 |
| Last seen | 2026-06-14 16:34:43 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:08 |
| Last seen | 2026-06-14 16:34:43 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | msnbot-media/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-01-10 22:19:16 |
| Last seen | 2026-06-14 10:06:40 |
| IP addresses | 16 |
| Walk from |
|
|
| Useragentstring | Gaisbot/3.0 (robot@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php)
|
| Category | Web scraper |
| First seen | 2020-02-06 05:51:00 |
| Last seen | 2026-06-10 05:05:13 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; U; CPU iPhone OS) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-06-19 14:11:31 |
| Last seen | 2026-06-10 05:05:10 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)
|
| Category | Web scraper |
| First seen | 2022-05-02 06:09:58 |
| Last seen | 2026-06-10 05:05:09 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; TelegramBot/1.0 like Linux)
|
| Category | Web scraper |
| First seen | 2026-06-09 18:09:28 |
| Last seen | 2026-06-09 18:09:28 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
|
| Category | Web scraper |
| First seen | 2024-06-03 03:05:24 |
| Last seen | 2026-06-09 17:41:59 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.224 Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-04-06 21:06:06 |
| Last seen | 2026-06-09 14:45:38 |
| IP addresses | 15 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Applebot/0.1; +http://www.apple.com/go/applebot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:47 |
| Last seen | 2026-06-07 05:14:43 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com)
|
| Category | Web scraper |
| First seen | 2026-04-29 15:21:53 |
| Last seen | 2026-06-07 05:14:37 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | SemrushBot-EO
|
| Category | Web scraper |
| First seen | 2026-05-24 01:40:56 |
| Last seen | 2026-06-06 17:48:02 |
| IP addresses | 41 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LocalLightUdgerCrawler/1.0; +https://udger.com/resources/ua-list/crawlers)
|
| Category | Web scraper |
| First seen | 2026-06-05 14:10:53 |
| Last seen | 2026-06-05 14:10:53 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-16 14:35:30 |
| Last seen | 2026-05-31 22:49:05 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)
|
| Category | Web scraper |
| First seen | 2020-07-18 20:02:13 |
| Last seen | 2026-05-30 08:17:47 |
| IP addresses | 19 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| First seen | 2018-04-26 16:22:53 |
| Last seen | 2026-05-30 08:17:46 |
| IP addresses | 14 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Bingbot/2.0; +http://www.bing.com/bingbot.htm)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2020-03-15 08:15:41 |
| Last seen | 2026-05-30 07:20:04 |
| IP addresses | 1,615 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; GoogleOther; +https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:48 |
| Last seen | 2026-05-22 10:54:30 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; CohereBot/1.0; +https://cohere.com/bot)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:45 |
| Last seen | 2026-05-22 10:43:58 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1)
|
| Category | Web scraper |
| First seen | 2026-02-01 08:18:54 |
| Last seen | 2026-05-22 09:20:56 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2024-05-17 13:46:13 |
| Last seen | 2026-05-21 21:57:34 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-19 07:08:33 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-05-16 14:03:01 |
| Last seen | 2026-05-16 14:03:01 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:09 |
| Last seen | 2026-05-16 01:17:35 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Meta-ExternalAgent/1.1; +https://developers.facebook.com/docs/sharing/webmasters/crawler)
|
| Category | Web scraper |
| First seen | 2026-04-28 09:53:18 |
| Last seen | 2026-05-15 12:24:44 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
|
| Category | Web scraper |
| First seen | 2026-05-02 07:37:05 |
| Last seen | 2026-05-15 12:24:39 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-02-15 02:57:31 |
| Last seen | 2026-05-15 05:18:37 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Googlebot/2.1 (+http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2011-01-23 15:09:17 |
| Last seen | 2026-05-14 22:20:20 |
| IP addresses | 122 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:19 |
| Last seen | 2026-05-12 03:08:26 |
| IP addresses | 9 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexNews/4.0; +http://yandex.com/bots)
|
| Category | Web scraper |
| First seen | 2020-07-01 05:51:44 |
| Last seen | 2026-05-06 15:34:48 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.6668.71 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-08-24 14:42:58 |
| Last seen | 2026-05-04 14:39:29 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; ThreatOpsBot/1.0; +https://threatops.fusion/bot) FeedFetcher-Google
|
| Category | Web scraper |
| First seen | 2026-05-03 23:39:51 |
| Last seen | 2026-05-03 23:39:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | AdsBot-Google ( http://www.google.com/adsbot.html)
|
| Category | Web scraper |
| First seen | 2020-09-02 16:18:57 |
| Last seen | 2026-04-28 17:02:34 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-07-05 04:31:51 |
| Last seen | 2026-04-21 12:50:01 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\xA3\xA9
|
| Category | Web scraper |
| First seen | 2018-04-18 12:36:23 |
| Last seen | 2026-04-19 22:17:15 |
| IP addresses | 335 |
| Walk from |
|
|
| Useragentstring | msnbot/0.11 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-03-18 10:43:48 |
| Last seen | 2026-04-19 05:18:10 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; BingIndexCrawler/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-14 04:57:33 |
| Last seen | 2026-04-15 09:02:44 |
| IP addresses | 60 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html\x09
|
| Category | Web scraper |
| First seen | 2019-05-22 04:20:20 |
| Last seen | 2026-04-15 07:46:23 |
| IP addresses | 494 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 10; Mobile; rv:68.0) Gecko/68.0 Firefox/68.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2026-04-06 06:43:25 |
| Last seen | 2026-04-09 14:45:04 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/145.0.7572.2 Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-04-09 12:11:34 |
| Last seen | 2026-04-09 12:11:34 |
| IP addresses | 1 |
| Walk from |
| 92.169.7.81 | lfbn-idf2-1-1504-81.w92-169.abo.wanadoo.fr | | FR |  |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2026-04-06 16:19:07 |
| Last seen | 2026-04-06 16:19:07 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/spd).
|
| Category | Web scraper |
| First seen | 2026-04-02 06:06:27 |
| Last seen | 2026-04-02 06:06:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (GoogleBot; compatible; Robots.txt checker/1.0)
|
| Category | Web scraper |
| First seen | 2026-02-12 18:05:32 |
| Last seen | 2026-03-30 15:45:37 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4201.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2021-09-02 05:11:43 |
| Last seen | 2026-03-29 08:16:58 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | msnbot/1.1 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2020-03-26 12:49:59 |
| Last seen | 2026-03-25 17:32:03 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | Facebot
|
| Category | Web scraper |
| First seen | 2021-07-14 04:42:54 |
| Last seen | 2026-03-25 09:51:49 |
| IP addresses | 6 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-03-24 06:07:43 |
| Last seen | 2026-03-24 06:07:43 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Sogou Push Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07\xA1\xE5)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:12:04 |
| Last seen | 2026-03-17 04:25:21 |
| IP addresses | 13 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 16_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Mobile/15E148 Safari/604.1 (compatible; Yeti/1.1; +https://naver.me/spd)
|
| Category | Web scraper |
| First seen | 2024-05-28 05:58:19 |
| Last seen | 2026-02-28 14:15:34 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/142.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-12-23 22:44:04 |
| Last seen | 2026-02-26 21:43:48 |
| IP addresses | 51 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 (+http://search.msn.com/msnbot.htm\xA1\xB1)
|
| Category | Web scraper |
| First seen | 2024-05-17 22:11:26 |
| Last seen | 2026-02-25 08:03:11 |
| IP addresses | 12 |
| Walk from |
|
|
| Useragentstring | GPTBot
|
| Category | Web scraper |
| First seen | 2025-09-18 00:14:39 |
| Last seen | 2026-02-24 05:27:44 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; Baiduspider-render/2.0; http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2026-02-02 16:11:53 |
| Last seen | 2026-02-13 05:21:08 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2016-08-18 16:05:46 |
| Last seen | 2026-02-02 18:17:15 |
| IP addresses | 84 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Vigil/1.0; +http://vigil-app.com/bot.html)
|
| Category | Web scraper |
| First seen | 2026-01-29 04:51:27 |
| Last seen | 2026-01-29 04:51:27 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1; +http://google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2023-07-02 18:16:35 |
| Last seen | 2026-01-24 09:19:43 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; LinkedInBot/1.0; +http://www.linkedin.com) Mobile Safari/537.36
|
| Category | Web scraper |
| First seen | 2026-01-21 15:12:51 |
| Last seen | 2026-01-21 15:12:51 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | googlebot
|
| Category | Web scraper |
| First seen | 2020-10-13 18:45:00 |
| Last seen | 2026-01-15 06:16:23 |
| IP addresses | 11 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.7390.122 Safari/537.36 (compatible; Google-InspectionTool/1.0)
|
| Category | Web scraper |
| First seen | 2026-01-15 05:31:48 |
| Last seen | 2026-01-15 05:31:48 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | BaiduSpider
|
| Category | Web scraper |
| First seen | 2022-09-03 03:05:42 |
| Last seen | 2026-01-09 05:44:46 |
| IP addresses | 65 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Googlebot/2.1
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2025-05-25 13:42:04 |
| Last seen | 2025-11-18 03:46:45 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | CCBot
|
| Category | Web scraper |
| First seen | 2025-02-12 19:53:02 |
| Last seen | 2025-11-11 17:35:28 |
| IP addresses | 1,233 |
| Walk from |
|
|
| Useragentstring | acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
|
| Category | Web scraper |
| First seen | 2018-10-09 02:34:15 |
| Last seen | 2025-10-13 17:17:34 |
| IP addresses | 168 |
| Walk from |
|
|
| Useragentstring | Baiduspider ( http://www.baidu.com/search/spider.htm)
|
| Category | Web scraper |
| First seen | 2020-01-02 10:43:07 |
| Last seen | 2025-09-26 16:28:39 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 11; Pixel 5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.5993.70 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-09-04 04:17:50 |
| Last seen | 2025-09-09 05:59:51 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | compatible; Googlebot/2.1; +http://www.google.com/bot.htm
|
| Category | Web scraper |
| First seen | 2025-09-06 23:33:39 |
| Last seen | 2025-09-06 23:33:39 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.96 Safari/537.36 Bingbot/2.0
|
| Category | Web scraper |
| First seen | 2025-07-10 05:51:02 |
| Last seen | 2025-09-04 04:45:06 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.4 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25
|
| Category | Web scraper |
| First seen | 2020-02-19 08:19:32 |
| Last seen | 2025-08-20 21:57:57 |
| IP addresses | 0 |
| Walk from | |
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
|
| Category | Web scraper |
| First seen | 2023-03-20 15:27:32 |
| Last seen | 2025-08-20 07:31:13 |
| IP addresses | 10 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2020-02-05 11:05:11 |
| Last seen | 2025-08-13 11:45:35 |
| IP addresses | 22 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.10) Gecko/20100623 Iceweasel/3.5.10 (like Firefox/3.5.10) Googlebot
|
| Category | Web scraper |
| Respects robots.txt | No |
| First seen | 2022-12-01 09:44:51 |
| Last seen | 2025-08-11 16:06:15 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Y!J-DLC/1.0 (https://support.yahoo-net.jp/PccSearch/s/article/H000007955)
|
| Category | Web scraper |
| First seen | 2024-11-11 06:32:44 |
| Last seen | 2025-07-23 05:24:35 |
| IP addresses | 2 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e YisouSpider/5.0 Safari/602.
|
| Category | Web scraper |
| First seen | 2025-07-11 06:18:22 |
| Last seen | 2025-07-11 06:31:22 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot-Video/1.0; +http://www.google.com/bot.html)
|
| Category | Web scraper |
| First seen | 2025-06-12 17:57:50 |
| Last seen | 2025-06-12 17:57:50 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | msnbot/1.0 ( http://search.msn.com/msnbot.htm)
|
| Category | Web scraper |
| First seen | 2022-09-14 20:06:01 |
| Last seen | 2025-06-10 04:23:45 |
| IP addresses | 7 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; YandexBot/3.0; +<http://yandex.com/bots>)
|
| Category | Web scraper |
| First seen | 2025-05-25 13:40:57 |
| Last seen | 2025-05-25 13:40:57 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/136.0.0.0 Safari/537.36
|
| Category | Web scraper |
| First seen | 2025-05-14 14:46:10 |
| Last seen | 2025-05-14 14:46:10 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/537.36 (KHTML, like Gecko, Mediapartners-Google) Chrome/87.0.4280.90 Safari/537.36,gzip(gfe)
|
| Category | Web scraper |
| First seen | 2025-04-30 06:30:04 |
| Last seen | 2025-04-30 06:30:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | gptbot
|
| Category | Web scraper |
| First seen | 2025-04-29 15:28:28 |
| Last seen | 2025-04-29 15:28:28 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 Baiduspider+(+http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2025-04-10 04:20:04 |
| Last seen | 2025-04-10 04:20:04 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (iPhone; Y!J-BRY/YATSH crawler; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)
|
| Category | Web scraper |
| First seen | 2025-03-31 12:11:01 |
| Last seen | 2025-03-31 12:11:01 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Blogtrottr/2.1 (+https://blogtrottr.com/)
|
| Category | Web scraper |
| First seen | 2025-03-18 18:21:55 |
| Last seen | 2025-03-24 16:26:44 |
| IP addresses | 3 |
| Walk from |
|
|
| Useragentstring | CriteoBot/0.1
|
| Category | Web scraper |
| First seen | 2025-03-20 23:18:13 |
| Last seen | 2025-03-20 23:18:13 |
| IP addresses | 1 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Googlebot/2.1 +http://www.googlebot.com/bot.html)
|
| Category | Web scraper |
| First seen | 2014-12-16 17:58:46 |
| Last seen | 2025-03-13 13:23:51 |
| IP addresses | 32 |
| Walk from |
|
|
| Useragentstring | Mozilla/5.0 (compatible; Baiduspider/2.0;+http://www.baidu.com/search/spider.html)
|
| Category | Web scraper |
| First seen | 2019-09-14 06:14:20 |
| Last seen | 2025-03-08 09:11:49 |
| IP addresses | 13 |
| Walk from |
|