Resources > Crawlers list > Crawler4j

logo Crawler4j

ID: 6280
ProducerYasser Ganjisaffar External link
Bot URLhttps://github.com/yasserg/crawler4j External link
StatusActive Active

Known variants

Crawler4j

Useragentstringcrawler4j (https://github.com/yasserg/crawler4j/)
Category-- Uncategorised --
Respects robots.txtNo
First seen2015-06-26 08:12:54
Last seen2020-07-20 06:44:57
IP addresses168
Walk from
5.10.13.12cust-5-10-13-12.pools.tk-bodensee.net DE
52.58.51.168ec2-52-58-51-168.eu-central-1.compute.amazonaws.comDE
82.165.224.156crawlbap27.1and1.orgDE
82.165.224.164crawlbap35.1and1.orgDE
82.165.224.212crawlbap83.1and1.orgDE
82.165.224.252crawlbap123.1and1.orgDE
82.165.224.220crawlbap91.1and1.orgDE
82.165.224.228crawlbap99.1and1.orgDE
82.165.224.172crawlbap43.1and1.orgDE
82.165.224.148crawlbap19.1and1.orgDE

 
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More)
 

Crawler4j

Useragentstringcrawler4j (http://code.google.com/p/crawler4j/)
Category-- Uncategorised --
First seen2011-07-10 10:35:23
Last seen2018-01-26 09:37:36
IP addresses66
Walk from
78.111.120.31u120-31.static.grapesc.czCZ
160.16.113.81tk2-232-25827.vs.sakura.ne.jpJP
160.16.241.202tk2-262-40948.vs.sakura.ne.jpJP
218.18.3.167?CN
153.156.71.182p4934182-ipngnfx01marunouchi.tokyo.ocn.ne.jpJP
38.106.143.231cip-231.trustwave.comUS
128.143.137.126grayson.cs.virginia.eduUS
217.162.118.164217-162-118-164.dynamic.hispeed.chCH
109.207.29.2salt-ext.roke.co.ukGB
80.244.17.1?CY

 
.. and more .. (All IP Addresses available download to users with subscription. ... Learn More)
 

Crawler4j

Useragentstringcrawler4j for XQuery
Category-- Uncategorised --
First seen2015-11-24 05:12:00
Last seen2015-11-22 00:18:29
IP addresses1
Walk from
195.250.140.18195.250.140.18 CZ
 
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.