Resources > Crawlers list > LemurWebCrawler

logo LemurWebCrawler

ID: 6612
ProducerLanguage Technologies Institute External link
Bot URLhttp://boston.lti.cs.cmu.edu/crawler_12/ External link
StatusInactive Inactive

Known variants

LemurWebCrawler

UseragentstringMozilla/5.0 (compatible; heritrix/3.1.0-RC1 +http://boston.lti.cs.cmu.edu/crawler_12/)
Category-- Uncategorised --
First seen2011-10-18 21:36:15
Last seen2011-10-15 18:18:16
IP addresses1
Walk from
128.2.207.79boston-cluster.lti.cs.cmu.eduUS
 

LemurWebCrawler

UseragentstringThe Lemur Web Crawler/Nutch-1.3 (Lemur Web Crawler; http://boston.lti.cs.cmu.edu/crawler_12/; admin@lemurproject.org)
Category-- Uncategorised --
First seen2011-10-04 08:10:00
Last seen2011-10-04 03:59:37
IP addresses1
Walk from
128.2.207.79boston-cluster.lti.cs.cmu.eduUS
 
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.