Resources > Crawlers list > Wikipedia crawler

logo Wikipedia crawler

ID: 33245
ProducerWikimedia Foundation Inc External link
Bot URLhttps://en.wikipedia.org/wiki/Category:All_Wikipedia_bots External link
StatusActive Active

Known variants

IABot/2.0

UseragentstringIABot/2.0 (+https://meta.wikimedia.org/wiki/InternetArchiveBot/FAQ_for_sysadmins) (Checking if link from Wikipedia is broken and needs removal)
CategoryLink checker
First seen2019-09-21 07:32:50
Last seen2020-01-10 06:29:40
IP addresses1
Walk from
185.15.56.22instance-cyberbot-exec-iabot-01.cyberbot.wmflabs.orgUS
 

IABot

UseragentstringIABot: Checking if link from Wikipedia is broken and needs removal - See https://meta.wikimedia.org/wiki/InternetArchiveBot/FAQ_for_sysadmins
CategoryLink checker
First seen2019-04-19 05:00:12
Last seen2019-09-09 08:13:37
IP addresses1
Walk from
185.15.56.22instance-cyberbot-exec-iabot-01.cyberbot.wmflabs.orgUS
 

COIBotParser/2.0

UseragentstringCOIBotParser/2.0
CategoryLink checker
First seen2019-08-09 09:08:31
Last seen2019-08-09 09:08:31
IP addresses1
Walk from
185.15.56.1nat.openstack.eqiad1.wikimediacloud.orgNL
 

GiftBot

UseragentstringGerman Wikipedia Broken Weblinks Bot; contact: gifti@tools.wmflabs.org
CategoryLink checker
First seen2015-02-21 09:58:19
Last seen2017-02-14 08:13:11
IP addresses1
Walk from
208.80.155.255internal-server-nat.wmflabs.orgUS
 
Among our clients
View more...
 SAP  
 MailChimp  
 Dailymotion SA  
 Akamai Technologies, Inc.  
 Oracle  
 PayPal Holdings, Inc.  

Recently Added UAS

Products

Resources

About Us