Resources > Crawlers list > Robots-txt.ai bot

logo Robots-txt.ai bot

ID: 228165
ProducerRobots-txt.ai External link
Bot URLhttps://robots-txt.ai/crawler External link
StatusActive Active

Known variants

Robots-txt Robots.txt Checker/1.0

UseragentstringRobots-txt Robots.txt Checker/1.0
Category-- Uncategorised --
First seen2026-08-22 20:42:24
Last seen2026-08-22 20:42:25
IP addresses1
Walk from
52.20.197.4ec2-52-20-197-4.compute-1.amazonaws.comUS
 

Robots.txt crawler

UseragentstringRobots.txt crawler - helps protect publisher content and lower bot traffic - https://robots-txt.ai/crawler
Category-- Uncategorised --
First seen2026-08-19 20:05:02
Last seen2026-08-21 20:26:07
IP addresses2
Walk from
213.159.13.42? US
136.227.164.243? US
 
Among our clients
View more...
 salesforce.com, inc.  
 MailChimp  
 Dailymotion SA  
 Allegro  
 Oracle  
 PayPal Holdings, Inc.