Producer | Zyte  |
Other robots of the same producer | Contacts Crawler, Crawlera, Frontera, Quick-Crawler, Splash |
Bot URL | https://scrapy.org/  |
Status | Active |
Known variants
|
Useragentstring | Scrapy/2.12.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2025-03-11 05:08:38 |
Last seen | 2025-03-25 06:08:40 |
IP addresses | 4 |
Walk from |
|
|
Useragentstring | Scrapy/2.11.2 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2024-06-28 05:06:35 |
Last seen | 2025-03-17 14:44:23 |
IP addresses | 13 |
Walk from |
|
|
Useragentstring | Scrapy/2.8.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2023-02-05 22:33:02 |
Last seen | 2025-03-17 10:00:51 |
IP addresses | 23 |
Walk from |
|
|
Useragentstring | Scrapy/2.5.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2022-01-02 06:43:48 |
Last seen | 2025-02-14 08:28:27 |
IP addresses | 32 |
Walk from |
|
|
Useragentstring | Scrapy/2.11.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2024-03-19 08:46:40 |
Last seen | 2024-12-26 08:09:56 |
IP addresses | 10 |
Walk from |
|
|
Useragentstring | Scrapy/2.6.3 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2023-08-03 18:44:39 |
Last seen | 2024-10-25 06:06:52 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/2.0.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2024-04-27 23:11:01 |
Last seen | 2024-05-21 03:56:46 |
IP addresses | 5 |
Walk from |
|
|
Useragentstring | Scrapy/2.11.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2024-01-04 09:09:43 |
Last seen | 2024-05-16 09:11:31 |
IP addresses | 5 |
Walk from |
|
|
Useragentstring | Scrapy/1.7.3 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2019-08-16 06:35:10 |
Last seen | 2024-03-16 08:02:20 |
IP addresses | 8 |
Walk from |
|
|
Useragentstring | Scrapy/2.9.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2023-07-08 12:50:36 |
Last seen | 2024-02-22 05:43:33 |
IP addresses | 5 |
Walk from |
|
|
Useragentstring | Scrapy/1.7.4 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2021-03-28 12:45:23 |
Last seen | 2023-09-15 03:34:15 |
IP addresses | 5 |
Walk from |
|
|
Useragentstring | Scrapy/2.10.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2023-08-27 17:31:21 |
Last seen | 2023-08-27 17:31:21 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/2.6.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2022-03-26 07:45:49 |
Last seen | 2023-04-11 07:34:22 |
IP addresses | 8 |
Walk from |
|
|
Useragentstring | Scrapy/2.6.2 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2023-01-22 19:28:46 |
Last seen | 2023-03-26 23:16:58 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/2.7.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2023-01-29 23:30:42 |
Last seen | 2023-02-02 13:18:10 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/2.4.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2021-03-25 04:33:03 |
Last seen | 2022-10-20 07:16:34 |
IP addresses | 4 |
Walk from |
|
|
Useragentstring | Scrapy/2.5.1 (+https://scrapy.org),gzip(gfe)
|
Category | Web scraper |
First seen | 2022-10-17 10:38:17 |
Last seen | 2022-10-17 10:38:17 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/1.1.3 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2018-03-10 17:09:30 |
Last seen | 2022-08-29 20:04:55 |
IP addresses | 8 |
Walk from |
|
|
Useragentstring | Scrapy/1.5.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2018-09-05 13:34:29 |
Last seen | 2021-12-09 04:54:59 |
IP addresses | 21 |
Walk from |
|
|
Useragentstring | Scrapy/2.5.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2021-08-10 20:54:06 |
Last seen | 2021-11-24 23:39:36 |
IP addresses | 3 |
Walk from |
|
|
Useragentstring | Scrapy/1.5.0 (+https://scrapy.org)
|
Category | Web scraper |
Respects robots.txt | No |
First seen | 2018-01-15 20:38:07 |
Last seen | 2021-07-29 22:13:37 |
IP addresses | 27 |
Walk from |
|
|
Useragentstring | Scrapy/2.2.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2021-01-28 17:17:23 |
Last seen | 2021-01-28 17:17:23 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/2.3.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2020-11-07 05:39:00 |
Last seen | 2021-01-04 07:55:09 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/1.8.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2019-11-11 05:12:58 |
Last seen | 2021-01-03 04:29:13 |
IP addresses | 7 |
Walk from |
|
|
Useragentstring | Scrapy/1.6.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2019-02-04 21:58:11 |
Last seen | 2020-10-19 13:26:38 |
IP addresses | 62 |
Walk from |
|
|
Useragentstring | Scrapy/2.2.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2020-07-06 11:04:52 |
Last seen | 2020-07-06 11:12:46 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/2.1.0 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2020-07-01 14:16:52 |
Last seen | 2020-07-01 14:52:14 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/1.7.2 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2019-10-17 16:38:47 |
Last seen | 2020-06-25 04:38:18 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/1.4.0 (+http://scrapy.org)
|
Category | Web scraper |
Respects robots.txt | No |
First seen | 2017-07-28 16:43:00 |
Last seen | 2020-01-13 13:16:28 |
IP addresses | 51 |
Walk from |
|
|
Useragentstring | Scrapy/1.0.5 (+http://scrapy.org)
|
Category | Web scraper |
Respects robots.txt | No |
First seen | 2016-02-12 15:26:00 |
Last seen | 2019-12-30 08:01:46 |
IP addresses | 12 |
Walk from |
|
|
Useragentstring | Scrapy/1.7.1 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2019-08-06 08:42:08 |
Last seen | 2019-08-27 11:30:05 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/1.5.2 (+https://scrapy.org)
|
Category | Web scraper |
First seen | 2019-02-03 19:06:16 |
Last seen | 2019-07-07 06:18:17 |
IP addresses | 3 |
Walk from |
|
|
Useragentstring | Scrapy/1.0.3 (+http://scrapy.org)
|
Category | Web scraper |
Respects robots.txt | No |
First seen | 2015-12-14 08:00:00 |
Last seen | 2018-05-11 07:16:04 |
IP addresses | 21 |
Walk from |
|
|
Useragentstring | Scrapy/1.3.0 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2017-01-30 01:37:54 |
Last seen | 2018-04-27 06:46:07 |
IP addresses | 5 |
Walk from |
|
|
Useragentstring | Scrapy/1.1.2 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2016-09-10 01:45:54 |
Last seen | 2018-03-19 11:01:04 |
IP addresses | 8 |
Walk from |
13.113.121.129 | ec2-13-113-121-129.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.197.188.46 | ec2-52-197-188-46.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.68.219.226 | ec2-52-68-219-226.ap-northeast-1.compute.amazonaws.com |  | JP |  |
13.113.12.64 | ec2-13-113-12-64.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.199.78.154 | ec2-52-199-78-154.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.199.104.67 | ec2-52-199-104-67.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.43.49.188 | ec2-52-43-49-188.us-west-2.compute.amazonaws.com |  | US |  |
52.25.226.122 | ec2-52-25-226-122.us-west-2.compute.amazonaws.com |  | US |  |
|
|
Useragentstring | Scrapy/1.3.2 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2017-12-20 10:34:45 |
Last seen | 2017-12-20 10:34:45 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/1.3.3 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2017-02-08 11:05:24 |
Last seen | 2017-11-07 09:12:10 |
IP addresses | 8 |
Walk from |
|
|
Useragentstring | Scrapy/0.16.5 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2016-08-18 20:17:35 |
Last seen | 2017-08-16 09:26:14 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/0.24.5 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2014-12-19 09:53:17 |
Last seen | 2017-04-14 00:30:33 |
IP addresses | 5 |
Walk from |
52.197.129.56 | ec2-52-197-129-56.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.69.69.138 | ec2-52-69-69-138.ap-northeast-1.compute.amazonaws.com |  | JP |  |
52.192.241.191 | ec2-52-192-241-191.ap-northeast-1.compute.amazonaws.com |  | JP |  |
107.23.56.124 | ec2-107-23-56-124.compute-1.amazonaws.com |  | US |  |
52.69.82.104 | ec2-52-69-82-104.ap-northeast-1.compute.amazonaws.com |  | JP |  |
|
|
Useragentstring | Scrapy/1.2.2 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2017-01-12 23:59:17 |
Last seen | 2017-03-26 23:59:17 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/1.0.5.post4+g4b324a8 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2017-01-07 23:32:39 |
Last seen | 2017-01-07 23:32:39 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/1.2.1 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2016-11-09 23:25:03 |
Last seen | 2016-12-13 16:37:29 |
IP addresses | 3 |
Walk from |
|
|
Useragentstring | Scrapy/1.1.1 (+http://scrapy.org)
|
Category | Web scraper |
Respects robots.txt | No |
First seen | 2016-09-11 07:43:33 |
Last seen | 2016-12-04 14:34:58 |
IP addresses | 3 |
Walk from |
|
|
Useragentstring | Scrapy/1.1.0 (+http://scrapy.org)
|
Category | Web scraper |
Respects robots.txt | No |
First seen | 2016-06-12 20:00:00 |
Last seen | 2016-09-01 16:03:46 |
IP addresses | 4 |
Walk from |
|
|
Useragentstring | Scrapy/1.0.4 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2016-01-27 06:10:00 |
Last seen | 2016-02-19 11:08:30 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/1.0.1 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2015-02-07 05:07:09 |
Last seen | 2016-02-10 14:16:41 |
IP addresses | 3 |
Walk from |
|
|
Useragentstring | Scrapy/0.24.0 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2014-08-08 09:15:00 |
Last seen | 2015-12-05 09:29:21 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/0.24.6 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2015-08-19 21:13:23 |
Last seen | 2015-08-19 21:13:23 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/0.25.1 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2015-04-08 18:52:07 |
Last seen | 2015-04-08 18:52:08 |
IP addresses | 1 |
Walk from |
|
|
Useragentstring | Scrapy/0.24.4 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2015-12-01 07:19:29 |
Last seen | 2014-12-10 23:03:17 |
IP addresses | 2 |
Walk from |
|
|
Useragentstring | Scrapy/0.22.2 (+http://scrapy.org)
|
Category | Web scraper |
First seen | 2014-02-18 10:40:06 |
Last seen | 2014-06-18 20:56:00 |
IP addresses | 2 |
Walk from |
|