Nike crawler

This crawler extracts product data from the Nike website.

It is developped and maintained by the Cortexalt team, using a rust-based library we developed from scratch for maximum stealth and cost efficiency.

As a result, you can run the actor with only 128 MB of memory and minimize compute costs (see below).

Proxy

The crawler should run without any proxy, as it is designed to be stealthy and avoid being detected.
If it does get blocked however, Apify datacenter and residential proxies are supported.

Benchmarks

We ran these benchmarks on the Apify platform, using 128 MB of memory (and 0.031 CPU cores), to give you an idea of the performance of the actor, and the time and cost you can expect when running it.

The actor sends around 10 requests per second, so as to not overload the website and avoid being blocked.
The maximum number of products can be configured, look for the budget parameter in the actor's run input.

• 100 products

  

• 1000 products

  

• 10000 products

  

• All ~20k products

  

Extracted data

This actor extracts a wide array of product information, as well as metadata about the run.
Each extracted product is thus formatted as a JSON object:

1{
2    "metadata": {...},
3    "data": {...}
4}

By default the dashboard only shows an overview of the most important fields:

Click on All fields and JSON to see the full data.

Sample data

1{
2    "metadata": {
3        "timestamp": "2024-12-30T13:33:03.909Z",
4        "run_id": "WPujuimlbv",
5        "actor": "nike",
6        "template": "product"
7    },
8    "data": {
9        "url": "https://www.nike.com/t/fast-mens-dri-fit-running-singlet-xCCZCl/FN4229-121",
10        "product_id": "FN4229-121",
11        "product_group": {
12            "group_id": "xCCZCl",
13            "product_ids": [
14                "FN4229-376",
15                "FN4229-010",
16                "FN4229-121"
17            ]
18        },
19        "title": "Nike Fast",
20        "subtitle": "Men's Dri-FIT Running Singlet",
21        "brand": "Nike",
22        "publication_date": "2024-01-08T08:00:00.000Z",
23        "price": {
24            "current": 38.97,
25            "full": 45,
26            "currency": "USD",
27            "on_sale": true,
28            "sale_percentage": "13%"
29        },
30        "breadcrumbs": "Track & field > Running > Apparel",
31        "categories": [
32            "Track & field",
33            "Running",
34            "Apparel"
35        ],
36        "gender": "1",
37        "description": "Designed for racing, the Nike Fast singlet offers lightweight breathability to help you move comfortably through every stride. Its relaxed fit and ultralight design won't get in your way from starting pistol to final kick.",
38        "material": null,
39        "pattern": null,
40        "country_of_origin": null,
41        "additional_properties": [
42            "Racerback design",
43            "Reflective Swoosh",
44            "100% polyester",
45            "Machine wash",
46            "Imported",
47            "Not intended for use as Personal Protective Equipment (PPE)"
48        ],
49        "main_image": "https://static.nike.com/a/images/t_default/1435d28d-5091-4b81-977d-f12a820d243d/M+NK+DF+FAST+SINGLET.png",
50        "images": [
51            "https://static.nike.com/a/images/t_default/1435d28d-5091-4b81-977d-f12a820d243d/M+NK+DF+FAST+SINGLET.png",
52            "https://static.nike.com/a/images/t_default/794f6e0f-ed10-4364-a330-63057a0e680c/M+NK+DF+FAST+SINGLET.png",
53            "https://static.nike.com/a/images/t_default/910a1069-4673-438c-ba40-9760c39eeed1/M+NK+DF+FAST+SINGLET.png",
54            "https://static.nike.com/a/images/t_default/897ca9e4-fa88-4dc2-a486-2d83abd632b0/M+NK+DF+FAST+SINGLET.png",
55            "https://static.nike.com/a/images/t_default/e1fe4b7e-cc9c-4332-9086-cb5f8dd579d3/M+NK+DF+FAST+SINGLET.png",
56            "https://static.nike.com/a/images/t_default/8eae1285-fd0d-464a-bcaf-6b9e0256ee1b/M+NK+DF+FAST+SINGLET.png",
57            "https://static.nike.com/a/images/t_default/fa5c354b-f0bc-4fe4-a13f-298100e6b20a/M+NK+DF+FAST+SINGLET.png"
58        ],
59        "videos": [
60            "https://static.nike.com/a/videos/q_90/1bc5520d-947f-48d7-9f39-4cef81723ced/video.mp4"
61        ],
62        "color": "Summit White",
63        "reviews": {
64            "average_rating": null,
65            "count": null,
66            "best_rating": "5",
67            "worts_rating": "0"
68        },
69        "sizes": [
70            {
71                "name": "XXS",
72                "size_system": null,
73                "sku": "2c0013e9-7353-5f36-b8fc-9f5e96a7529b",
74                "gtin": "00196976001049",
75                "availability": null
76            },
77            {
78                "name": "XS",
79                "size_system": null,
80                "sku": "ee329513-cb58-512b-a954-e54556e3f73e",
81                "gtin": "00196976012243",
82                "availability": null
83            },
84            {
85                "name": "S",
86                "size_system": null,
87                "sku": "be59638a-b008-558f-86e3-d6aa0848338a",
88                "gtin": "00196976004323",
89                "availability": null
90            },
91            {
92                "name": "M",
93                "size_system": null,
94                "sku": "1f2c6a3f-42bc-5cbe-ba22-2597b75d09ee",
95                "gtin": "00196976006372",
96                "availability": null
97            },
98            {
99                "name": "L",
100                "size_system": null,
101                "sku": "980d53d5-2ddd-570d-9ff1-06ea4e05a923",
102                "gtin": "00196976009977",
103                "availability": null
104            },
105            {
106                "name": "XL",
107                "size_system": null,
108                "sku": "a8c7cf2b-a222-5efd-a1dc-5fcc37ab72a4",
109                "gtin": "00196976002015",
110                "availability": null
111            },
112            {
113                "name": "XXL",
114                "size_system": null,
115                "sku": "e9bc0028-29a7-5ccc-bb69-e22432b70f4c",
116                "gtin": "00196975997978",
117                "availability": null
118            }
119        ]
120    }
121}

Feedback

As this is a beta release for this actor and the underlying library, there might be some rough edges.

We’re always working on improving the performance of our Actors, so if you’ve got any technical feedback or simply found a bug, please create an issue on the Actor’s Issues tab in Apify Console.

🚀 Happy crawling 🚀