{
 "title": "darn-tough-scraper",
 "description": "",
 "type": "object",
 "schemaVersion": 1,
 "properties": {
 "maxRequestsPerCrawl": {
 "title": "Max items",
 "description": "How many items to extract from darntough.com",
 "default": 20,
 "prefill": 20,
 "type": "integer",
 "editor": "number"
 },
 "extendOutputFunction": {
 "title": "Extend Output Function",
 "description": "Add or remove properties on the output object or omit the output returning null",
 "type": "string",
 "default": "async ({ data, item, product, images, fns, name, request, variants, context, customData, input, Apify }) => {\n return item;\n}",
 "prefill": "async ({ data, item, product, images, fns, name, request, variants, context, customData, input, Apify }) => {\n return item;\n}",
 "editor": "javascript",
 "sectionCaption": "Extend scraper functionality",
 "sectionDescription": "You can change the output of the items for your dataset here, or add additional behavior on the scraper."
 },
 "extendScraperFunction": {
 "title": "Extend Scraper Function",
 "description": "Advanced function that allows you to extend the default scraper functionality, allowing you to manually perform actions on the page",
 "type": "string",
 "default": "async ({ fns, customData, Apify, label }) => {\n \n}",
 "prefill": "async ({ fns, customData, Apify, label }) => {\n \n}",
 "editor": "javascript"
 },
 "customData": {
 "title": "Custom data",
 "description": "Any data that you want to have available inside the Extend Output/Scraper Function",
 "default": {},
 "prefill": {},
 "type": "object",
 "editor": "json"
 },
 "fetchHtml": {
 "title": "Fetch HTML",
 "description": "If you decide to fetch the HTML of the pages, it will take twice as long. Make sure to only enable this if needed",
 "default": true,
 "editor": "checkbox",
 "type": "boolean"
 },
 "maxConcurrency": {
 "title": "Max concurrency",
 "description": "Max concurrency to use",
 "default": 20,
 "prefill": 20,
 "type": "integer",
 "editor": "number"
 },
 "maxRequestRetries": {
 "title": "Max request retries",
 "description": "Set the max request retries",
 "default": 3,
 "prefill": 3,
 "type": "integer",
 "editor": "number"
 },
 "debugLog": {
 "title": "Debug Log",
 "description": "Enable a more verbose logging to be able to understand what's happening during the scraping",
 "type": "boolean",
 "default": false,
 "editor": "checkbox"
 }
 }
}

INPUT_SCHEMA.json

## What does Darn Tough Scraper do?

This scraper creates an API for Darn Tough to enable you to extract product information and pricing from the [darntough.com](https://darntough.com) online store. 

The Darn Tough API is free to use and will let you scrape and extract e-commerce data as often as you need to. The data you extract can be downloaded in structured format so that you can use it in your own applications, spreadsheets, reports, or tools.

Scraping Darn Tough could help you identify competition, opportunities, potential leads, and useful contacts. The right data can help you with product tracking, market research, and price monitoring in the footwear category.

If you need more inspiration, check out [how scraping can help you](https://apify.com/industries/ecommerce-and-retail) get an edge over the competition and stay ahead in e-commerce.

## How much will it cost to scrape Darn Tough?

Running Darn Tough Scraper will consume platform credits. Platform credits are counted in USD and each plan includes a set amount. Check our [platform pricing](https://apify.com/pricing/actors) page for details.

The exact number of platform credits consumed will depend on the actor input settings, the type of job it performs, how often it runs, and for how long.

The best way to find out how many platform credits an actor will consume is to perform a test run. You can then review platform usage in [Billing](https://console.apify.com/billing) and figure out the best Apify subscription plan for your needs.

## How to scrape Darn Tough

[darntough.com](https://darntough.com) is built using Shopify and Darn Tough Scraper is one of our huge range of online e-commerce scrapers designed to create a universal Shopify API.

Check out our [quick start guide](https://docs.apify.com/tutorials/quick-start) to using any Apify scraper or feel free to send an email to [support@apify.com](mailto:support@apify.com) if you have any questions.

You can also watch our [video about scraping Amazon](https://www.youtube.com/watch?v=BsidLZKdYWQ) to understand more about scraping e-commerce data and how it can help your business succeed.

For more ideas, read about our [top 5 web scraping tools to help you gather retail analytics](https://blog.apify.com/top-5-web-scraping-tools-gather-retail-analytics/).

README.md

import Apify from 'apify';

Apify.main(async () => {
 const input = await Apify.getInput();

 await Apify.metamorph('pocesar/shopify-scraper', {
 ...input,
 startUrls: [{
 url: 'http://www.darntough.com',
 }],
 });
});

main.js

{
 "name": "darn-tough-scraper",
 "version": "0.0.1",
 "type": "module",
 "dependencies": {
 "apify": "^2.3.2"
 },
 "scripts": {
 "start": "node main.js"
 }
}

package.json

# First, specify the base Docker image. You can read more about
# the available images at https://sdk.apify.com/docs/guides/docker-images
# You can also use any other image from Docker Hub.
FROM apify/actor-node:16

# Second, copy just package.json and package-lock.json since those are the only
# files that affect "npm install" in the next step, to speed up the build.
COPY package*.json ./

RUN npm --quiet set progress=false \
 &amp;&amp; npm install --only=prod --no-optional \
 &amp;&amp; echo "Installed NPM packages:" \
 &amp;&amp; (npm list --only=prod --no-optional --all || true) \
 &amp;&amp; echo "Node.js version:" \
 &amp;&amp; node --version \
 &amp;&amp; echo "NPM version:" \
 &amp;&amp; npm --version

COPY . ./

ENV APIFY_DISABLE_OUTDATED_WARNING 1
ENV npm_config_loglevel=silent

Dockerfile

Any data that you want to have available inside the Extend Output/Scraper Function

Custom data

Enable a more verbose logging to be able to understand what's happening during the scraping

Debug Log

Add or remove properties on the output object or omit the output returning null

You can change the output of the items for your dataset here, or add additional behavior on the scraper.

Extend Output Function

Advanced function that allows you to extend the default scraper functionality, allowing you to manually perform actions on the page

Extend Scraper Function

If you decide to fetch the HTML of the pages, it will take twice as long. Make sure to only enable this if needed

Fetch HTML

Max concurrency

Max request retries

How many items to extract from darntough.com

Max items

darn-tough-scraper

## What does Darn Tough Scraper do?

This scraper creates an API for Darn Tough to enable you to extract product information and pricing from the [darntough.com](https://darntough.com) online store. 

The Darn Tough API is free to use and will let you scrape and extract e-commerce data as often as you need to. The data you extract can be downloaded in structured format so that you can use it in your own applications, spreadsheets, reports, or tools.

Scraping Darn Tough could help you identify competition, opportunities, potential leads, and useful contacts. The right data can help you with product tracking, market research, and price monitoring in the footwear category.

If you need more inspiration, check out [how scraping can help you](https://apify.com/industries/ecommerce-and-retail) get an edge over the competition and stay ahead in e-commerce.

## How much will it cost to scrape Darn Tough?

Running Darn Tough Scraper will consume platform credits. Platform credits are counted in USD and each plan includes a set amount. Check our [platform pricing](https://apify.com/pricing/actors) page for details.

The exact number of platform credits consumed will depend on the actor input settings, the type of job it performs, how often it runs, and for how long.

The best way to find out how many platform credits an actor will consume is to perform a test run. You can then review platform usage in [Billing](https://console.apify.com/billing) and figure out the best Apify subscription plan for your needs.

## How to scrape Darn Tough

[darntough.com](https://darntough.com) is built using Shopify and Darn Tough Scraper is one of our huge range of online e-commerce scrapers designed to create a universal Shopify API.

Check out our [quick start guide](https://docs.apify.com/tutorials/quick-start) to using any Apify scraper or feel free to send an email to [support@apify.com](mailto:support@apify.com) if you have any questions.

You can also watch our [video about scraping Amazon](https://www.youtube.com/watch?v=BsidLZKdYWQ) to understand more about scraping e-commerce data and how it can help your business succeed.

For more ideas, read about our [top 5 web scraping tools to help you gather retail analytics](https://blog.apify.com/top-5-web-scraping-tools-gather-retail-analytics/).

import Apify from 'apify';

Apify.main(async () => {
    const input = await Apify.getInput();

    await Apify.metamorph('pocesar/shopify-scraper', {
        ...input,
        startUrls: [{
            url: 'http://www.darntough.com',
        }],
    });
});

# First, specify the base Docker image. You can read more about
# the available images at https://sdk.apify.com/docs/guides/docker-images
# You can also use any other image from Docker Hub.
FROM apify/actor-node:16

# Second, copy just package.json and package-lock.json since those are the only
# files that affect "npm install" in the next step, to speed up the build.
COPY package*.json ./

RUN npm --quiet set progress=false \
 && npm install --only=prod --no-optional \
 && echo "Installed NPM packages:" \
 && (npm list --only=prod --no-optional --all || true) \
 && echo "Node.js version:" \
 && node --version \
 && echo "NPM version:" \
 && npm --version

COPY . ./

ENV APIFY_DISABLE_OUTDATED_WARNING 1
ENV npm_config_loglevel=silent



Scrape Darn Tough and extract data on footwear from darntough.com. Our Darn Tough API lets you crawl product information and pricing. The saved data can be downloaded as HTML, JSON, CSV, Excel, and XML.

Darn Tough Scraper

Darn Tough Scraper · Apify

API · Darn Tough Scraper · Apify

Input · Darn Tough Scraper · Apify

Source code · Darn Tough Scraper · Apify

Related actors · Darn Tough Scraper · Apify

Scrape Darn Tough and extract data on footwear from darntough.com. Our Darn Tough API lets you crawl product information and pricing. The saved data can be downloaded as HTML, JSON, CSV, Excel, and...