Urban Industry Scraper

  • mshopik/urban-industry-scraper
  • Modified
  • Users 2
  • Runs 667
  • Created by Author's avatarMark Carter

Scrape Urban Industry and extract data on casual apparel from urbanindustry.co.uk. Our Urban Industry API lets you crawl product information and pricing. The saved data can be downloaded as HTML, JSON, CSV, Excel, and XML.

Max items

maxRequestsPerCrawl

Optional

integer

How many items to extract from urbanindustry.co.uk

Extend Output Function

extendOutputFunction

Optional

string

Add or remove properties on the output object or omit the output returning null

Extend Scraper Function

extendScraperFunction

Optional

string

Advanced function that allows you to extend the default scraper functionality, allowing you to manually perform actions on the page

Custom data

customData

Optional

object

Any data that you want to have available inside the Extend Output/Scraper Function

Fetch HTML

fetchHtml

Optional

boolean

If you decide to fetch the HTML of the pages, it will take twice as long. Make sure to only enable this if needed

Max concurrency

maxConcurrency

Optional

integer

Max concurrency to use

Max request retries

maxRequestRetries

Optional

integer

Set the max request retries

Debug Log

debugLog

Optional

boolean

Enable a more verbose logging to be able to understand what's happening during the scraping