Dotti Australia Product Scraper

This Apify Actor allows you to scrape product data, categories, and detailed item information from Dotti Australia for price monitoring, product research, market research, availability tracking, and competitive analysis.

Features

• Product Search: Search for products using keywords and sort options.
• Category Scraping: List products within a specific category.
• Detailed Item Info: Get full specifications, pricing, and availability for a single product.
• Category Tree: Explore the Dotti category hierarchy.
• Search Filters: Discover available filters and sort options for a category.
• Multi-Method HTTP Fallback: Automatically tries multiple HTTP clients (httpx, cloudscraper, tls_client, curl_cffi) for maximum success rate.
• Proxy Support: Integrated Apify proxy support with country filtering.
• Retry Logic: Automatic retry with exponential backoff for blocked requests.
• Standardized Infrastructure: Built on shared apify-wave1 runtime for consistency across actors.

Operation Guide

1. Product Search

Provide a Search Query (e.g., "dress") to get a list of matching products. You can refine results using Sort.

2. Category Scraping

Provide a URL (e.g., https://dotti.jgl.com.au/shop/do-womens-new-all) or Category ID to fetch all products in that category.

3. Item Details

Provide a URL, Slug, or Item ID to get exhaustive details for a single item.

4. Category List

Use the categories operation to get a list of all categories from the homepage. Use Refresh Categories to force reload.

5. Search Filters

Provide a Category URL to discover available filters and sort options for that category.

Examples

You can copy and paste these JSON inputs into the Apify Actor's "JSON" editor for quick testing.

Search for "Dress"

Returns a list of dress products sorted by relevance.

{
  "operation": "search",
  "query": "dress",
  "limit": 10,
  "sort": "recommended"
}

Search for Jeans with Price Sort

Returns jeans products sorted by price.

{
  "operation": "search",
  "query": "jeans",
  "sort": "price_asc",
  "limit": 20
}

Fetch Category Products

Gets products from a specific category.

{
  "operation": "category",
  "url": "https://dotti.jgl.com.au/shop/do-womens-new-all",
  "limit": 20,
  "sort": "new"
}

Fetch Specific Product Details

Gets full specifications for a product using its URL.

{
  "operation": "item",
  "url": "https://dotti.jgl.com.au/shop/do-womens-new-all/do-womens-dress-12345"
}

List All Categories

Returns the main category structure of the site.

{
  "operation": "categories",
  "limit": 100
}

Get Category Filters

Returns available filters for a category.

{
  "operation": "search_filters",
  "categoryUrl": "/shop/do-womens-new-all"
}

Input Fields

Field	Required	Description	Example
operation	Required	Operation to perform: search, category, item, categories, or search_filters	search
query	Optional	Text search query	dress
url	Optional	Full category or product URL	https://dotti.jgl.com.au/shop/do-womens-new-all
slug	Optional	Product slug	do-womens-dress-12345
categoryId	Optional	Category ID	461559
itemId	Optional	Item ID or SKU	12345
parentId	Optional	Parent category ID	461558
categoryUrl	Optional	Category URL for filters	/shop/do-womens-new-all
limit	Optional	Max items to return	48
page	Optional	Page number	1
sort	Optional	Sort order (recommended, new, price_asc, price_desc)	price_asc
details	Optional	Include richer normalized fields	false
refresh	Optional	Refresh category cache from homepage	false
proxy	Optional	Proxy mode (direct, apify, custom, auto)	auto
customProxyUrl	Optional	Custom proxy URL	http://proxy.example.com:8080
proxyCountry	Optional	Proxy country code	AU

Output Fields

Each product item includes:

• id: Product ID.
• slug: Product slug.
• name: Product name.
• brand: Brand name.
• price: Current price.
• discount_price: Discounted price.
• currency: Currency (AUD).
• source_url: URL to product page.
• image: Main product image.
• images: List of all product images.
• in_stock: Stock availability boolean.
• stock_status: Stock status text.
• description: Full product description.
• short_description: Short product description.
• attributes: Detailed specifications (color, size, features, etc.).
• breadcrumbs: Category hierarchy.
• variants: Product variants with size/color options.
• price_info: Price information array.

Proxy & Bot Protection

Dotti uses light bot protection. Direct mode usually works, but for high-volume scraping or if you encounter blocks, use:

• Auto: Automatically handles proxy selection (recommended).
• Direct: Bypasses proxy (usually sufficient).
• Custom: Uses a provided custom proxy URL.
• Apify: Uses Apify's proxy infrastructure.

The actor includes automatic retry logic with exponential backoff for blocked requests (403, 429, 502, 503) and invalid JSON responses.

Pricing

• Actor Start: $0.005 per run
• Dataset Item: $0.0004 per item

Free/trial users are limited to 10 result requests per day.

Limitations

• This scraper is unofficial and not affiliated with Dotti.
• Dotti may change their API or HTML structure without notice.
• Some products may have incomplete data depending on source availability.
• Category URLs may change over time; use the categories endpoint to discover current URLs.
• High-volume scraping may trigger rate limiting or blocking.

Disclaimer

This scraper is unofficial and not affiliated with Dotti. Users are responsible for complying with Dotti's terms of service and applicable laws.