# Yahoo Auctions Scraper (`sigma-dev/yahoo-auctions-scraper`) Actor Scrape products from Yahoo Auctions Japan category and search URLs - prices, bids, end time, seller, category and images. - **URL**: https://apify.com/sigma-dev/yahoo-auctions-scraper.md - **Developed by:** [Sigma Dev](https://apify.com/sigma-dev) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $0.60 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Yahoo Auctions Scraper **Yahoo Auctions Scraper extracts product data from any [Yahoo Auctions Japan](https://auctions.yahoo.co.jp/) category or search results page.** Paste a URL, choose a page range, and get **structured data** for every listing - title, current price, buy-now price, number of bids, end time, seller, category, and images - exported to JSON, CSV, or Excel. Because it runs on the Apify platform, you also get **API access, scheduling, integrations, proxy rotation, and run monitoring** out of the box. ### What does Yahoo Auctions Scraper do? Give it a Yahoo Auctions URL - a category listing such as `auctions.yahoo.co.jp/category/list/...` or a search results page - exactly as it appears in your browser (including any price, condition, or shipping filters you applied). The Actor walks through the results pages you asked for and returns one clean record per auction. Choose whether you only need the **listing thumbnail** (fast) or the **full image gallery from every product page**. ### Why use Yahoo Auctions Scraper? - **Market & price research** - track current and buy-now prices across a category. - **Reselling & sourcing** - monitor new listings, bids, and end times for items you flip. - **Brand & catalog monitoring** - collect titles, conditions, and images at scale. - **Data analysis** - feed structured auction data into spreadsheets, BI tools, or your own database. ### How to use Yahoo Auctions Scraper 1. Open [Yahoo Auctions](https://auctions.yahoo.co.jp/) and browse to the category or search you want. Apply any filters (price range, condition, shipping, sort order). 2. Copy the URL from your browser's address bar and paste it into the **Start URL** field. 3. Set **Start page** and **End page** (leave both at `0` to scrape every page). 4. Pick **Images to collect** - thumbnail only, or all images per product. 5. Click **Start** and download your results from the **Output** tab. ### Input Configure the run in the **Input** tab. Fields: | Field | Description | Default | | --- | --- | --- | | **Start URL** (`startUrl`) | Yahoo Auctions category or search URL to scrape. | *example URL* | | **Collect more than 15,000 items** (`splitByPrice`) | Auto-splits the search into price bands to bypass Yahoo's 150-page cap (see below). When on, Start/End page are ignored — use **Max items** to bound the run. | `true` | | **Max items** (`maxItems`) | Upper limit on products scraped. `0` = no limit. **Strongly recommended** when price-splitting is on. | `0` | | **Images to collect** (`imageMode`) | `thumbnail` (listing thumbnail only) or `all` (full gallery from each product page). | `thumbnail` | | **Start page** (`startPage`) | First results page (page 1 = first page). `0` = start from the first page. *Only used when price-splitting is off.* | `0` | | **End page** (`endPage`) | Last results page. `0` = continue to the final available page (max 150). *Only used when price-splitting is off.* | `0` | | **Proxy configuration** (`proxyConfiguration`) | Proxy used for requests. Apify Proxy recommended. | Apify Proxy | #### How many items can I get? (Yahoo's 150-page limit) Yahoo Auctions only lets you page through **150 pages (~15,000 items) per search URL**, no matter how many results the category actually contains (some have millions). To collect more, keep **Collect more than 15,000 items** enabled: the scraper reads the result count and, whenever a search exceeds the cap, automatically subdivides it into narrower **price bands** — recursively, until every band fits — so it can harvest the whole category. Because large categories can hold hundreds of thousands of items, **always set Max items** to control run time and cost. With price-splitting **off**, the actor scrapes a single query (max ~15,000 items) and honors the Start/End page range: `start 0 + end 5` → pages 1-5 · `start 3 + end 0` → page 3 to the last page. Example input: ```json { "startUrl": "https://auctions.yahoo.co.jp/category/list/23000/?auccat=23000&price_type=currentprice&min=160000&n=100&b=1", "startPage": 0, "endPage": 5, "imageMode": "all", "maxItems": 0, "proxyConfiguration": { "useApifyProxy": true } } ```` ### Output Each product becomes one dataset item. You can download the dataset in various formats such as JSON, HTML, CSV, or Excel. Example item (in `all` image mode): ```json { "auctionId": "p1235594542", "title": "【中古】グッチ オールドグッチ バンブー ハンドバッグ ミディアム 2WAY ブラック 竹 Aランク", "url": "https://auctions.yahoo.co.jp/jp/auction/p1235594542", "thumbnail": "https://auc-pctr.c.yimg.jp/i/.../i-img1200x1200-...jpg?w=300&h=300", "images": [ "https://auctions.c.yimg.jp/images.auctions.yahoo.co.jp/image/.../i-img1200x1200-...jpg" ], "imageCount": 10, "currentPrice": 228800, "buyNowPrice": 228800, "startPrice": 228800, "bids": 0, "biddersNum": 0, "condition": "未使用に近い", "endTime": "2026-07-08T23:07:22+09:00", "shipping": "送料未定", "sellerName": "example_seller", "sellerId": "FS8Yz6ZzfjMBnysWJJ1pCZxftSQJW", "sellerRating": "100%", "sellerLocation": "東京都", "categoryPath": "オークション > ファッション > ブランド別 > グッチ", "brand": "GUCCI", "quantity": 1, "status": "open", "pageNumber": 1, "scrapedAt": "2026-07-02T09:00:00+00:00" } ``` #### Data table | Field | Description | | --- | --- | | `auctionId` | Yahoo auction ID. | | `title` | Product title. | | `marketplace` | `auction` (Yahoo Auctions) or `fleaMarket` (Yahoo!フリマ / PayPay Flea Market — these appear mixed into auction results). | | `url` | Link to the auction page. | | `thumbnail` | Listing thumbnail image URL. | | `images` | Full-resolution gallery image URLs (populated in `all` image mode). | | `imageCount` | Number of images collected. | | `currentPrice` | Current price (JPY). | | `buyNowPrice` | Buy-now / 即決 price (JPY), if offered. | | `startPrice` | Starting price (JPY). | | `bids` / `biddersNum` | Number of bids / bidders. | | `condition` | Item condition (`all` mode). | | `endTime` / `timeLeft` | Auction end time (ISO 8601, JST) / human-readable time remaining. | | `shipping` | Shipping/postage note. | | `sellerName` / `sellerId` / `sellerRating` / `sellerLocation` / `sellerUrl` | Seller details (`all` mode adds name, rating, and location). | | `categoryPath` / `categoryIdPath` / `brand` | Category breadcrumb and brand (`all` mode). | | `pageNumber` | Results page the item was found on. | | `scrapedAt` | Timestamp the record was scraped (UTC). | > Note: thumbnail mode returns the core fields available on the listing page. Seller name, condition, description, brand, readable category path, and the full image gallery come from each product page and are only populated in **all images** mode. Both Yahoo Auctions and Yahoo!フリマ (Flea Market) item pages are fully parsed. ### How much does it cost to scrape Yahoo Auctions? Cost depends on how many pages/products you scrape and the image mode. **Thumbnail mode** makes a single request per results page (~100 products each), so it is very cheap. **All images mode** makes one extra request per product, which increases compute and time proportionally. Set **Max items** or a narrow page range to cap cost while testing. New Apify accounts include monthly free platform credits to get started. ### Tips and advanced options - **Scrape faster / cheaper:** use `thumbnail` mode and a bounded page range when you don't need full galleries. - **Filter at the source:** apply price, condition, and sort filters on Yahoo Auctions before copying the URL - the Actor respects them. - **Items per page:** the Actor honors the `n` parameter in your URL (Yahoo's maximum is 100). - **Avoid blocks:** keep Apify Proxy enabled; for large runs, Residential proxies with country Japan are the most reliable. ### FAQ, disclaimers, and support **Is scraping Yahoo Auctions legal?** Scraping publicly available data is generally legal, but you are responsible for how you use the data and for complying with Yahoo Auctions' Terms of Service and applicable laws. Do not collect personal or private data. **The site layout changed and fields are missing.** Yahoo occasionally updates its markup. Please report issues via the **Issues** tab and they can be fixed. **Can I get custom fields or a tailored version?** Yes - open an issue describing what you need. # Actor input Schema ## `startUrl` (type: `string`): A Yahoo Auctions category or search results URL to scrape. Open the category/search on auctions.yahoo.co.jp, apply any filters you want, and paste the URL from your browser's address bar. ## `splitByPrice` (type: `boolean`): Yahoo Auctions only lets you page through 150 pages (~15,000 items) per URL, no matter how many results exist. When enabled, the scraper automatically subdivides the search into narrower price bands so it can collect the whole category (potentially hundreds of thousands of items). IMPORTANT: for large categories, always set a 'Max items' cap to control run time and cost. When enabled, the Start/End page settings are ignored. ## `maxItems` (type: `integer`): Maximum number of products to scrape. Use 0 for no limit. Strongly recommended when 'Collect more than 15,000 items' is enabled, since a full category can contain hundreds of thousands of items. ## `imageMode` (type: `string`): "Thumbnail image only" reads just the listing thumbnail and is fast (one request per results page). "All images from each product" opens every product page and collects its full image gallery (one extra request per product, so it is slower and uses more compute). ## `startPage` (type: `integer`): First results page to scrape (page 1 is the first page). Leave as 0 to start from the very first page. Only used when 'Collect more than 15,000 items' is turned OFF. ## `endPage` (type: `integer`): Last results page to scrape. Leave as 0 to keep scraping until the final available page (max 150 due to Yahoo's cap). Only used when 'Collect more than 15,000 items' is turned OFF. ## `proxyConfiguration` (type: `object`): Proxy settings used for requests. Apify Proxy is recommended to avoid rate-limiting by Yahoo Auctions. For best reliability with this Japanese site you can select Residential proxies with country Japan. ## Actor input object example ```json { "startUrl": "https://auctions.yahoo.co.jp/category/list/23000/?min=160000&max=&price_type=currentprice&auccat=23000&fixed=3&is_postage_mode=1&dest_pref_code=13&b=1&n=100&s1=new&o1=d", "splitByPrice": true, "maxItems": 0, "imageMode": "thumbnail", "startPage": 0, "endPage": 0, "proxyConfiguration": { "useApifyProxy": true } } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrl": "https://auctions.yahoo.co.jp/category/list/23000/?min=160000&max=&price_type=currentprice&auccat=23000&fixed=3&is_postage_mode=1&dest_pref_code=13&b=1&n=100&s1=new&o1=d", "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("sigma-dev/yahoo-auctions-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrl": "https://auctions.yahoo.co.jp/category/list/23000/?min=160000&max=&price_type=currentprice&auccat=23000&fixed=3&is_postage_mode=1&dest_pref_code=13&b=1&n=100&s1=new&o1=d", "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("sigma-dev/yahoo-auctions-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrl": "https://auctions.yahoo.co.jp/category/list/23000/?min=160000&max=&price_type=currentprice&auccat=23000&fixed=3&is_postage_mode=1&dest_pref_code=13&b=1&n=100&s1=new&o1=d", "proxyConfiguration": { "useApifyProxy": true } }' | apify call sigma-dev/yahoo-auctions-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=sigma-dev/yahoo-auctions-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Yahoo Auctions Scraper", "description": "Scrape products from Yahoo Auctions Japan category and search URLs - prices, bids, end time, seller, category and images.", "version": "0.1", "x-build-id": "4FXQKHvgdthahUC9H" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/sigma-dev~yahoo-auctions-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-sigma-dev-yahoo-auctions-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/sigma-dev~yahoo-auctions-scraper/runs": { "post": { "operationId": "runs-sync-sigma-dev-yahoo-auctions-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/sigma-dev~yahoo-auctions-scraper/run-sync": { "post": { "operationId": "run-sync-sigma-dev-yahoo-auctions-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrl" ], "properties": { "startUrl": { "title": "Start URL", "type": "string", "description": "A Yahoo Auctions category or search results URL to scrape. Open the category/search on auctions.yahoo.co.jp, apply any filters you want, and paste the URL from your browser's address bar.", "default": "https://auctions.yahoo.co.jp/category/list/23000/?min=160000&max=&price_type=currentprice&auccat=23000&fixed=3&is_postage_mode=1&dest_pref_code=13&b=1&n=100&s1=new&o1=d" }, "splitByPrice": { "title": "Collect more than 15,000 items (auto price-band splitting)", "type": "boolean", "description": "Yahoo Auctions only lets you page through 150 pages (~15,000 items) per URL, no matter how many results exist. When enabled, the scraper automatically subdivides the search into narrower price bands so it can collect the whole category (potentially hundreds of thousands of items). IMPORTANT: for large categories, always set a 'Max items' cap to control run time and cost. When enabled, the Start/End page settings are ignored.", "default": true }, "maxItems": { "title": "Max items", "minimum": 0, "type": "integer", "description": "Maximum number of products to scrape. Use 0 for no limit. Strongly recommended when 'Collect more than 15,000 items' is enabled, since a full category can contain hundreds of thousands of items.", "default": 0 }, "imageMode": { "title": "Images to collect", "enum": [ "thumbnail", "all" ], "type": "string", "description": "\"Thumbnail image only\" reads just the listing thumbnail and is fast (one request per results page). \"All images from each product\" opens every product page and collects its full image gallery (one extra request per product, so it is slower and uses more compute).", "default": "thumbnail" }, "startPage": { "title": "Start page", "minimum": 0, "type": "integer", "description": "First results page to scrape (page 1 is the first page). Leave as 0 to start from the very first page. Only used when 'Collect more than 15,000 items' is turned OFF.", "default": 0 }, "endPage": { "title": "End page", "minimum": 0, "type": "integer", "description": "Last results page to scrape. Leave as 0 to keep scraping until the final available page (max 150 due to Yahoo's cap). Only used when 'Collect more than 15,000 items' is turned OFF.", "default": 0 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Proxy settings used for requests. Apify Proxy is recommended to avoid rate-limiting by Yahoo Auctions. For best reliability with this Japanese site you can select Residential proxies with country Japan.", "default": { "useApifyProxy": true } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```