ShopGoodwill Product Search Scraper: Extract Auction Listings at Scale

---

What Is ShopGoodwill.com?

ShopGoodwill.com is Goodwill Industries' online auction platform, offering thousands of thrift and donated items across diverse categories — from jewelry and electronics to furniture and collectibles. Each listing includes dynamic auction data (current bids, time remaining, starting prices) that updates in real-time. Manually tracking product availability, pricing trends, and competitive landscape is inefficient; the ShopGoodwill Product Search Scraper automates data collection, delivering structured inventory records for analysis, resale, or market intelligence.

---

Overview

The ShopGoodwill Product Search Scraper extracts product listings from ShopGoodwill.com category search pages, converting auction item data into clean, machine-readable records. It is ideal for:

• Resellers & dropshippers identifying profitable items and monitoring inventory
• Price researchers tracking auction trends and competitive pricing
• Market analysts studying secondhand goods valuations
• Data aggregators building product databases for comparison platforms
• Business intelligence teams monitoring Goodwill inventory patterns

Key strengths include support for paginated search results, configurable item limits, robust error handling via ignore_url_failures, and comprehensive auction metadata including bid history and shipping costs.

---

Input Format

The scraper accepts a JSON configuration with three core parameters:

{
  "urls": [
    "https://shopgoodwill.com/categories/jewelry-gemstones?p=2"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Parameter	Type	Description
urls	Array	Direct links to ShopGoodwill product search pages (e.g., category filtered results with pagination)
max_items_per_url	Integer	Maximum number of products to extract per URL (e.g., 200)
ignore_url_failures	Boolean	If true, scraper continues even if individual URLs fail; if false, halts on first error

URL Examples:

• https://shopgoodwill.com/categories/jewelry-gemstones?p=1 (first page, jewelry category)
• https://shopgoodwill.com/categories/electronics?p=3 (third page, electronics)

Tip: Use pagination parameters (?p=1, ?p=2) to scrape multiple pages of the same category sequentially.

---

Output Format

Sample output

{
  "item_id": 267760293,
  "category_id": 86,
  "category_name": "Necklaces",
  "title": "Vintage Tribal Silver-Tone Pendant Necklace with Colored Glass Inlays & Bells",
  "description": null,
  "current_price": 16.0,
  "num_bids": 2,
  "minimum_bid": 14.99,
  "start_time": "2026-06-17T21:51:17.05",
  "end_time": "2026-06-22T21:45:00",
  "buy_now_price": 24.99,
  "image_url": "https://shopgoodwillimages.azureedge.net/production/8\\Item\\2026-06-17\\d2db9a24-c76f-4037-841b-a1b42cb1012bnger_0617t1.jpeg",
  "gallery_url": "",
  "shipping_price": 4.99,
  "relist_id": 0,
  "image_status": 0,
  "image_purged": false,
  "itemfeatured": false,
  "itemgallery": false,
  "item_count": 63458,
  "views": 0,
  "is_stock": false,
  "discount": 0.0,
  "is_favorite": false,
  "remaining_time": "17m 47s ",
  "featured": false,
  "starting_price": 14.99,
  "gallery": false,
  "discounted_buy_now_price": 24.99,
  "part_number": "",
  "cat_parent_list": null,
  "seller_id": 8,
  "item_quantity": 1,
  "cat_full_name": "Jewelry & Gemstones > Necklaces",
  "cat_level_num": 2,
  "listing_type": 2,
  "from_url": "https://shopgoodwill.com/categories/jewelry-gemstones?p=2"
}

Each scraped product returns a rich record with 34 fields capturing auction state, pricing, and inventory details:

Item Identification & Categorization

Field	Meaning
Item ID	Unique identifier for the product listing
Category ID	Numeric ID of the primary category
Category Name	Human-readable category name (e.g., "Jewelry & Gemstones")
Category Full Name	Full hierarchical category path
Category Parent List	Parent categories in the hierarchy
Category Level Number	Depth of category nesting
Title	Product name/auction title as displayed
Description	Full item description provided by seller
Part Number	Manufacturer part number (if applicable)
Seller ID	Identifier of the ShopGoodwill seller account

Pricing & Bidding

Field	Meaning
Starting Price	Initial asking price when auction began
Current Price	Current bid/active price (updates in real-time during auction)
Minimum Bid	Minimum acceptable bid amount
Buy Now Price	Immediate purchase price (if "Buy It Now" is available)
Discounted Buy Now Price	Reduced "Buy It Now" price (if applicable)
Shipping Price	Cost to ship the item
Discount	Any active discount percentage or amount
Number of Bids	Total bids placed on the item

Auction Timeline

Field	Meaning
Start Time	Timestamp when auction began
End Time	Timestamp when auction closes
Remaining Time	Time left in auction (calculated from current time to End Time)

Inventory & Stock

Field	Meaning
Item Quantity	Number of units available
Item Count	Total items in the lot (for multi-item auctions)
In Stock	Boolean flag indicating availability
Relist ID	ID if item is a relisted auction

Media & Display

Field	Meaning
Image URL	Primary product image URL
Image Status	Status of the primary image (e.g., active, pending)
Image Purged	Flag indicating if image was removed
Gallery URL	URL to full image gallery
Gallery	Additional gallery metadata

Listing Features & Metrics

Field	Meaning
Item Featured	Flag indicating premium/featured placement
Featured	Whether the listing has highlight status
Item Gallery	Whether item has multiple gallery images
Is Favorite	User favorite/watchlist status
Views	Number of times the listing was viewed
Listing Type	Type of sale format (auction, fixed price, etc.)

---

How to Use

1. Navigate ShopGoodwill — Go to shopgoodwill.com and filter by category (e.g., Jewelry, Electronics, Furniture).
2. Copy search URLs — Grab the category page URL, including pagination (?p=1, ?p=2, etc.). You can add multiple URLs.
3. Set parameters —
   • Adjust max_items_per_url based on your needs (20–200 is typical)
   • Set ignore_url_failures: true for robust batch runs
4. Run the scraper — Start the actor and monitor progress in the run logs.
5. Export & analyze — Download results as JSON, CSV, or Excel for integration with your tools.

Best practices:

• Start with a low max_items_per_url (e.g., 50) to test, then scale up
• Use category-specific URLs to target product types relevant to your analysis
• Re-run periodically to capture new listings and price updates
• Filter results by In Stock: true or Current Price thresholds in post-processing

---

Use Cases & Business Value

• Retail reselling: Identify underpriced items, trending categories, and profitable lot buys
• Price intelligence: Track how similar items appreciate or depreciate over auction cycles
• Inventory monitoring: Alert on new stock arrivals in your category of interest
• Competitive analysis: Benchmark your offerings against ShopGoodwill listings
• Academic research: Analyze consumer behavior, secondhand market valuation, or donation patterns

Automating ShopGoodwill scraping transforms hours of manual browsing into actionable datasets that feed pricing models, inventory systems, or business dashboards.

---

Conclusion

The ShopGoodwill Product Search Scraper unlocks fast, reliable access to thousands of auction listings with comprehensive metadata. Whether you're a reseller scaling sourcing operations, a researcher studying thrift markets, or an analyst tracking pricing trends, this scraper delivers the structured data you need. Configure your search URLs, set your item limits, and start extracting auction intelligence today.