Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

Hibid.com Scraper: Extract Auction Data & Pricing Intelligence

Unlocking the Power of HiBid.com Auction Data

HiBid.com stands as the leading online auction platform where users can sell, search, bid, and win on antiques, collectibles, coins, estate & personal property, cars & trucks, toys and more. With over 800,000 lots live for bidding and nearly 95,000 lots sold weekly, the platform represents a goldmine of market intelligence for businesses, researchers, and auction professionals.

The challenge many face is manually tracking thousands of auction listings across multiple categories and time periods. This is where automated data extraction becomes invaluable. Our HiBid.com Auction Listings Scraper addresses this critical need by providing systematic, scalable access to auction data that can transform how you analyze market trends, track competitor pricing, and identify profitable opportunities.

Whether you're an auction house studying market dynamics, a reseller researching product values, or a data analyst building pricing models, extracting structured data from HiBid.com enables evidence-based decision making at scale.

Comprehensive HiBid.com Scraping Solution

The HiBid.com Auction Listings Scraper is designed to extract detailed auction information from specific product categories and search results pages. This tool excels at capturing the rich dataset that HiBid.com provides, including current bid amounts, auction timelines, product descriptions, and seller information.

Key Advantages:

• Multi-category Support: Extract data from electronics, collectibles, vehicles, real estate, and more
• Scalable Processing: Handle multiple URLs simultaneously with configurable item limits
• Proxy Integration: Built-in residential proxy support to ensure reliable, undetected scraping
• Structured Output: Organized data in consistent JSON format for easy integration
• Retry Mechanisms: Automatic retry logic to handle temporary network issues

Target Users:

• Market research professionals analyzing auction trends
• E-commerce businesses tracking competitor pricing
• Investment firms evaluating collectible markets
• Academic researchers studying online auction behavior
• Individual collectors monitoring specific item categories

Input and Output Details

Example url 1: https://hibid.com/lots/40213/computers-and-electronics/consumer-electronics/home-audio/speakers?apage=2

Example url 2: https://hibid.com/lots/40303/computers-and-electronics/cameras-and-camera-accessories/cameras

Example url 3: https://hibid.com/lots/40199/computers-and-electronics/computers/laptops

Example Screenshot of product information page:

Input Format

The scraper accepts configuration through a JSON object with several key parameters:

Scrape with URLs:

{
  "max_retries_per_url": 2, // Maximum number of retry attempts for each URL
  "proxy": { // Proxy configuration to avoid bot detection
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "US" // Choose a country that matches your target data location
  },
  "max_items_per_url": 20, // Total number of items you want to scrape
  "urls": [ // Auction lot list page URLs to scrape
    "https://hibid.com/lots/40213/computers-and-electronics/consumer-electronics/home-audio/speakers?apage=2",
    "https://hibid.com/lots/40303/computers-and-electronics/cameras-and-camera-accessories/cameras",
    "https://hibid.com/lots/40199/computers-and-electronics/computers/laptops"
  ],
  "ignore_url_failures": true // Continue scraping even if some URLs fail
}

The urls parameter: List of auction lot list page URLs that you want to scrape. You can add URLs one by one, or use the Bulk edit section to add a prepared list.

The ignore_url_failures parameter: If set to true, the scraper will continue running even if some URLs fail to be scraped after reaching the maximum number of retries. This ensures that one problematic URL doesn't stop your entire scraping job.

When you provide a list of URLs for scraping, all options in the "Scrape with search filters" section will be disabled. The system will only collect data from the URLs you specified.

Scrape with Search Filters:

{
  "max_retries_per_url": 2, // Maximum number of retry attempts for each search filter
  "proxy": { // Proxy configuration to avoid bot detection
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "US" // Choose a country that matches your target data location
  },
  "max_items_per_url": 20, // Total number of items you want to scrape
  "keyword": "laptop", // Search keyword to find auction lots
  "zip_code": "10001", // Zip code for location-based search
  "distance": "100", // Distance range from zip code in miles
  "lot_type": "ONLINE", // Filter by lot type
  "auction_status": "OPEN", // Filter by auction status
  "sort_by": "TIME_LEFT", // Sort lots by specific criteria
  "page": 1 // Starting page number for search results
}

The keyword parameter: The search keyword to find auction lots (e.g., "laptop", "furniture", "jewelry", "tools").

The zip_code parameter: Enter zip code for location-based search to find auctions near a specific area.

The distance parameter: Filter auction lots by distance range from the specified zip code:

• "-1" - Any where (no distance limit)
• "25" - 25 Miles
• "50" - 50 Miles
• "100" - 100 Miles
• "250" - 250 Miles
• "500" - 500 Miles

The lot_type parameter: Filter auction lots by lot type:

• "ALL" - All lot types
• "BIDDABLE" - Biddable Lots
• "WEBCAST" - Live Webcast Lots
• "ONLINE" - Online Only Lots
• "ABSENTEE" - Absentee Lots
• "LISTING" - Listing Only Lots

The auction_status parameter: Filter auction lots by auction status:

• "ALL" - All statuses
• "CLOSING" - Closing Soon
• "FEATURED" - Featured auctions
• "TOP" - Top Picks
• "HOT" - Hot auctions
• "OPEN" - Open auctions
• "CLOSED" - Closed auctions

The sort_by parameter: Sort auction lots by various criteria:

• "" - Best Match (default relevance)
• "TIME_LEFT" - Time remaining (ending soonest first)
• "BID_AMOUNT_HIGH_TO_LOW" - Bid amount (high to low)
• "BID_AMOUNT_LOW_TO_HIGH" - Bid amount (low to high)
• "DISTANCE_NEAREST" - Distance (nearest first)

The page parameter: Starting page number for scraping, useful for continuing interrupted scrapes or targeting specific result ranges.

When using search filters for scraping, you need to leave the urls field empty (or set it to null) in the "Scrape with URLs" configuration.

General Options:

The max_items_per_url parameter: Limits the number of auction lots extracted from each lot list page or search results page. The default value is 20, providing a manageable batch size while allowing for comprehensive data collection.

The max_retries_per_url parameter: Sets the maximum number of retry attempts for each URL or search filters if the scrape is detected as a bot or the page fails to load. The default value is 2, providing a good balance between thoroughness and efficiency.

The proxy parameter: Proxy configuration is essential for maintaining anonymity and avoiding detection. The residential proxy option ensures that your scraping activities appear as legitimate browsing, reducing the risk of being blocked or rate-limited. You should choose a country that matches the location of the website you're scraping (e.g., US for hibid.com).

Output Format

You get the output from the Hibid.com Auction Listings Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of Auction information
  {
  "auction": {
    "__typename": "Auction",
    "id": 671543,
    "alt_bidding_url": null,
    "alt_bidding_url_caption": "",
    "amex_accepted": true,
    "discover_accepted": true,
    "mastercard_accepted": true,
    "visa_accepted": true,
    "reg_type": "CREDIT_CARD_EVERY_TIME",
    "hold_amount": 0,
    "auctioneer": {
      "__ref": "Auctioneer:83443"
    },
    "auction_options": {
      "__typename": "AuctionOptionsType",
      "bidding": true,
      "alt_bidding": false,
      "catalog": true,
      "live_catalog": true,
      "shipping_type": "SHIPPING_OFFERED_ALL",
      "preview": false,
      "registration": true,
      "webcast": false,
      "use_lot_number": true,
      "use_sale_order": false
    },
    "auction_state": {
      "__typename": "AuctionStateType",
      "auction_status": "OPEN_ABSENTEE",
      "bid_card_number": 0,
      "is_registered": false,
      "open_lot_count": 360,
      "time_to_open": ""
    },
    "bid_amount_type": "MAX_BIDDING",
    "bid_increments": [
      {
        "__typename": "BidIncrementType",
        "min_bid_increment": 1,
        "up_to_amount": 250
      },
      {
        "__typename": "BidIncrementType",
        "min_bid_increment": 5,
        "up_to_amount": 975
      },
      {
        "__typename": "BidIncrementType",
        "min_bid_increment": 50,
        "up_to_amount": 9750
      },
      {
        "__typename": "BidIncrementType",
        "min_bid_increment": 2500,
        "up_to_amount": 97500
      },
      {
        "__typename": "BidIncrementType",
        "min_bid_increment": 10000,
        "up_to_amount": 9999999.99
      }
    ],
    "bid_open_date_time": "2025-08-24T00:55:00",
    "bid_close_date_time": "2025-08-29T07:30:00",
    "bid_type": "INTERNET_ONLY",
    "buyer_premium": "20",
    "buyer_premium_rate": 1,
    "checkout_date_info": "Pick up  Noon to 2 on Aug 31",
    "preview_date_info": "217-306-5478",
    "currency_abbreviation": "USD",
    "description": "highend  overstock estate from Loami estate form St Louis",
    "event_address": "8110 Flitz trail",
    "event_city": "Litchfield",
    "event_date_begin": "2025-08-23T00:00:00",
    "event_date_end": "2025-08-29T00:00:00",
    "event_date_info": "Aug 23  Begins\r\nEnds August 30 730 PM",
    "event_name": "Flitz trail #24 Litchfield Il",
    "event_state": "IL",
    "event_zip": "62056",
    "featured_picture": {
      "__typename": "Picture",
      "description": "Flitz trail #24 Litchfield Il",
      "full_size_location": "https://cdn.hibid.com/img.axd?id=8195278667&wid=&rwl=false&p=&ext=&w=0&h=0&t=&lp=&c=true&wt=false&sz=MAX&checksum=cVq%2bH45PyrT0QuZ%2f7Yf98u8meLYX9NKn",
      "height": 0,
      "hd_thumbnail_location": "",
      "thumbnail_location": "https://cdn.hibid.com/img.axd?id=8195278667&wid=&rwl=false&p=&ext=&w=0&h=0&t=&lp=&c=true&wt=false&sz=MAX&checksum=cVq%2bH45PyrT0QuZ%2f7Yf98u8meLYX9NKn&h=200&w=200",
      "width": 0
    },
    "links": [],
    "lot_count": 360,
    "show_buyer_premium": false,
    "audio_video_chat_info": {
      "__typename": "AuctionAudioVideoChat",
      "a_v_c_enabled": false,
      "block_chat": false
    },
    "hidden": false,
    "source_type": "AFLEX",
    "distance_miles": null
  },
  "bid_amount": 123.45,
  "bid_list": [
    2,
    3,
    4,
    5,
    6,
    7,
    8,
    9,
    10,
    11,
    12,
    13,
    14,
    15,
    16,
    17,
    18,
    19,
    20,
    21,
    22,
    23,
    24,
    25,
    26,
    27,
    28,
    29,
    30,
    31,
    32,
    33,
    34,
    35,
    36,
    37,
    38,
    39,
    40,
    41,
    42,
    43,
    44,
    45,
    46,
    47,
    48,
    49,
    50,
    51,
    52
  ],
  "bid_quantity": "",
  "description": "",
  "estimate": "",
  "featured_picture": {
    "__typename": "Picture",
    "description": "speakers",
    "full_size_location": "https://cdn.hibid.com/img.axd?id=8195278438&wid=&rwl=false&p=&ext=&w=0&h=0&t=&lp=&c=true&wt=false&sz=MAX&checksum=N33R4eJJO4BsS%2fvVwJ6bhISDQIw3%2b1vW",
    "height": 0,
    "hd_thumbnail_location": "https://cdn.hibid.com/img.axd?id=8195278438&wid=&rwl=false&p=&ext=&w=0&h=0&t=&lp=&c=true&wt=false&sz=MAX&checksum=N33R4eJJO4BsS%2fvVwJ6bhISDQIw3%2b1vW&h=400&w=400",
    "thumbnail_location": "https://cdn.hibid.com/img.axd?id=8195278438&wid=&rwl=false&p=&ext=&w=0&h=0&t=&lp=&c=true&wt=false&sz=MAX&checksum=N33R4eJJO4BsS%2fvVwJ6bhISDQIw3%2b1vW&h=200&w=200",
    "width": 0
  },
  "force_live_catalog": true,
  "fr8_star_url": "https://app.fr8star.com/transport-estimate?utm_channel=referral&utm_source=hibid&utm_medium=site-link&utm_campaign=shipping&utm_content=homepage&lot_id=261252067&origin_address_line_1=8110+Flitz+trail&origin_address_city=Litchfield&origin_address_state=IL&origin_address_postal_code=62056&origin_address_country=USA",
  "hide_lead_with_description": false,
  "id": 261252067,
  "item_id": 73938,
  "lead": "speakers",
  "links": [],
  "link_types": [],
  "lot_number": "163",
  "lot_state": {
    "__typename": "LotState",
    "bid_count": 0,
    "bidding_extended": false,
    "bid_max": 0,
    "bid_max_total": 0,
    "buyer_bid_status": "NO_BID",
    "buyer_high_bid": 0,
    "buyer_high_bid_total": 0,
    "buy_now": 0,
    "choice_type": "SINGLE_LOT",
    "high_bid": 0,
    "high_buyer_id": "0",
    "is_archived": false,
    "is_closed": false,
    "is_hidden": false,
    "is_live": false,
    "is_not_yet_live": true,
    "is_on_live_catalog": false,
    "is_posted": false,
    "is_public_hidden": false,
    "is_registered": false,
    "is_watching": false,
    "linked_soft_close": "",
    "may_have_won_status": "",
    "min_bid": 2,
    "price_realized": 0,
    "price_realized_message": null,
    "price_realized_per_each": 0,
    "product_status": "BUY_NOW_SET",
    "product_url": null,
    "quantity_sold": 0,
    "reserve_satisfied": true,
    "sealed": false,
    "show_bid_status": false,
    "show_reserve_status": false,
    "soft_close_minutes": 2,
    "soft_close_seconds": 0,
    "status": "OPEN",
    "time_left": "4h  21m  ",
    "time_left_lead": "",
    "time_left_seconds": 15711.759999999998,
    "time_left_title": "Internet Bidding closes at: 8/29/2025 8:24:00 AM EST",
    "time_left_with_limbo_seconds": 15712.759999999998,
    "watch_notes": null
  },
  "picture_count": 1,
  "pictures": null,
  "quantity": 1,
  "ring_number": 0,
  "rv": 4,
  "shipping_offered": true,
  "simulcast_status": "PENDING",
  "site": {
    "__typename": "Site",
    "domain": null,
    "fr8_star_url": "https://app.fr8star.com/transport-estimate?utm_channel=referral&utm_source=hibid&utm_medium=site-link&utm_campaign=shipping&utm_content=homepage",
    "is_domain_request": false,
    "is_extra_w_w_w_request": false,
    "site_type": "PUBLIC",
    "subdomain": "WWW"
  },
  "distance_miles": null,
  "from_url": "https://hibid.com/lots/40213/computers-and-electronics/consumer-electronics/home-audio/speakers"
}, // ... Many other Auction details
]

The scraper returns comprehensive auction data with 26 distinct fields, each serving specific analytical purposes:

Core Auction Information:

• Auction: The auction house or seller name hosting the event
• ID & Item ID: Unique identifiers for database integration and tracking
• Lot Number: Sequential auction lot identifier for reference
• Lot State: Current status (active, closed, pending, etc.)

Bidding Analytics:

• Bid Amount: Current highest bid value for price analysis
• Bid List: Complete bidding history for trend analysis
• Bid Quantity: Number of bids placed, indicating item popularity
• Estimate: Professional appraisal or starting price range
• RV (Reserve Value): Minimum acceptable selling price

Product Details:

• Description: Detailed item information including condition, specifications, and provenance
• Lead: Summary or headline description for quick identification
• Hide Lead with Description: Flag controlling display formatting

Visual Assets:

• Featured Picture: Primary product image URL
• Pictures: Array of all available product images
• Picture Count: Total number of images available

Logistics Information:

• Shipping Offered: Boolean indicating if seller provides shipping
• Distance (miles): Geographic proximity data for local buyers
• Site: Auction location or venue information

Technical Metadata:

• Force Live Catalog: System flag for live auction integration
• Fr8 Star URL: Shipping calculation service link
• Links: Related URLs (additional photos, documents, etc.)
• Link Types: Classification of associated links
• Ring Number: Live auction ring or room assignment
• Simulcast Status: Multi-platform broadcast availability
• Quantity: Number of items in the lot

This comprehensive dataset enables sophisticated analysis including price trend tracking, seller performance evaluation, category demand analysis, and geographic market assessment.

Implementation Guide and Best Practices

Step-by-Step Setup

Option A - URL-Based Setup:

1. Configure Target URLs: Navigate to HiBid.com and use the website's category browsing and filtering features to find the auction lots you need. Copy the complete URLs from specific category pages or search results that align with your research objectives.

2. Set Geographic Proxy: Choose proxy country matching your target market for authentic data access (typically US for HiBid.com).

3. Optimize Extraction Limits: Balance comprehensiveness with processing efficiency using the max_items_per_url parameter. Start with 20-50 items for testing.

4. Test Configuration: Run small batches initially to verify data quality and format.

Option B - Filter-Based Setup:

1. Define Search Parameters: Configure search filters to automatically generate queries:

   • Set keyword for specific items (e.g., "laptop", "furniture", "jewelry")
   • Define zip_code and distance for location-based searches
   • Select lot_type to filter by auction format (online, webcast, absentee, etc.)
   • Choose auction_status to target open, closing, or featured auctions
   • Set sort_by to organize results by time remaining, bid amount, or distance

2. Set Geographic Proxy: Choose US proxy for optimal performance with HiBid.com.

3. Configure Pagination: Set starting page number and max_items_per_url based on your needs.

4. Test Configuration: Run with small limits initially to verify filter combinations work correctly.

Optimization Strategies

Method Selection:

• Use URL-based scraping for complex category hierarchies or when you need specific pre-filtered results
• Use filter-based scraping for dynamic searches across multiple locations or auction statuses
• Combine both approaches: use filters for broad discovery, then URLs for targeted deep dives

Performance Enhancement:

• Use residential proxies from US regions for authentic data access
• Set appropriate retry limits (default: 2) to handle temporary server issues
• Implement reasonable delays between requests to maintain access reliability
• Monitor extraction patterns to identify peak and off-peak performance windows
• Enable ignore_url_failures to ensure robust scraping

Location-Based Optimization:

• For filter-based scraping: Use zip_code with appropriate distance radius to target local auctions
• Start with broader distance ranges (250-500 miles) then narrow down based on results
• Sort by DISTANCE_NEAREST when location proximity is critical

Auction Timing Strategy:

• Use auction_status: "CLOSING" to find auctions ending soon
• Sort by TIME_LEFT to prioritize time-sensitive opportunities
• Filter by OPEN status for comprehensive inventory of available lots

Data Quality Assurance:

• Regularly validate output schema consistency
• Cross-reference extracted prices with live site data
• Implement data cleaning pipelines for description standardization
• Track extraction success rates across different categories and filter combinations
• Test keyword variations to ensure comprehensive coverage

Common Challenge Resolution:

• Rate Limiting: Adjust request frequency and implement proper proxy rotation
• Page Structure Changes: Monitor for layout updates that might affect extraction accuracy
• Category Variations:
  • URL-based: Adapt URL patterns for different product categories
  • Filter-based: Refine keyword and filter combinations based on results
• Data Completeness: Handle missing fields gracefully in downstream analysis
• Geographic Coverage: For filter-based, test different zip codes and distance ranges to ensure complete market coverage
• Auction Type Filtering: Use lot_type to focus on specific auction formats that match your research needs

Business Applications and Strategic Value

Market Intelligence Applications

The extracted HiBid.com data provides actionable insights for multiple business scenarios:

Price Analysis and Forecasting: Historical bid data enables sophisticated pricing models for collectibles, electronics, and specialty items. Businesses can identify undervalued categories and predict market movements.

Competitive Landscape Mapping: Track competitor auction performance, identify successful selling strategies, and benchmark pricing approaches across similar product categories.

Inventory Sourcing Optimization: Identify consistent suppliers, evaluate seller reliability based on completion rates, and discover new sourcing opportunities in emerging categories.

Geographic Market Analysis: Leverage location and shipping data to understand regional demand patterns, optimize logistics strategies, and identify expansion opportunities.

Operational Efficiency Gains

Automated data extraction eliminates manual research processes that previously required hours of browsing and note-taking. Teams can focus on analysis and decision-making rather than data collection, significantly improving productivity and enabling more comprehensive market coverage.

Conclusion

The HiBid.com Auction Listings Scraper transforms auction data from scattered, manual observations into structured, actionable business intelligence. By providing comprehensive access to bid histories, product details, and market dynamics, this tool empowers data-driven decision making in the dynamic auction marketplace.

Ready to unlock the full potential of HiBid.com's auction data? Start extracting valuable market insights today and gain the competitive advantage that comes from comprehensive, real-time auction intelligence.

Related Actors

• Hibid.com Auction Details Scraper: A specialized data extraction solution engineered to harvest comprehensive Auction information from Hibid.com's.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Hibid.com Auction Listings Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.