# CarMax Scraper (`rigelbytes/carmax-scraper`) Actor Scrapes used car listings from CarMax.com with search URL, zip code filtering, and pagination support. - **URL**: https://apify.com/rigelbytes/carmax-scraper.md - **Developed by:** [Rigel Bytes](https://apify.com/rigelbytes) (community) - **Categories:** Travel, E-commerce, News - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.00 / 1,000 cars This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## CarMax Scraper Extract used car listings from CarMax.com with full vehicle specs, pricing, location, and dealership data — from **$1 per 1,000 listings**. Search by make, model, body type, or nationwide inventory, filter by zip code, and paginate through thousands of results for market research, price monitoring, and inventory analysis. --- ### What can CarMax Scraper do for you? - **Search any CarMax criteria** — Use CarMax search URLs with all filters applied (make, model, body type, price range, features) and let the scraper work through every matching car - **Zip code filtering** — Target inventory near a specific location to analyze local pricing and availability - **Full pagination support** — Automatically pages through all search results so you never miss a listing - **Complete vehicle details** — Extract year, make, model, trim, mileage, price, VIN, engine specs, transmission, drivetrain, fuel type, MPG, colors, and more - **Dealer & location data** — Get store name, city, state, distance, ratings, and transfer/shipping information for every car - **Features & options breakdown** — Capture full feature lists, packages, highlights, and optional equipment for competitive analysis ### What data can you extract? | Field | Description | |-------|-------------| | 🖼️ **Hero Image** | Main listing photo URL | | 🔗 **Listing URL** | Direct link to the car on CarMax | | 🏷️ **Stock # / VIN** | Unique stock number and vehicle identification number | | 📅 **Year** | Model year | | 🚗 **Make & Model** | Brand and model name | | 🎨 **Trim** | Trim level (e.g., Onyx Edition, SEL Sport) | | 💰 **Price** | Current base price and original price | | 📉 **Price Drop** | Whether the price has been reduced | | ⛽ **Mileage** | Odometer reading | | 🎨 **Exterior / Interior Color** | Color specifications (raw and normalized) | | ⚙️ **Transmission** | Automatic, manual, etc. | | 🔄 **Drivetrain** | AWD, FWD, RWD, 4WD | | 🔋 **Engine** | Type, size, cylinders, horsepower, torque, RPM | | 🏎️ **Fuel Type & MPG** | Gas, hybrid, electric — city and highway MPG | | 🪫 **EV Battery Range** | Original battery range for electric vehicles | | ⭐ **Features** | Full feature list (Android Auto, Blind Spot Monitor, etc.) | | 🏪 **Store Info** | Store name, city, state, distance | | ⭐ **Ratings & Reviews** | Average rating and number of reviews | | 🚚 **Transfer Info** | Transfer fee, type, estimated duration, shipping details | | 📦 **Prior Use** | Rental, fleet, or personal use history | ### Why use this scraper? - **🔍 Market research** — Analyze used car pricing trends, inventory distribution, and popular models across the country - **📊 Price monitoring** — Track price changes and identify deals with price drop detection across thousands of listings - **🏪 Inventory analysis** — Understand what makes and models are available at which CarMax locations, with distance and transfer data - **🤖 Automated data collection** — Replace manual copy-paste with a programmable scraper that pushes structured data directly to your dataset - **📈 Competitive intelligence** — Compare trim levels, features, and pricing to benchmark against market averages ### Pricing - **$1/1,000 listings** - No hidden fees or limits on usage. --- ### How to use CarMax Scraper 1. **Create an Apify account** — Sign up at [apify.com](https://apify.com) and log in to the Console 2. **Open the CarMax Scraper** — Navigate to the [CarMax Scraper](https://apify.com/rigelbytes/carmax-scraper) page 3. **Configure your input** — Enter a CarMax search URL (e.g., `https://www.carmax.com/cars/suvs/audi`) and optionally set a zip code and max items limit 4. **Start the run** — Click "Start" and the scraper will begin extracting listings 5. **Download your data** — Once complete, export your dataset as JSON, CSV, HTML, or Excel ### Input | Property | Type | Required | Description | |----------|------|----------|-------------| | `searchUrl` | string | No | Full CarMax search URL, e.g. `https://www.carmax.com/cars/suvs/audi`. All filters from the URL are automatically applied. | | `searchUrls` | array | No | Multiple search URLs to scrape (overrides `searchUrl` if set). | | `zipCode` | string | No | Target zip code for inventory filtering. Leave empty for nationwide search. Default: `"20760"`. | | `maxItems` | integer | No | Maximum number of cars to scrape (`0` = unlimited). Default: `0`. | | `proxyConfiguration` | object | No | Proxy settings for anti-bot protection. Default uses Apify Residential proxies. | #### 📝 Copy for Use: ```json { "searchUrl": "https://www.carmax.com/cars", "zipCode": "", "maxItems": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ```` ### Output The scraper pushes each car listing as a structured JSON object to the Apify dataset. Here is an example of a single listing: ```json { "heroImageUrl": "https://img2.carmax.com/assets/28735752/hero.jpg?width=400&height=300", "url": "https://www.carmax.com/car/28735752", "stockNumber": 28735752, "vin": "4S4BTALCXR3155366", "year": 2024, "make": "Subaru", "model": "Outback", "body": "4D Sport Utility", "trim": "Onyx Edition", "basePrice": 25998.0, "mileage": 56484, "exteriorColor": "Black", "transmission": "Automatic", "driveTrain": "All Wheel Drive", "engineSize": "2.5L", "horsepower": 182, "mpgCity": 26, "mpgHighway": 32, "storeName": "Greenwood", "storeCity": "Indianapolis", "state": "Indiana" } ``` You can download the dataset in various formats such as JSON, HTML, CSV, or Excel. ### Why Choose This Scraper? - **Affordable**: Pay only $1 per 1,000 listings scraped. - **Comprehensive**: Extracts 80+ data points per vehicle including pricing, specs, features, location, and transfer details. - **Easy to Use**: Just paste a CarMax search URL and click run — no coding or browser setup required. - **Reliable**: Built with automatic retries, TLS impersonation, and Apify residential proxy support for consistent scraping at scale. ### Recommended Proxy Providers - ## **Shifter** - Reliable residential proxies all over the world. - Cheap rates - [Order Shifter Now](https://shifter.io/r/YoBB/order) - Get 10% Off any product, use coupan `rigelbytes-YoBB`. - ## **OxyLabs** - **100M+ Proxies** - Fastest proxies in the market - Real profile, human-like Residential IPs - Quality assurance framework for most reliable IPs - [Get Proxies](https://oxylabs.go2cloud.org/aff_c?offer_id=7\&aff_id=1366\&url_id=7) - ## **DataImpulse** - Covers **200+ Counties** - Reliable Residential Proxies for just $1/GB - [Get Residential Proxies](https://dataimpulse.com/?aff=89421) ### [![Learn More About Proxies](https://img.shields.io/badge/Learn_More-About_Proxies-blue?style=for-the-badge)](#understanding-proxies) ### 🙌 Why Buy Through Our Affiliate Link? - Exclusive Deals: Some providers may offer special discounts or bonuses when you use our link. - Support Our Work: Each purchase helps us maintain and improve the tools and services we provide. - No Extra Cost: You pay the same price, but part of it goes to supporting our efforts. #### Running via Apify Console You can run this actor from the Apify Console by providing the necessary input parameters. #### Running via API You can trigger this actor using the Apify API, passing the required input in the request body. ### API #### Python ```python import asyncio from apify_client import ApifyClientAsync async def main(): client = ApifyClientAsync(token="YOUR_API_TOKEN") actor_call = await client.actor("rigelbytes/carmax-scraper").call( run_input={ "searchUrl": "https://www.carmax.com/cars", "zipCode": "", "maxItems": 20, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"] } } ) dataset = await client.dataset(actor_call["defaultDatasetId"]).list_items() for item in dataset.items: print(item) if __name__ == "__main__": asyncio.run(main()) ``` #### JavaScript ```javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: 'YOUR_API_TOKEN' }); const actorCall = await client .actor('rigelbytes/carmax-scraper') .call({ searchUrl: 'https://www.carmax.com/cars', zipCode: '', maxItems: 20, proxyConfiguration: { useApifyProxy: true, apifyProxyGroups: ['RESIDENTIAL'], }, }); const { items } = await client .dataset(actorCall.defaultDatasetId) .listItems(); console.log(items); ``` #### cURL ```shell curl -X POST "https://api.apify.com/v2/acts/rigelbytes~carmax-scraper/runs?token=YOUR_API_TOKEN" \ -H "Content-Type: application/json" \ -d '{ "searchUrl": "https://www.carmax.com/cars", "zipCode": "", "maxItems": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } }' ``` ### 🚀 Other Tools by Rigel Bytes Explore **74** more scraping tools by Rigel Bytes, organized by use case: #### 📱 Social Media Scrape Instagram, TikTok, LinkedIn, and more for content research and marketing intelligence. - **[Export Instagram Reels](https://apify.com/rigelbytes/export-instagram-reels)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Facebook Ads Scraper](https://apify.com/rigelbytes/facebook-ads-scraper)** — Extract posts, profiles, and engagement data from Facebook for content research, influencer tracking, and marketing analytics. - **[Instagram Analytics Tool](https://apify.com/rigelbytes/instagram-analytics-tool)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Comment Scraper](https://apify.com/rigelbytes/instagram-comment-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Creator Stats](https://apify.com/rigelbytes/instagram-creator-stats)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Engagement Tool](https://apify.com/rigelbytes/instagram-engagement-tool)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Post Scraper](https://apify.com/rigelbytes/instagram-post-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[instagram-posts](https://apify.com/rigelbytes/instagram-posts)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Profile Scraper](https://apify.com/rigelbytes/instagram-profile-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Reel Scraper](https://apify.com/rigelbytes/instagram-reel-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[linkedin-company-details](https://apify.com/rigelbytes/linkedin-company-details)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[Linkedin Company Scraper](https://apify.com/rigelbytes/linkedin-company-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[LinkedIn Profile Scraper](https://apify.com/rigelbytes/linkedin-profile-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[Scrape Instagram Creators](https://apify.com/rigelbytes/scrape-instagram-creators)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Tiktok Comment Scraper](https://apify.com/rigelbytes/tiktok-comment-scraper)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Tiktok Creator Stats](https://apify.com/rigelbytes/tiktok-creator-stats)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Tiktok Engagement Rate](https://apify.com/rigelbytes/tiktok-engagement-rate)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[TikTok Profile Scraper](https://apify.com/rigelbytes/tiktok-profile-scraper)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. #### 🏠 Real Estate Extract property listings, prices, and agent data from top real estate platforms. - **[Airbnb Address Finder](https://apify.com/rigelbytes/airbnb-address-finder)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Availability Calendar](https://apify.com/rigelbytes/airbnb-availability-calendar)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Detailed Scraper - Search & Listing Details](https://apify.com/rigelbytes/airbnb-detailed-scraper)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Images Downloader](https://apify.com/rigelbytes/airbnb-images-downloader)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Listing](https://apify.com/rigelbytes/airbnb-listing)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Listing Urls](https://apify.com/rigelbytes/airbnb-listing-urls)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Property Details](https://apify.com/rigelbytes/airbnb-property-details)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Reviews](https://apify.com/rigelbytes/airbnb-reviews)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Scraper - Search & Listing Details](https://apify.com/rigelbytes/airbnb-scraper)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Bayut Scraper](https://apify.com/rigelbytes/bayut-scraper)** — Scrape property listings and market data from Bayut for market research, price monitoring, and investment analysis. - **[Boligsiden.dk Scraper](https://apify.com/rigelbytes/boligsiden-dk-scraper)** — Scrape Danish real estate listings from Boligsiden.dk — for sale, sold, and rental properties with pricing, details,... - **[Daft.ie Property Scraper](https://apify.com/rigelbytes/daft-ie-scraper)** — Scrapes property listings from Daft.ie including residential, rental, commercial, and new homes across Ireland. - **[dubai-listing-scraper](https://apify.com/rigelbytes/dubai-listing-scraper)** — Extract unlimited property listings from Bayut.com — the UAE's largest real estate platform. Get detailed property... - **[Export Airbnb Calendar](https://apify.com/rigelbytes/export-airbnb-calendar)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Funda Netherlands Real Estate Scraper](https://apify.com/rigelbytes/funda-nl-scraper)** — Scrape property listings from Funda.nl — the largest real estate platform in the Netherlands. Supports buy and rent,... - **[Furnished Finder Fast](https://apify.com/rigelbytes/furnished-finder-fast)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[Extract Furnished Finder Hosts](https://apify.com/rigelbytes/furnished-finder-hosts)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[FurnishedFinder](https://apify.com/rigelbytes/furnishedfinder)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[Hemnet.se Scraper - Swedish Real Estate Listings](https://apify.com/rigelbytes/hemnet-se-scraper)** — Scrape property listings from Hemnet.se including for-sale, upcoming, and sold homes. Search by URL or location... - **[Immobiliare Italy Real Estate Scraper](https://apify.com/rigelbytes/immobiliare-it-scraper)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immobilienscout24](https://apify.com/rigelbytes/immobilienscout24)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immobilienscout24-scraper](https://apify.com/rigelbytes/immobilienscout24-scraper)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immoweb Scraper - Belgium Property Listings](https://apify.com/rigelbytes/immoweb-scraper)** — Scrapes property listings from Immoweb.be. Supports search result extraction with optional property detail enrichment. - **[Immowelt Property Scraper](https://apify.com/rigelbytes/immowelt-property-scraper)** — The Immowelt Scraper helps you extract unlimited real estate listings from Immowelt with complete details including... - **[Immowelt Scraper](https://apify.com/rigelbytes/immowelt-scraper)** — The Immowelt Scraper helps you extract unlimited real estate listings from Immowelt with complete details including... - **[Land.com Scraper](https://apify.com/rigelbytes/landdotcom-scraper)** — Scrape property listings and market data from Land.com for market research, price monitoring, and investment analysis. - **[Outdoorsy Scraper](https://apify.com/rigelbytes/outdoorsy-scraper)** — Scrape property listings and market data from Outdoorsy for market research, price monitoring, and investment analysis. - **[Propertyfinder Scraper](https://apify.com/rigelbytes/propertyfinder-scraper)** — Scrape property listings and market data from Property Finder for market research, price monitoring, and investment analysis. - **[Redfin Scraper](https://apify.com/rigelbytes/redfin-scraper)** — Scrape property listings and market data from Redfin for market research, price monitoring, and investment analysis. - **[Rightmove Scraper](https://apify.com/rigelbytes/rightmove-scraper)** — Scrape property listings and market data from Rightmove for market research, price monitoring, and investment analysis. - **[RVshare Scraper](https://apify.com/rigelbytes/rvshare-scraper)** — Scrape property listings and market data from RVshare for market research, price monitoring, and investment analysis. - **[Unlimited Redfin Scraper](https://apify.com/rigelbytes/unlimited-redfin-scraper)** — Scrape property listings and market data from Redfin for market research, price monitoring, and investment analysis. - **[Zillow Detail Scraper](https://apify.com/rigelbytes/zillow-detail-scraper)** — Scrape property listings and market data from Zillow for market research, price monitoring, and investment analysis. - **[Zillow Scraper](https://apify.com/rigelbytes/zillow-scraper)** — Scrape property listings and market data from Zillow for market research, price monitoring, and investment analysis. - **[Zoopla Scraper](https://apify.com/rigelbytes/zoopla-scraper)** — Scrape property listings and market data from Zoopla for market research, price monitoring, and investment analysis. #### ✈️ Travel & Hospitality Monitor rentals, bookings, and travel listings at scale. - **[Ticketmaster Scraper](https://apify.com/rigelbytes/ticketmaster-scraper)** — Collect rental and travel listings from Ticketmaster for pricing intelligence and availability tracking. #### 🛒 E-commerce Scrape products, prices, and marketplace data for competitive research. - **[Amazon Product Scraper](https://apify.com/rigelbytes/amazon-product-scraper)** — Scrape products, prices, and seller data from Amazon for competitor monitoring, pricing, and product research. - **[Amazon Search Scraper](https://apify.com/rigelbytes/amazon-scraper)** — Scrape products, prices, and seller data from Amazon for competitor monitoring, pricing, and product research. - **[Daraz](https://apify.com/rigelbytes/daraz)** — Scrape products, prices, and seller data from Daraz for competitor monitoring, pricing, and product research. - **[Etsy Scraper](https://apify.com/rigelbytes/etsy-scraper)** — Scrape products, prices, and seller data from Etsy for competitor monitoring, pricing, and product research. - **[Homedepot Scraper](https://apify.com/rigelbytes/homedepot-scraper)** — HomeDepot Products Scraper lets you extract product data from homedepot.com using a collection URL and delivery ZIP.... - **[Otodom Scraper - Polish Real Estate Listings](https://apify.com/rigelbytes/otodom-scraper)** — Scrapes property listings from Otodom.pl, Poland's leading real estate marketplace. Supports filters for transaction... #### 📩 Lead Generation Find business contacts, leads, and company data for sales and outreach. - **[Company Service Finder](https://apify.com/rigelbytes/company-service-finder)** — The Company Service Finder uses AI to extract and analyze company services from Google Search & Maps. Get detailed... - **[Doctify Scraper](https://apify.com/rigelbytes/doctify-scraper)** — Doctify Scraper lets you extract doctor and practice data from doctify.com using a search results URL. Collect... - **[FindLaw Law Firm Scraper - Attorney & Law Firm Data Extraction](https://apify.com/rigelbytes/findlaw-scraper)** — Scrape law firm profiles from FindLaw.com. Extract detailed attorney and firm information including contact details,... - **[Google Maps Scraper](https://apify.com/rigelbytes/google-maps-scraper)** — Find business leads and contact details from Google Maps for outbound sales, prospecting, and CRM enrichment. - **[Website Services Finder](https://apify.com/rigelbytes/website-services-finder)** — Automatically extract and analyze company services from any business website using advanced AI. Choose from 5 AI... - **[Zillow Agents](https://apify.com/rigelbytes/zillow-agents)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. - **[Zillow Agents Phone](https://apify.com/rigelbytes/zillow-agents-phone)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. #### ⭐ Reviews & Ratings Monitor reviews and reputation data across review platforms. - **[Airbnb Listing Reviews](https://apify.com/rigelbytes/airbnb-listing-reviews)** — Collect reviews and ratings from Airbnb for reputation monitoring and customer insights. - **[BBB Scraper](https://apify.com/rigelbytes/bbb-scraper)** — Collect reviews and ratings from BBB for reputation monitoring and customer insights. - **[Rottentomatoes Reviews Scraper](https://apify.com/rigelbytes/rottentomatoes-reviews-scraper)** — Collect reviews and ratings from Rotten Tomatoes for reputation monitoring and customer insights. - **[Trustpilot Reviews Scraper](https://apify.com/rigelbytes/trustpilot-reviews)** — Collect reviews and ratings from Trustpilot for reputation monitoring and customer insights. #### 🍔 Food & Delivery Extract restaurant, grocery, and delivery platform data. - **[Instacart Scraper](https://apify.com/rigelbytes/instacart-scraper)** — Scrape menus, stores, and delivery data from Instacart for data-driven research and automation. - **[Publix Scraper](https://apify.com/rigelbytes/publix-scraper)** — Scrape menus, stores, and delivery data from Publix for data-driven research and automation. #### 🛠️ Developer Tools General-purpose scraping and automation tools. - **[Web Crawler](https://apify.com/rigelbytes/webcrawler)** — This web crawler is designed to provide users with complete flexibility by allowing them to use their \*\*own... ### Understanding Proxies: When scraping data or browsing anonymously, proxies are essential. They act as intermediaries, masking your original IP address and allowing you to send requests from another location. #### Why Use Proxies? - Avoid IP Blocks: By routing requests through proxies, you prevent the target website from recognizing your IP as a scraper or spammer. - Access Geo-restricted Content: Proxies let you access content or websites restricted by location. - Enhance Anonymity: Hide your actual IP, ensuring privacy while scraping or browsing. #### Types of Proxies 1. Residential Proxies - Real IP addresses provided by ISPs to home users. - They mimic regular users, making them harder to detect. - Best for: Long-term, undetectable scraping, and avoiding blocks. 2. Data Center Proxies - IP addresses from servers in data centers. - Faster and cheaper than residential proxies but easier to detect and block. - Best for: High-speed scraping, but with a higher risk of detection. 3. Mobile Proxies - IPs provided by mobile carriers (3G/4G/5G networks). - Very difficult to detect, as they appear as regular mobile users. - Best for: Mobile-related scraping or avoiding sophisticated blocks. #### Rotating Proxies vs. Straight Proxies - Rotating Proxies: Every request you send goes through a different proxy, making it harder for websites to detect patterns. - Straight Proxies: All requests are sent through the same proxy, making it easier to track your IP. ### About Rigel Bytes Rigel Bytes specializes in web scraping, automation, and data analytics. We help businesses extract and leverage valuable data for informed decision-making. ### Contact Us Ready to unlock the power of data? Reach out to us at (contact@rigelbytes.com) or [book an appointment](https://cal.com/faizanali/appointments) with us to learn more about how we can help you achieve your data goals. ### Detailed Data ```json [ { "heroImageUrl": "https://img2.carmax.com/assets/28735752/hero.jpg?width=400&height=300", "url": "https://www.carmax.com/car/28735752", "stockNumber": 28735752, "vin": "4S4BTALCXR3155366", "year": 2024, "make": "Subaru", "model": "Outback", "body": "4D Sport Utility", "trim": "Onyx Edition", "basePrice": 25998.0, "originalPrice": null, "hasPriceDrop": false, "mileage": 56484, "exteriorColor": "Black", "interiorColor": "Black", "transmission": "Automatic", "driveTrain": "All Wheel Drive", "engineType": "Gas", "engineSize": "2.5L", "cylinders": 4, "horsepower": 182, "mpgCity": 26, "mpgHighway": 32, "fuelType": null, "storeName": "Greenwood", "storeCity": "Indianapolis", "state": "Indiana", "stateAbbreviation": "IN", "distance": 1871.3, "averageRating": 4.92, "numberOfReviews": 12, "features": [ "Android Auto", "Alloy Wheels", "Parking Sensors", "Rear View Camera", "Apple CarPlay", "Blind Spot Monitor", "Lane Departure Warning", "Smart Key" ] }, { "heroImageUrl": "https://img2.carmax.com/assets/28451069/hero.jpg?width=400&height=300", "url": "https://www.carmax.com/car/28451069", "stockNumber": 28451069, "vin": "2C3CDXBGXPH604122", "year": 2023, "make": "Dodge", "model": "Charger", "body": "4D Sedan", "trim": "SXT", "basePrice": 29998.0, "originalPrice": null, "hasPriceDrop": false, "mileage": 19978, "exteriorColor": "Black", "interiorColor": "Black", "transmission": "Automatic", "driveTrain": "Rear Wheel Drive", "engineType": "Gas", "engineSize": "3.6L", "cylinders": 6, "horsepower": 292, "mpgCity": 19, "mpgHighway": 30, "fuelType": null, "storeName": "Midlothian", "storeCity": "Midlothian", "state": "Virginia", "stateAbbreviation": "VA", "distance": 2341.9, "averageRating": 4.67, "numberOfReviews": 12, "features": [ "Cloth Seats", "Smart Key", "Rear View Camera", "20 Inch Plus Wheels", "Android Auto", "Apple CarPlay", "Premium Sound" ] } ] ``` # Actor input Schema ## `searchUrl` (type: `string`): Full CarMax search URL, e.g. https://www.carmax.com/cars/suvs/audi. All filters from the URL are automatically applied. ## `searchUrls` (type: `array`): Multiple search URLs to scrape (overrides searchUrl if set). ## `zipCode` (type: `string`): Target zip code for inventory filtering. Leave empty for nationwide search. ## `maxItems` (type: `integer`): Maximum number of cars to scrape (0 = unlimited). ## `proxyConfiguration` (type: `object`): Proxy settings for anti-bot protection. ## Actor input object example ```json { "searchUrl": "https://www.carmax.com/cars", "zipCode": "20760", "maxItems": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `results` (type: `string`): Dataset containing scraped CarMax car listings # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchUrl": "https://www.carmax.com/cars", "maxItems": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("rigelbytes/carmax-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchUrl": "https://www.carmax.com/cars", "maxItems": 20, } # Run the Actor and wait for it to finish run = client.actor("rigelbytes/carmax-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchUrl": "https://www.carmax.com/cars", "maxItems": 20 }' | apify call rigelbytes/carmax-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=rigelbytes/carmax-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "CarMax Scraper", "description": "Scrapes used car listings from CarMax.com with search URL, zip code filtering, and pagination support.", "version": "1.0", "x-build-id": "KjSQvoKNNrPVEVgTi" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/rigelbytes~carmax-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-rigelbytes-carmax-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/rigelbytes~carmax-scraper/runs": { "post": { "operationId": "runs-sync-rigelbytes-carmax-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/rigelbytes~carmax-scraper/run-sync": { "post": { "operationId": "run-sync-rigelbytes-carmax-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "searchUrl": { "title": "CarMax Search URL", "type": "string", "description": "Full CarMax search URL, e.g. https://www.carmax.com/cars/suvs/audi. All filters from the URL are automatically applied." }, "searchUrls": { "title": "CarMax Search URLs", "type": "array", "description": "Multiple search URLs to scrape (overrides searchUrl if set).", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "zipCode": { "title": "Zip Code", "type": "string", "description": "Target zip code for inventory filtering. Leave empty for nationwide search.", "default": "20760" }, "maxItems": { "title": "Max Cars", "minimum": 0, "type": "integer", "description": "Maximum number of cars to scrape (0 = unlimited).", "default": 0 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Proxy settings for anti-bot protection.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```