Dollargeneral Category Scraper

Introduction

The Dollargeneral Category Scraper is a powerful Apify Actor designed to extract detailed product information from Dollar General's online store based on specific store numbers and search queries. It enables users to gather comprehensive data on products, including pricing, availability, ratings, and more, directly from Dollar General's website. This tool is ideal for businesses, researchers, and developers needing reliable, structured data for analysis, monitoring, or integration into applications.

Features

• Targeted Scraping: Scrape products by store number and custom search queries for precise, location-specific results.
• Comprehensive Data Extraction: Captures key product details like UPC, name, price, stock status, ratings, and images.
• High Performance: Utilizes CheerioCrawler for efficient, fast scraping with minimal resource usage.
• Proxy Support: Built-in proxy configuration for residential IPs to avoid IP blocks and ensure reliable access.
• Flexible Limits: Set maximum items to scrape, balancing depth with efficiency.
• JSON Output: Delivers clean, structured JSON data ready for export to CSV, Excel, or databases.
• Error Handling: Includes robust logging and retry mechanisms for uninterrupted operation.

Input Parameters

Parameter	Type	Required	Description	Example
storeNumber	string	Yes	The specific Dollar General store number to target for product scraping.	"22937"
searchQuery	string	No	Keywords to search for products within the selected store. Defaults to "pet".	"pet"
maxItems	integer	No	Maximum number of products to scrape; helps control request volume for efficiency. Defaults to 10.	10
proxyConfiguration	object	No	Proxy settings to mask the scraper's origin, using Apify's residential proxies by default.	{"useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"]}

Example Usage

Input

{
  "storeNumber": "22937",
  "searchQuery": "pet",
  "maxItems": 10,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Output

[
  {
    "upc": 50000100446,
    "name": "Purina Friskies Prime Filets Chicken and Tuna Dinner in Wet Cat Food Gravy",
    "price": 0.85,
    "originalPrice": 0.85,
    "shipToHomePrice": 0.85,
    "shipToHomeOriginalPrice": 0.85,
    "image": "https://s7d1.scene7.com/is/image/dolgen/dg-41154101-1",
    "inStock": true,
    "availableQty": 67,
    "storeStock": 67,
    "averageRating": 4.8,
    "reviewCount": 534,
    "category": "Cat Food > Dollar Deals > Dollar Pet",
    "isDeliverable": true,
    "isShipToHome": false,
    "isBopisEligible": false,
    "coupons": [],
    "offers": []
  }
]

Use Cases

• Market Research: Analyze product trends, pricing, and availability across Dollar General stores.
• Competitive Intelligence: Monitor competitors' offerings and stock levels in specific locations.
• Price Monitoring: Track price changes and promotions for retail optimization.
• Content Aggregation: Build databases of product catalogs for e-commerce platforms.
• Academic Research: Study consumer goods distribution and regional variations.
• Business Automation: Automate inventory checks or integrate data into ERP systems.

Installation and Usage

1. Search for "Dollargeneral Category Scraper" in the Apify Store
2. Click "Try for free" or "Run"
3. Configure input parameters
4. Click "Start" to begin extraction
5. Monitor progress in the log
6. Export results in your preferred format (JSON, CSV, Excel)

Output Format

The Actor outputs an array of JSON objects, each representing a scraped product. Key fields include:

• upc: Unique product code.
• name: Product title.
• price and originalPrice: Current and base prices.
• image: Product image URL.
• inStock, availableQty, storeStock: Availability details.
• averageRating, reviewCount: Customer feedback metrics.
• category: Product categorization.
• isDeliverable, isShipToHome, isBopisEligible: Shipping and pickup options.
• coupons, offers: Arrays of promotions (may be empty).

Data is structured for easy parsing and integration.

Support

For custom/simplified outputs or bug reports, please contact:

• Email: support@getdataforme.com
• Subject line: "custom support"
• Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!

---