Dollargeneral Category Scraper

The Dollargeneral Category Scraper is a powerful Apify Actor designed to extract detailed product information from Dollar General's online store. It enables users to scrape product data based on specific store numbers and search queries, providing comprehensive details like prices, availability, ratings, and more. This tool is ideal for businesses, researchers, and developers needing accurate, up-to-date retail data for analysis and automation.

Features

• Targeted Scraping: Scrape products from specific Dollar General stores using store numbers and custom search queries.
• Comprehensive Data Extraction: Retrieve key product details including UPC, name, prices, stock levels, ratings, and images.
• Efficient and Scalable: Built on CheerioCrawler for fast, reliable scraping with configurable item limits to optimize performance.
• Proxy Support: Integrated proxy configuration for residential IPs to avoid detection and ensure smooth operation.
• High-Quality Output: Delivers structured JSON data with consistent formatting for easy integration into workflows.
• Flexible Configuration: Customize searches and limits to suit various needs, from small queries to large-scale data collection.
• Error-Resilient: Handles common scraping challenges like rate limits and site changes gracefully.

Input Parameters

Parameter	Type	Required	Description	Example
storeNumber	string	No	The specific Dollar General store number to target for product scraping.	"22937"
searchQuery	string	No	Keywords to search for products within the selected store.	"pet"
maxItems	integer	No	Maximum number of products to scrape; helps control request volume and efficiency.	10
proxyConfiguration	object	No	Proxy settings to mask the scraper's origin, using Apify's residential proxies by default.	{"useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"]}

Example Usage

To run the Actor, provide input parameters in JSON format. Here's an example:

{
  "storeNumber": "22937",
  "searchQuery": "pet",
  "maxItems": 10,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

The Actor will output a JSON array of product objects. Example output:

[
  {
    "upc": 50000100446,
    "name": "Purina Friskies Prime Filets Chicken and Tuna Dinner in Wet Cat Food Gravy",
    "price": 0.85,
    "originalPrice": 0.85,
    "shipToHomePrice": 0.85,
    "shipToHomeOriginalPrice": 0.85,
    "image": "https://s7d1.scene7.com/is/image/dolgen/dg-41154101-1",
    "inStock": true,
    "availableQty": 67,
    "storeStock": 67,
    "averageRating": 4.8,
    "reviewCount": 534,
    "category": "Cat Food > Dollar Deals > Dollar Pet",
    "isDeliverable": true,
    "isShipToHome": false,
    "isBopisEligible": false,
    "coupons": [],
    "offers": []
  }
]

Use Cases

• Market Research: Analyze product trends, pricing, and availability across Dollar General stores for competitive insights.
• Price Monitoring: Track price changes and promotions for specific items to inform purchasing decisions.
• Competitive Intelligence: Gather data on rival products and categories to benchmark against other retailers.
• Content Aggregation: Collect product images, descriptions, and reviews for e-commerce platforms or blogs.
• Academic Research: Study consumer goods data, such as stock levels and ratings, for economic or behavioral studies.
• Business Automation: Integrate scraped data into inventory management systems or automated reporting tools.

Installation and Usage

1. Search for "Dollargeneral Category Scraper" in the Apify Store
2. Click "Try for free" or "Run"
3. Configure input parameters
4. Click "Start" to begin extraction
5. Monitor progress in the log
6. Export results in your preferred format (JSON, CSV, Excel)

Output Format

The Actor outputs a JSON array of objects, each representing a scraped product. Key fields include:

• upc: Unique product code.
• name: Product title.
• price and originalPrice: Current and original pricing.
• shipToHomePrice and shipToHomeOriginalPrice: Shipping-related prices.
• image: Product image URL.
• inStock, availableQty, storeStock: Availability details.
• averageRating, reviewCount: Customer feedback metrics.
• category: Product categorization.
• isDeliverable, isShipToHome, isBopisEligible: Delivery and pickup options.
• coupons, offers: Arrays of applicable deals.

Data is structured for easy parsing and integration.

Support

For custom/simplified outputs or bug reports, please contact:

• Email: support@getdataforme.com
• Subject line: "custom support"
• Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!

---