Walgreens Product Scraper

Extract comprehensive product data from Walgreens.com at scale. Collect product names, prices, ratings, inventory status, and more from search results and category pages. Perfect for retail analytics, price monitoring, and market research.

Features

• Product Search - Search by keyword to find relevant products across all categories
• Price Extraction - Collect regular prices, sale prices, and unit pricing
• Ratings & Reviews - Extract average ratings and review counts for each product
• Inventory Data - Get real-time stock status and availability information
• Product Details - Access product IDs, SKUs, UPCs, and brand information
• Offer Details - Capture deals, rebate messages, and product-level savings text
• Fulfillment Signals - Collect shipping, pickup, same-day, add-to-cart, and channel availability fields
• Pagination Support - Automatically navigate through multiple result pages
• Flexible Input - Use keywords or direct Walgreens URLs for targeted scraping

Use Cases

Competitive Price Monitoring

Track price changes on Walgreens for specific product categories. Compare pricing strategies, identify sale patterns, and optimize your own pricing decisions.

Product Research & Analysis

Build comprehensive product catalogs with detailed attributes. Analyze product assortments, brand distribution, and category trends across Walgreens marketplace.

Inventory & Availability Tracking

Monitor stock levels for products across different fulfillment methods. Identify trends in product availability and plan purchasing strategies accordingly.

---

Input Parameters

Parameter	Type	Required	Default	Description
keyword	String	No	"vitamin"	Product keyword to search for on Walgreens
url	String	No	--	Direct Walgreens URL (search results or category page)
results_wanted	Integer	No	20	Maximum number of products to collect
max_pages	Integer	No	10	Safety cap on number of result pages to scrape
sort	Select	No	"relevance"	Sort order for search results
proxyConfiguration	Object	No	Apify Proxy	Proxy settings for reliable data collection

---

Output Data

Each item in the dataset contains:

Field	Type	Description
productId	String	Unique product identifier
title	String	Product display name
brand	String	Brand name
price	String	Current price
salePrice	String	Sale or discounted price
regularPrice	String	Regular price
onSale	Boolean	Whether the product is on sale
imageUrl	String	Product image URL
productUrl	String	Direct link to product page
category	String	Product category
size	String	Product size or volume
retailUnitQty	String	Retail unit quantity
reviewCount	Number	Number of customer reviews
averageRating	Number	Average customer rating
upc	String	Universal product code
gtin	String	Global trade item number
storeInventoryStatus	String	Store inventory availability
shippingEligible	Boolean	Whether the product can ship
pickupEligible	Boolean	Whether the product supports pickup
sameDayEligible	Boolean	Whether the product supports same-day fulfillment
addToCart	Boolean	Whether the product can be added to cart
sku	String	Stock keeping unit
description	String	Product description
ingredients	Array	Ingredient groups when available
warnings	String	Product warning text when available
offers	Array	Product offer and promotion details
deal	String	Primary visible deal or savings message
shippingWeight	Number	Shipping weight in pounds
ageRestricted	Boolean	Whether the item has an age restriction
onlineRedemption	Object	Online coupon redemption details when available

---

Usage Examples

Basic Keyword Search

Search for products by keyword:

{
    "keyword": "vitamin d",
    "results_wanted": 50
}

Category Page Scraping

Use a direct category URL for targeted scraping:

{
    "url": "https://www.walgreens.com/store/c/productlist/N=20000944",
    "results_wanted": 100,
    "max_pages": 5
}

Full Configuration

Maximum control with all options:

{
    "keyword": "ibuprofen",
    "results_wanted": 200,
    "max_pages": 20,
    "sort": "top_sellers",
    "proxyConfiguration": {
        "useApifyProxy": true,
        "apifyProxyGroups": ["RESIDENTIAL"]
    }
}

---

Sample Output

{
    "productId": "prod6089370",
    "title": "Vitamin D3 2000 IU Softgels",
    "brand": "Walgreens",
    "price": "$8.99",
    "salePrice": "$6.99",
    "regularPrice": "$8.99",
    "onSale": true,
    "imageUrl": "https://pics.walgreens.com/prodimg/508499/155.jpg",
    "productUrl": "https://www.walgreens.com/store/c/vitamin-d3-2000-iu-softgels/ID=prod6089370-product",
    "category": "Vitamins & Supplements",
    "size": "200 count",
    "reviewCount": 1247,
    "averageRating": 4.5,
    "upc": "311917150345",
    "storeInventoryStatus": "In Stock",
    "sku": "sku6080848",
    "shippingEligible": true,
    "pickupEligible": false,
    "sameDayEligible": true,
    "deal": "Buy 1, Get 1 FREE",
    "addToCart": true
}

---

Tips for Best Results

Choose Effective Keywords

• Start with broad search terms to discover available products
• Use specific product names for targeted extraction
• Try different keyword variations to cover product categories

Optimize Collection Size

• Start with results_wanted: 20 for quick testing
• Increase to 100-500 for production runs based on your needs
• Adjust max_pages to control scraping depth

Proxy Configuration

• Use residential proxies for reliable access to Walgreens
• Enable Apify Proxy in regions that match your target market
• Start with default proxy settings for most use cases

---

Integrations

Connect your data with:

• Google Sheets - Export product data for collaborative analysis
• Airtable - Build searchable product databases
• Make - Create automated workflows and data pipelines
• Zapier - Trigger actions based on scraping results
• Webhooks - Send data to custom endpoints in real time

Export Formats

• JSON - For developers and API integrations
• CSV - For spreadsheet analysis and reporting
• Excel - For business reporting and presentations
• XML - For system integrations and data exchange

---

Frequently Asked Questions

How many products can I collect?

You can collect thousands of products in a single run. The practical limit depends on the available results for your keyword or category URL.

Can I scrape specific product categories?

Yes. Use a category URL as the url parameter to scrape specific departments or product categories on Walgreens.

What if some fields are missing?

Not all products have every attribute. Fields like upc, salePrice, or description may be empty if the source page does not provide that information. The scraper only includes fields with available data.

Does this work with Walgreens pharmacy products?

The scraper focuses on retail products available through Walgreens.com search. Some pharmacy- restricted items may not be accessible.

How fast is the scraping?

Performance depends on your proxy quality, network conditions, and the number of results requested. Typical runs collect 20-50 products per minute with residential proxies.

Can I schedule regular runs?

Yes. Apify supports scheduling for recurring data collection. Set up daily or weekly runs to track price changes and inventory updates.

---

Support

For issues or feature requests, contact support through the Apify Console.

Resources

• Apify Documentation
• API Reference
• Scheduling Runs

---

Legal Notice

This actor is designed for legitimate data collection purposes. Users are responsible for ensuring compliance with website terms of service and applicable laws. Use data responsibly and respect rate limits.