# Weather Data Extractor (`kawsar/weather-data-extractor`) Actor Extract comprehensive current weather conditions, 24-48h hourly forecasts, 8-15d daily forecasts, and EPA air quality indices from Weather.com by location name, zip code, or URL. Features premium proxy bypass. - **URL**: https://apify.com/kawsar/weather-data-extractor.md - **Developed by:** [Kawsar](https://apify.com/kawsar) (community) - **Categories:** Developer tools, Automation, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $3.90 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Weather Data Extractor The Weather Data Extractor is an enterprise-grade, high-performance web scraping and data integration solution for Weather.com. It is designed to extract real-time meteorology datasets, including comprehensive current conditions, high-resolution 24 to 48-hour hourly forecasts, 8 to 15-day daily forecasts, and EPA global air quality indices for any region, city, zip code, or specific geographic location worldwide. To ensure uninterrupted data extraction and bypass standard anti-bot obstacles (such as Cloudflare challenges, browser fingerprinting, and rate-limiting), this Actor features an **integrated, zero-configuration bypass framework**. The Actor automatically employs intelligent request-level browser emulation and seamlessly escalates requests through a premium, rotating residential proxy network on failure. You do not need to configure any proxies, buy credentials, or manage custom browser headersβ€”all bypass mechanics are handled dynamically under the hood to ensure industry-leading data retrieval success rates. --- ### 🌟 Key Features - **Dynamic Location Resolving & Geocoding**: Input standard query names (such as `Dhaka`, `Marion County, FL`, `90210`, or `London, UK`), and the Actor will automatically query Weather.com's public geocoding API to resolve the exact coordinates and unique `placeId` to target. - **Direct Code Scraping**: Provide raw Weather.com location/station codes for direct, high-speed, and precise coordinate mapping. - **Direct URL Inputs**: Input specific Weather.com pages directly to bypass search entirely and scrape exact targets immediately. - **Current Meteorology Metrics**: Extract 17+ essential metrics including temperature, feels-like, UV index, relative humidity, pressure, visibility, dew point, wind speed/direction, and current conditions phrases. - **High-Resolution Hourly Forecasts**: Retrieve hourly weather conditions, temperature, humidity, precipitation chance, precipitation type, wind cardinal direction, and UV index. - **Extended Daily Forecasts**: Extract 8 to 15-day daily forecasts with Day-part granularity (separate daytime and nighttime metrics for weather phrases, precip probability, wind speeds, and humidity), plus moon phase and exact sunrise/sunset times. - **EPA Global Air Quality Index (AQI)**: Extract real-time air quality index values, primary pollutants, EPA categories, and custom health advisory messages. --- ### πŸš€ Common Use Cases 1. **Travel, Logistics & Supply Chain**: Plan shipping routes and schedule travel by scraping high-resolution hourly and extended daily forecasts for key global transit hubs. 2. **Agriculture & Farm Management**: Optimize irrigation and crop spraying schedules by tracking precise relative humidity, daytime wind speeds, and real-time precipitation chances. 3. **Retail & Demand Forecasting**: Correlate local weather trends (such as heatwaves or incoming storms) with purchase behavior to forecast inventory requirements. 4. **Energy & Resource Planning**: Monitor solar intensity (via UV indices) and heating/cooling demand (via temperature and feels-like indexes) for smart grid optimization. 5. **SEO & Content Automation**: Power localized weather widgets, automated regional weather blogs, or localized marketing campaigns with structured, real-time datasets. --- ### βš™οΈ Input Form Parameters The Actor is configured with a fully customizable, user-friendly input interface on the Apify platform: | Field Name | Type | Required | Default | Description | | :--- | :--- | :--- | :--- | :--- | | `locations` | `array` | No | `["Dhaka", "Marion County, FL"]` | A list of city names, region names, county names, or postal zip codes to search and scrape. | | `locationCodes` | `array` | No | `[]` | A list of raw Weather.com station or location codes for direct lookup. | | `urls` | `array` | No | `[]` | A list of specific Weather.com URLs. | | `maxItems` | `integer` | No | `1000` | The maximum number of location profiles to scrape in a single run. | | `requestTimeoutSecs` | `integer` | No | `30` | The maximum timeout in seconds for fetching and processing each location. | *Note: You must specify at least one location search query, location code, or URL to execute a scraping run.* --- ### πŸ“Š Data Dictionary (Output Fields) When the Actor executes, it pushes flat or nested JSON weather profiles to your Apify default dataset. Below is a detailed description of the extracted keys: #### Metadata & Location Info - `searchQuery`: The original string or code that triggered the task. - `locationCode`: The resolved unique location identifier (place ID) on Weather.com. - `url`: The exact Weather.com target page URL scraped. - `locationName`: The official display name of the location. - `latitude` / `longitude`: Geographic coordinates. - `scrapedAt`: ISO timestamp indicating when the profile was scraped. #### Current Observations (`currentConditions`) - `temperature` / `feelsLike`: Actual temperature and human-perceived temperature (Feels Like). - `temperatureMaxSinceMidnight` / `temperatureMinSinceMidnight`: Temperature highs and lows recorded since 12:00 AM. - `humidity` / `relativeHumidity`: Atmospheric moisture percentage. - `windSpeed` / `windGust`: Current wind speed and gust velocities. - `windDirection` / `windDirectionCardinal`: Wind direction expressed in degrees and cardinal headings (e.g., `NNE`). - `uvIndex` / `uvCategory`: Ultraviolet solar radiation level and its safety classification (e.g., `Extreme`). - `visibility`: Optical visibility distance. - `pressure` / `pressureTendency`: Atmospheric pressure and tendency (e.g., `Falling`). - `dewPoint`: The temperature at which water vapor condenses. - `weatherPhrase`: Text description of current sky conditions (e.g., `Haze`, `Partly Cloudy`). #### Air Quality (`airQuality`) - `aqiValue`: Air Quality Index value. - `aqiCategory`: EPA category classification (e.g., `Unhealthy for Sensitive Groups`). - `primaryPollutant`: Major active pollutant (e.g., `PM2.5`). - `advisoryMessage`: Comprehensive health and safety advisory message. #### Hourly & Daily Lists - `hourlyForecast`: Array of 24 to 48 sequential hourly entries containing weather phrases, precipitation probability (`precipChance`), precip type (`rain` or `snow`), humidity, and wind details. - `dailyForecast`: Array of 8 to 15-day sequential daily forecast blocks containing daytime and nighttime weather phrases, temperatures, relative humidity, wind speeds, moon phases, and exact sunrise and sunset times. --- ### πŸ“₯ Sample JSON Payload Below is an example of a complete weather dataset output item generated by this Actor: ```json { "searchQuery": "Dhaka", "locationCode": "f370fc9f1e5d07401a72fab32be4e1abe8f8f9df412cbaef3110e44cbf45cc56", "url": "https://weather.com/weather/today/l/f370fc9f1e5d07401a72fab32be4e1abe8f8f9df412cbaef3110e44cbf45cc56", "locationName": "Dhaka", "latitude": 23.764, "longitude": 90.389, "scrapedAt": "2026-06-09T06:04:34.264361Z", "currentConditions": { "temperature": 86, "feelsLike": 99, "temperatureMaxSinceMidnight": 88, "temperatureMinSinceMidnight": 82, "humidity": 76, "windSpeed": 7, "windGust": null, "windDirection": 30, "windDirectionCardinal": "NNE", "uvIndex": 11, "uvCategory": "Extreme", "visibility": 2.2, "pressure": 29.59, "pressureTendency": "Falling", "dewPoint": 78, "weatherPhrase": "Haze", "relativeHumidity": 76 }, "airQuality": { "aqiValue": 103, "aqiCategory": "Unhealthy for Sensitive Groups", "primaryPollutant": "PM2.5", "advisoryMessage": "Members of sensitive groups may experience health effects. The general public is not likely to be affected." }, "hourlyForecast": [ { "time": "2026-06-09T13:00:00+0600", "epochTime": 1780988400, "temperature": 87, "feelsLike": 100, "weatherPhrase": "Scattered Thunderstorms", "precipChance": 65, "precipType": "rain", "humidity": 75, "windSpeed": 6, "windDirectionCardinal": "SSE", "uvIndex": 7 } ], "dailyForecast": [ { "dayOfWeek": "Tuesday", "date": "2026-06-09T07:00:00+0600", "epochTime": 1780966800, "temperatureMax": 89, "temperatureMin": 80, "weatherPhraseDay": "Thunderstorms", "weatherPhraseNight": "Mostly Cloudy", "precipChanceDay": 100, "precipChanceNight": 24, "windSpeedDay": 11, "windSpeedNight": 9, "humidityDay": 74, "humidityNight": 86, "sunrise": "2026-06-09T05:10:51+0600", "sunset": "2026-06-09T18:44:31+0600", "moonPhase": "Waning Crescent" } ] } ```` *** ### πŸ”Œ Integrations & Webhooks Since all datasets are stored directly in your Apify Cloud account, you can easily sync and stream this data to your favorite platforms: - **Webhooks**: Configure a webhook to automatically send POST payloads of scraped weather forecasts to your custom REST API or serverless endpoints whenever a run finishes. - **Zapier / Make**: Trigger automated workflows that export scraped daily datasets directly to Google Sheets, Airtable, Notion, SQL databases, or email digests. - **Direct API Access**: Query the dataset directly via REST endpoints using JSON, CSV, XML, or Excel formats. *** ### πŸ›‘οΈ License, Reliability & Support - This Actor is designed to retrieve publicly accessible state hydration payloads from Weather.com. Please keep workloads and request frequencies respectful of source guidelines. - If you notice any data structure updates on Weather.com or need additional meteorological fields, please file a ticket under the **Issues** tab. # Actor input Schema ## `locations` (type: `array`): List of cities, counties, or regions to search and extract weather data for (e.g., 'Dhaka', 'Marion County, FL', 'London'). ## `locationCodes` (type: `array`): List of raw Weather.com location codes (e.g., 'f370fc9f1e5d07401a72fab32be4e1abe8f8f9df412cbaef3110e44cbf45cc56'). Use this for precise mapping. ## `urls` (type: `array`): List of full Weather.com URLs (e.g., 'https://weather.com/weather/today/l/f370fc9f1e5d07401a72fab32be4e1abe8f8f9df412cbaef3110e44cbf45cc56'). ## `maxItems` (type: `integer`): Maximum number of weather profiles/locations to extract. ## `requestTimeoutSecs` (type: `integer`): The timeout in seconds for each HTTP request to the integrated proxy bypass network. ## Actor input object example ```json { "locations": [ "Dhaka", "Marion County, FL" ], "locationCodes": [], "urls": [], "maxItems": 1000, "requestTimeoutSecs": 30 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "locations": [ "Dhaka", "Marion County, FL" ], "locationCodes": [], "urls": [] }; // Run the Actor and wait for it to finish const run = await client.actor("kawsar/weather-data-extractor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "locations": [ "Dhaka", "Marion County, FL", ], "locationCodes": [], "urls": [], } # Run the Actor and wait for it to finish run = client.actor("kawsar/weather-data-extractor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "locations": [ "Dhaka", "Marion County, FL" ], "locationCodes": [], "urls": [] }' | apify call kawsar/weather-data-extractor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=kawsar/weather-data-extractor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Weather Data Extractor", "description": "Extract comprehensive current weather conditions, 24-48h hourly forecasts, 8-15d daily forecasts, and EPA air quality indices from Weather.com by location name, zip code, or URL. Features premium proxy bypass.", "version": "0.0", "x-build-id": "U0YvetRTdKyaJOi6W" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/kawsar~weather-data-extractor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-kawsar-weather-data-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/kawsar~weather-data-extractor/runs": { "post": { "operationId": "runs-sync-kawsar-weather-data-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/kawsar~weather-data-extractor/run-sync": { "post": { "operationId": "run-sync-kawsar-weather-data-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "locations": { "title": "Locations (City, County, Region Names)", "type": "array", "description": "List of cities, counties, or regions to search and extract weather data for (e.g., 'Dhaka', 'Marion County, FL', 'London').", "items": { "type": "string" } }, "locationCodes": { "title": "Location Codes", "type": "array", "description": "List of raw Weather.com location codes (e.g., 'f370fc9f1e5d07401a72fab32be4e1abe8f8f9df412cbaef3110e44cbf45cc56'). Use this for precise mapping.", "items": { "type": "string" } }, "urls": { "title": "Weather.com URLs", "type": "array", "description": "List of full Weather.com URLs (e.g., 'https://weather.com/weather/today/l/f370fc9f1e5d07401a72fab32be4e1abe8f8f9df412cbaef3110e44cbf45cc56').", "items": { "type": "string" } }, "maxItems": { "title": "Max Items", "minimum": 1, "type": "integer", "description": "Maximum number of weather profiles/locations to extract.", "default": 1000 }, "requestTimeoutSecs": { "title": "Request Timeout (Seconds)", "minimum": 5, "type": "integer", "description": "The timeout in seconds for each HTTP request to the integrated proxy bypass network.", "default": 30 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```