Openaq Pollution Scraper

Scrapes food and nutrition data from the USDA FoodData Central API. Search for any food item and retrieve detailed nutritional information including calories, protein, fat, and carbohydrate content. The API covers branded foods, survey foods, foundation foods, and SR legacy foods from the United ...

Scrapes historical weather data from the Open-Meteo archive API. Access daily temperature maximums, minimums, precipitation totals, and wind speed data for any location on Earth by specifying latitude, longitude, and a date range. The free API requires no authentication and provides high-quality ...

Scrapes geographic place data from the GeoNames API, one of the largest geographical databases available. Search for mountains, cities, landmarks, and other geographic features worldwide. Returns detailed information including coordinates, population, country, administrative divisions, and featur...

Parses and extracts structured data from RSS and Atom feeds. Provide one or more feed URLs and the actor will fetch each feed, parse all items, and output a normalized dataset with titles, links, dates, authors, content snippets, and categories. Supports both RSS 2.0 and Atom feed formats. Ideal ...

Converts web pages into clean Markdown format. For each provided URL, the actor fetches the HTML content, extracts the main body, and converts HTML elements to their Markdown equivalents including headers, links, lists, bold and italic text, images, and paragraphs. Outputs the page title, convert...

Scrapes natural event data from the NASA EONET (Earth Observatory Natural Event Tracker) API. Access real-time information about active wildfires, severe storms, volcanic eruptions, sea and lake ice events, and other natural phenomena tracked by NASA. The API provides event titles, geographic coo...

Checks Cross-Origin Resource Sharing (CORS) policies for multiple URLs in bulk. For each URL, the actor sends both an OPTIONS preflight request and a regular GET request, then analyzes the response headers to determine CORS configuration. Reports Access-Control-Allow-Origin, Allow-Methods, Allow-...

Extracts JSON-LD structured data markup from web pages. For each provided URL, the actor fetches the HTML content, finds all script tags with type "application/ld+json", parses the JSON content, and outputs structured schema.org data including schema types, names, descriptions, and the raw schema...

Extracts social media profile links from web pages. For each provided URL, the actor fetches the HTML content and scans all anchor tags to identify links to major social media platforms including Twitter/X, Facebook, LinkedIn, Instagram, YouTube, GitHub, TikTok, Pinterest, Mastodon, and Threads. ...

Zendesk to RAG Markdown Scraper

inclusive_insect/Zendesk-to-RAG-Markdown-Pipeline

Crawl any Zendesk Help Center and extract pristine, semantic Markdown optimized for LLMs, RAG pipelines, and Vector Databases. Automatically strips HTML junk, navigation bars, and footers to provide high-accuracy AI training data.