Pay $10.00 for 1,000 scrapes

Web Scraping API - Scrape Any Website

zeeb0t/web-scraping-api---scrape-any-website

Pay $10.00 for 1,000 scrapes

Easily capture data from any website with a single API. Forget xPath, manual updates, and broken scrapers—our web scraping API handles it all.

You can access the Web Scraping API - Scrape Any Website programmatically from your own JavaScript applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "url": "https://apify.com/pricing",
12    "method": "getApifyPricingPlans",
13    "output": "{\"plans\":[{\"name\":\"\",\"monthly_price\":\"\",\"prepaid_usage\":\"\",\"compute_units\":\"\",\"actor_ram\":\"\",\"max_concurrent_users\":\"\",\"rented_actors\":\"\"}]}",
14    "proxy_country": ""
15};
16
17// Run the Actor and wait for it to finish
18const run = await client.actor("zeeb0t/web-scraping-api---scrape-any-website").call(input);
19
20// Fetch and print Actor results from the run's dataset (if any)
21console.log('Results from dataset');
22console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
23const { items } = await client.dataset(run.defaultDatasetId).listItems();
24items.forEach((item) => {
25    console.dir(item);
26});
27
28// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Web Scraping API - Scrape Any Website API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Web Scraping API - Scrape Any Website API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

npm install apify-client

Other API clients include:

Web Scraping API - Scrape Any Website API in Python

Web Scraping API - Scrape Any Website API through CLI

Web Scraping API - Scrape Any Website OpenAPI definition

Web Scraping API - Scrape Any Website API

Developer

Anthony Ziebell

Actor Metrics

43 monthly users
5 bookmarks
>99% runs succeeded
Created in Aug 2024
Modified 3 months ago

Categories

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.4k

YouTube Video Subtitles (captions) Scraper

genial_candlestand/youtube-subtitles-scraper

Extract subtitles (captions) from one or multiple YouTube videos. Download YouTube video subtitles (captions) as a HTML, JSON, CSV, Excel, or XML doc.

Flowo

376

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

37.1k

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

28.1k

323

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

Fast YouTube Channel Scraper

streamers/youtube-channel-scraper

This alternative YouTube Data API has no limits or quotas. Use it to scrape one or multiple YouTube channels: channel info, URL, total number of subscribers, videos and views, creation date. Try it and get basic video data. You can download extracted data in JSON, CSV, and Excel.

Streamers

3.4k

143

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

75.1k

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

9.1k

243

Yelp Scraper

tri_angle/yelp-scraper

Free Yelp web scraper to extract data from Yelp. Fast Yelp review scraper, but also gets business details and ratings without using the Yelp API.

Tri⟁angle

3.5k

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.