You can access the web-scrape-data programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{
<  "categoryOrProductUrls": [
<    {
<      "curl": "https://www.amazon.com/s?k=keyboard"
<    }
<  ]
<}' |
<apify call angelbabyai123/my-actor --silent --output-dataset

web-scrape-data API through CLI

The Apify CLI is the official tool that allows you to use web-scrape-data locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

$npm i -g apify-cli
$apify login

Other API clients include:

web-scrape-data API in Python

web-scrape-data API in JavaScript

web-scrape-data OpenAPI definition

web-scrape-data API

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram hashtags data. Just add one or more hashtags and extract posts, images, URLs, comments, likes, users, locations, timestamps, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

27K

4.6

(22)

YouTube Video Subtitles (captions) Scraper

genial_candlestand/youtube-subtitles-scraper

Extract subtitles (captions) from one or multiple YouTube videos. Download YouTube video subtitles (captions) as a HTML, JSON, CSV, Excel, or XML doc.

Flowo

566

1.0

(1)

General Purpose Web Scraping and Metadata Extraction

moving_beacon-owner1/my-actor-10

This project uses the Apify platform to scrape data from web pages, collect metadata, and store results in an Apify dataset. It features functions for managing date ranges, encoding identifiers, and handling large datasets, aiming to efficiently extract and store structured data for analysis.

Jamshaid Arif

Instant web data scraper - Scrape any website

curious_coder/instant-web-scraper

Scrape any public and private website data by providing just URL and optionally cookies and proxy information. This scraper is similar to instant data scraper but runs on cloud and can be used as API too!

Curious Coder

1.5K

3.6

(2)

Selenium with wait

decorative_quorum/selenium-with-wait

Runs a simple selenium-based scrape of a site, but waits a given amount of time for the broswer to load the page

José Eduardo Piña Castro

Upwork Jobs Scraper Pro

getdataforme/upwork-jobs-scraper-pro

Upwork Jobs Scraper Pro, monitors and discovers relevant Upwork job opportunities. Get instant notifications when new listings that match your profile and skillset are posted, so you never miss an opportunity to connect with potential clients and expand your freelance career.

GetDataForMe

1.9

(3)

Etsy Seller Info Scraper

getdataforme/etsy-seller-info-scraper

An Etsy Seller Info Scraper is a tool that collects publicly available data from Etsy seller profiles and shops. It extracts information such as shop name, number of sales, ratings, location, product listings, and shop descriptions. This data is useful for market research among successful sellers.

GetDataForMe

Scrape Alibaba Products

shareze001/scrape-alibaba-item

Scrape product information from the product details page, product category page. The product category page includes `productgrouplist`, `featureproductlist`, `productlist`, etc. Currently using an excellent proxy tool, making data scraping more stable.

shareze

Scrape Alibaba Suppliers

shareze001/scrape-alibaba-suppliers

Obtain a list of Alibaba suppliers using a keyword or Search URL.

shareze

Google Maps Scraper

avtorizer/google-maps-scraper

Sends the requests to the Google Maps search using a built-in proxy network.

Aleksandr Vikhorev

Walmart Review Crawler

webscrapewizard/walmart-review-crawler

Extract all reviews from each review page. For each review, capture and output the following information: URL, product name, product link, total number of reviews, average product rating, review location, review rating, publication date, review text, review title, author name, and original source.