3 days trial then $4.99/month - No credit card required now

JP Castnet Gu Global Scraper

styleindexamerica/jp-gu-global-scraper

Try for free

3 days trial then $4.99/month - No credit card required now

Actor intended to scraper products from https://www.gu-global.com/jp/ja/

TypeScript Crawlee & CheerioCrawler template

A template example built with Crawlee to scrape data from a website using Cheerio wrapped into CheerioCrawler.

Included features

Apify SDK - toolkit for building Actors
Crawlee - web scraping and browser automation library
Input schema - define and easily validate a schema for your Actor's input
Dataset - store structured data where each object stored has the same attributes
Cheerio - a fast, flexible & elegant library for parsing and manipulating HTML and XML

How it works

This code is a TypeScript script that uses Crawlee CheerioCralwer framework to crawl a website and extract the data from the crawled URLs with Cheerio. It then stores the website titles in a dataset.

The crawler starts with URLs provided from the input startUrls field defined by the input schema. Number of scraped pages is limited by maxPagesPerCrawl field from input schema.
The crawler uses requestHandler for each URL to extract the data from the page with the Cheerio library and to save the title and URL of each page to the dataset. It also logs out each result that is being saved.

Resources

Video tutorial on building a scraper using CheerioCrawler
Written tutorial on building a scraper using CheerioCrawler
Web scraping with Cheerio in 2023
How to scrape a dynamic page using Cheerio
TypeScript vs. JavaScript: which to use for web scraping?
Integration with Zapier, Make, Google Drive and others
Video guide on getting scraped data using Apify API
A short guide on how to build web scrapers using code templates:

Getting started

For complete information see this article. To run the actor use the following command:

apify run

Deploy to Apify

Connect Git repository to Apify

If you've created a Git repository for the project, you can easily connect to Apify:

Go to Actor creation page
Click on Link Git Repository button

Push project on your local machine to Apify

You can also deploy the project on your local machine to Apify without the need for the Git repository.

Log in to Apify. You will need to provide your Apify API Token to complete this action.
```
apify login
```
Deploy your Actor. This command will deploy and build the Actor on the Apify Platform. You can find your newly created Actor under Actors -> My Actors.
```
apify push
```

Documentation reference

To learn more about Apify and Actors, take a look at the following resources:

Developer

PopinBorder Castnet

Actor metrics

3 monthly users
1 star
100.0% runs succeeded
Created in Oct 2023
Modified 19 days ago

Categories

E-commerce

Facebook Ads Scraper

apify/facebook-ads-scraper

Extract advertising data from one or multiple Facebook Pages. Get page details, reach estimates, publisher platforms, report count, number of impressions, ad IDs, timestamps, and more. Download Facebook ads data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

5.3k

Amazon Reviews Scraper

junglee/amazon-reviews-scraper

Amazon scraper to extract reviews from Amazon products. Scrape and download detailed reviews without using the Amazon API, including rating score, review description, reactions and images. Download your data as HTML table, JSON, CSV, Excel, XML.

Junglee

3.1k

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

3.5k

Google Maps Reviews Scraper

compass/Google-Maps-Reviews-Scraper

Extract all reviews of Google Maps places using place URLs. Get review text, published date, response from owner, review URL, and reviewer's details. Download scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Compass

4.1k

🔥Vinted Scraper

bebity/vinted-premium-actor

🚀 Vinted Data Scraper: Fast & Robust! 🔥 🛒 Items and catalogs 👥 User profiles with stats and balances 🏷️ Brands 🌟 Seamlessly integrate with Apify for unparalleled performance & insights. Elevate your business now!🌟 🔥 Power of direct API access for ultra-fast data extraction in a flash! ⚡

Bebity

139

Facebook marketplace scraper

curious_coder/facebook-marketplace

Scrape facebook marketplace listings and export data to CSV, JSON or use as API

Curious Coder

548

Google Shopping Insights

epctex/google-shopping-scraper

Unlock valuable insights from Google Shopping with our Data Extractor. Get reviews, descriptions, prices, merchant details, and affiliation links. Export data in JSON, XML, CSV, Excel, and HTML formats with no limits!

epctex

1.7k

Walmart Data Extractor

epctex/walmart-scraper

Access a vast array of product data from Walmart with our Walmart Scraper. Extract images, brand details, prices, variations, and more. Customize your search with filters, categories, and lists to gather the information you need.

epctex

604

eBay Scraper

dtrungtin/ebay-items-scraper

Unofficial eBay API to extract data from eBay based on keywords or categories. Scrape prices, product descriptions, images, location, availability, brand, and more. Download extracted data in structured format and use it in reports, spreadsheets, databases, and applications.

Tin Duong

841

Amazon Product Scraper

junglee/Amazon-crawler

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

Junglee

7.3k