No credit card required

GCP Uploader

circ_le/gcp-uploader

Try for free

No credit card required

Upload datasets and KV store records to Google cloud storage

GCP Service account key

keystringRequired

Service account key in the JSON format.

Bucket name

bucketNamestringRequired

Upload path

uploadPathstringOptional

Path where files should be uploaded to. If not provided, files will be uploaded to the root of the bucket. Example: 'my-folder/my-subfolder'

Dataset ID

datasetIdstringOptional

Dataset format

datasetFormatEnumOptional

Value options:

"json": string"jsonl": string"xml": string"html": string"csv": string"xlsx": string"rss": string

File name

fileNamestringOptional

File name to be uploaded to the bucket, otherwise the dataset ID will be used.

Key-value store ID

kvStoreIdstringOptional

Key-value store record regex

kvStoreRegexstringOptional

Only records matching this regex will be uploaded to the key-value store.

Transform file name function

transformFileNameFunctionstringOptional

Function that creates the name of the uploaded file from the record key. It receives the record key as an argument and must return the new file name.

Compression

compressionEnumOptional

Value options:

"none": string"gzip": string"zip": string

Developer

Cir◎cle

Actor Metrics

4 monthly users
3 stars
>99% runs succeeded
Created in Jan 2024
Modified 2 months ago

Categories

Automation

Developer tools

Integrations

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

29.8k

775

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.8k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

72.8k

282

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.8k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

4.6k

103

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

26.5k

198

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.2k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.2k