Pricing

$2.00 / 1,000 1,000 rows converteds

Try for free

Go to Apify Store

Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery

Try for free

Apify exports JSON, CSV and Excel but not Parquet. Pick any dataset and get typed Parquet files (inferred schema, flattened nested fields, detected timestamps) in the key-value store, optionally pushed to S3, R2 or Google Cloud Storage. Ready for DuckDB, BigQuery, Athena.

Pricing

$2.00 / 1,000 1,000 rows converteds

Rating

0.0

(0)

Developer

mohamed alaya

Actor stats

Bookmarked

Total users

Monthly active users

16 days ago

Last modified

Categories

Developer tools

Automation

Other

You can access the Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "rows": [],
12    "rowsCsv": "",
13    "fileName": "dataset",
14    "nestedFields": "flatten",
15    "rowsPerFile": 250000,
16    "maxRows": 1000000,
17    "s3Bucket": "",
18    "s3Region": "us-east-1",
19    "s3KeyPrefix": "",
20    "s3Endpoint": "",
21    "gcsBucket": "",
22    "gcsKeyPrefix": ""
23};
24
25// Run the Actor and wait for it to finish
26const run = await client.actor("that_red_bird/dataset-to-parquet").call(input);
27
28// Fetch and print Actor results from the run's dataset (if any)
29console.log('Results from dataset');
30console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
31const { items } = await client.dataset(run.defaultDatasetId).listItems();
32items.forEach((item) => {
33    console.dir(item);
34});
35
36// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Export Dataset to Parquet - DuckDB & BigQuery API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery API in Python

Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery API through CLI

Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery OpenAPI definition

Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery API

Dataset Cleaner & Exporter

nerolabs/dataset-cleaner-exporter

Returns a deduplicated, flattened and cleaned copy of any Apify dataset, file or Google Sheet by URL, or JSON array, plus CSV and Excel files, named-dataset append and webhook delivery. Inputs: source, dedup keys, flatten, cleaning options. Agent-ready: pay per event (x402, MCP), per cleaned record.

Adam Pearce

Yet Another Dataset Translator

mvolfik/yet-another-dataset-translator

Actor to translate datasets with field selection and source language detection. Requires Google Translate API Key.

Matěj Volf

Apify Smart Dataset Comparator

agenscrape/apify-smart-dataset-comparator

Compare 2-10 Apify datasets to detect changes, new/removed records, and duplicates. Features field-level diffs, smart merging, schema validation, data cleaning, and anomaly detection. Perfect for price monitoring, lead deduplication, and data quality tracking.

Agenscrape

Dataset Validity Checker

equidem/Dataset-Validity-Checker

Automatically checks, whether default datasets created by runs of an actor differ too much from the previously encountered ones, allowing it to warn you about web scraping problems caused by, e.g., a website layout changing, or other significant changes in the resulting data.

Matěj Sochor

Airtable Exporter

jupri/airtable

💫 Export Dataset to Airtable

cat

209

1.0

(2)

Kafka Integration

brasil-scrapers/kafka-integration

This integration facilitates the processing of data from an Apify dataset and its delivery to a Kafka topic. It is configured via a schema that includes details about the dataset, Kafka configuration, and batch processing size.

Brasil Scrapers

Output to Dataset

njoylab/apify-output-to-dataset

Merges outputs from multiple actors into a single dataset. Execute actors in series or parallel, combine data from datasets, key-value stores, webhooks, and export the final output in various formats.

njoylab

DuckDB Helper – SQL over CSV, JSON, Parquet, Excel, SQLite

rl1987/duckdb-wrapper

Run a DuckDB SQL query over remote or local input files (CSV, JSON/NDJSON, Parquet, Excel, Avro, SQLite, and more) and push the results to a dataset.

R.L.

Merge Datasets & Remove Duplicates: Combine Runs, CSVs, Sheets

nerolabs/dataset-merge-dedupe

Returns one de-duplicated list from many Apify datasets, CSV, Excel or JSON files and Google Sheets, with blanks filled from the copies and each row's source labelled. Inputs: datasetIds, fileUrls, dedupKeys. Charged per merged row written ($0.001). Agent-ready via x402 and MCP.

Adam Pearce

Website to RAG Chunks - Re-crawl and Update Only What Changed

that_red_bird/website-to-rag-incremental

Stop re-embedding your whole site. Crawl docs or any site into heading-aware, token-counted RAG chunks; on re-runs get only new and changed chunks plus the ids to delete from your vector DB. Sitemap and robots.txt aware. JSON, JSONL, Markdown. No embedding or API key.