Pricing

$2.00 / 1,000 1,000 rows converteds

Try for free

Go to Apify Store

Export Dataset to Parquet - Typed Schema for DuckDB & BigQuery

Try for free

Apify exports JSON, CSV and Excel but not Parquet. Pick any dataset and get typed Parquet files (inferred schema, flattened nested fields, detected timestamps) in the key-value store, optionally pushed to S3, R2 or Google Cloud Storage. Ready for DuckDB, BigQuery, Athena.

Pricing

$2.00 / 1,000 1,000 rows converteds

Rating

0.0

(0)

Developer

mohamed alaya

Actor stats

Bookmarked

Total users

Monthly active users

15 days ago

Last modified

Categories

Developer tools

Automation

Other

Dataset(s) to convert

datasets

Optional

Pick the dataset of any Actor run. Use the picker rather than typing an ID: it gives this Actor permission to read your dataset. Several datasets are appended into one Parquet schema. Leave empty to use the pasted rows below, or the built-in demo.

Type:array

Rows (JSON)

rows

Optional

Optional. Paste rows as JSON objects, e.g. {"id":1,"name":"Ann","tags":["a"]}. Nested objects are flattened by default.

Type:array

Default:

[]

Rows (CSV or JSON text)

rowsCsv

Optional

Optional. Paste a CSV (first row = column names; numbers and true/false are detected) or a JSON array.

Type:string

Default:

Output file name

fileName

Optional

Base name of the Parquet file in the key-value store (.parquet is added). With several files the name gets -part-0001, -part-0002 and so on.

Type:string

Default:dataset

Nested objects

nestedFields

Optional

flatten turns {"a":{"b":1}} into a column a_b (best for BigQuery, Athena, DuckDB). json keeps each top-level nested object as one JSON column. Arrays are always kept as JSON columns.

Type:string

Default:flatten

Options:

flattenjson

Detect timestamps

inferDates

Optional

Columns where every value is an ISO 8601 date or date-time (2026-05-01, 2026-05-01T10:00:00Z) become TIMESTAMP columns. Date-times without a time zone are read as UTC.

Type:boolean

Default:true

Warehouse-safe column names

sanitizeColumnNames

Optional

Replace characters other than letters, digits and underscore with an underscore (BigQuery and Athena require this) and make names unique. Turn off to keep the original names.

Type:boolean

Default:true

Rows per file

rowsPerFile

Optional

Maximum rows in one Parquet file. Bigger datasets are split into several files with the same schema; each file is billed per started 1,000 rows.

Type:integer

Minimum:1000

Maximum:2000000

Default:250000

Maximum rows

maxRows

Optional

Safety limit on the number of rows converted in one run.

Type:integer

Minimum:1

Maximum:20000000

Default:1000000

S3 bucket (optional)

s3Bucket

Optional

Also upload each Parquet file to this Amazon S3 bucket (or any S3-compatible service such as Cloudflare R2, MinIO or Backblaze B2). Needs the access key fields below. The files are always kept in the key-value store too.

Type:string

Default:

S3 region

s3Region

Optional

AWS region of the bucket, for example us-east-1 or eu-west-1. For R2 use auto.

Type:string

Default:us-east-1

S3 key prefix

s3KeyPrefix

Optional

Optional folder inside the bucket, for example scrapes/2026-10/.

Type:string

Default:

S3 access key ID

s3AccessKeyId

Optional

Access key ID of an IAM user that may PutObject into the bucket. Use a key limited to this bucket.

Type:string

S3 secret access key

s3SecretAccessKey

Optional

Secret access key that belongs to the access key ID. Stored encrypted by Apify.

Type:string

S3 session token

s3SessionToken

Optional

Only for temporary credentials (AWS STS). Leave empty otherwise.

Type:string

S3-compatible endpoint

s3Endpoint

Optional

Only for non-AWS services, for example https://.r2.cloudflarestorage.com or https://s3.us-west-004.backblazeb2.com. Leave empty for Amazon S3.

Type:string

Default:

Google Cloud Storage bucket (optional)

gcsBucket

Optional

Also upload each Parquet file to this Google Cloud Storage bucket. Needs the service-account JSON below.

Type:string

Default:

GCS object prefix

gcsKeyPrefix

Optional

Optional folder inside the bucket, for example scrapes/2026-10/.

Type:string

Default:

GCS service-account JSON

gcsServiceAccountJson

Optional

Paste the full JSON key of a service account with Storage Object Creator access to the bucket. Stored encrypted by Apify.

Type:string

Dataset Cleaner & Exporter

nerolabs/dataset-cleaner-exporter

Returns a deduplicated, flattened and cleaned copy of any Apify dataset, file or Google Sheet by URL, or JSON array, plus CSV and Excel files, named-dataset append and webhook delivery. Inputs: source, dedup keys, flatten, cleaning options. Agent-ready: pay per event (x402, MCP), per cleaned record.

Adam Pearce

Yet Another Dataset Translator

mvolfik/yet-another-dataset-translator

Actor to translate datasets with field selection and source language detection. Requires Google Translate API Key.

Matěj Volf

Apify Smart Dataset Comparator

agenscrape/apify-smart-dataset-comparator

Compare 2-10 Apify datasets to detect changes, new/removed records, and duplicates. Features field-level diffs, smart merging, schema validation, data cleaning, and anomaly detection. Perfect for price monitoring, lead deduplication, and data quality tracking.

Agenscrape

Dataset Validity Checker

equidem/Dataset-Validity-Checker

Automatically checks, whether default datasets created by runs of an actor differ too much from the previously encountered ones, allowing it to warn you about web scraping problems caused by, e.g., a website layout changing, or other significant changes in the resulting data.

Matěj Sochor

Airtable Exporter

jupri/airtable

💫 Export Dataset to Airtable

cat

209

1.0

(2)

Kafka Integration

brasil-scrapers/kafka-integration

This integration facilitates the processing of data from an Apify dataset and its delivery to a Kafka topic. It is configured via a schema that includes details about the dataset, Kafka configuration, and batch processing size.

Brasil Scrapers

Output to Dataset

njoylab/apify-output-to-dataset

Merges outputs from multiple actors into a single dataset. Execute actors in series or parallel, combine data from datasets, key-value stores, webhooks, and export the final output in various formats.

njoylab

DuckDB Helper – SQL over CSV, JSON, Parquet, Excel, SQLite

rl1987/duckdb-wrapper

Run a DuckDB SQL query over remote or local input files (CSV, JSON/NDJSON, Parquet, Excel, Avro, SQLite, and more) and push the results to a dataset.

R.L.

Merge Datasets & Remove Duplicates: Combine Runs, CSVs, Sheets

nerolabs/dataset-merge-dedupe

Returns one de-duplicated list from many Apify datasets, CSV, Excel or JSON files and Google Sheets, with blanks filled from the copies and each row's source labelled. Inputs: datasetIds, fileUrls, dedupKeys. Charged per merged row written ($0.001). Agent-ready via x402 and MCP.

Adam Pearce

Website to RAG Chunks - Re-crawl and Update Only What Changed

that_red_bird/website-to-rag-incremental

Stop re-embedding your whole site. Crawl docs or any site into heading-aware, token-counted RAG chunks; on re-runs get only new and changed chunks plus the ids to delete from your vector DB. Sitemap and robots.txt aware. JSON, JSONL, Markdown. No embedding or API key.