embeddingBatchSize: (only Pinecone) batch size for embedding texts. Default: 1000, Minimum: 1.
usePineconeIdPrefix: (only Pinecone) Optimizes delta updates with a Pinecone ID prefix (item_id#chunk_id) when enableDeltaUpdates is true. Works only when database is empty.
New parameter dataUpdatesStrategy:
- Replaces enableDeltaUpdates.
- Automatically set to deltaUpdates if enableDeltaUpdates = true.
- Options: deltaUpdates, add, or upsert
Renamed deltaUpdatesPrimaryDatasetFields:
- Now dataUpdatesPrimaryDatasetFields.
- Automatically migrated if the old field is present.
Backward Compatibility:
- Legacy enableDeltaUpdates mappings and deltaUpdatesPrimaryDatasetFields are supported.

0.1.9 (2025-01-25)

Convert all fields used for delta updates to strings to avoid issues with different types of data.

0.1.8 (2024-12-20)

Do not create string from metadata fields
Increase backoff time to 900 seconds (15 minutes) (was 300)
Add Apify's badge to the README

0.1.7 (2024-10-25)

Increase backoff time to 300 seconds (was 120)

0.1.6 (2024-10-04)

Add retry logic with exponential backoff for Qdrant errors.
Use Langchain Fake Embeddings for testing.
Parallelize comparison of crawled data with the database.
Implement a count() method for Pinecone and Qdrant.

0.1.5 (2024-09-30)

Add retry logic with exponential backoff for Pinecone database to handle rate limiting.

0.1.4 (2024-09-24)

Change milvusUrl to milvusUri.
Remove milvusUsername and milvusPassword as they were moved to the milvusUri as part of the URI.

0.1.3 (2024-09-11)

Set performChunking to true by default as some users were not aware of the setting their runs were failing.

0.1.2 (2024-09-04)

Pinecone - add support to update Pinecone index namespace (Optional arg: PineconeIndexNamespace)

0.1.1 (2024-07-24)

Fixed issue with Weaviate database when collection was not created before inserting data.

0.1.0 (2024-07-24)

Introduced the deleteExpiredObjects setting to enable or disable the automatic deletion feature.
Previously, outdated data deletion was tied to the enableDeltaUpdates setting. Now, the deletion feature can be controlled independently.

0.0.4 (2024-07-12)

Add integration to Milvus database (Zilliz)

0.0.3 (2024-06-26)

The key in the metadata dictionary has been refactored from 'id' to 'chunk_id'. This change was necessitated by the requirements of the Weaviate database.
A new function, 'get_by_item_id', has been introduced. This function fetches objects from the database, including their ids. With this change, it's no longer necessary to store the 'chunk_id' in the metadata. However, storing the 'chunk_id' remains beneficial for referencing chunks within the metadata."

0.0.2 (2024-06-24)

Add PostgreSQL database integration (PGVector integration)

0.0.1 (2024-06-20)

Improved README.md and error messages

0.0.0 (2024-05-24)

Initial import

OpenAI Vector Store Integration

jiri.spilka/openai-vector-store-integration

This integration uploads data from Apify Actors to the OpenAI Vector Store linked to OpenAI Assistant.

Jiří Spilka

204

4.8

Pinecone Integration

apify/pinecone-integration

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Apify

499

3.2

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.7

Opengauss Integration

wyswyz/opengauss-integration

This integration transfers data from Apify Actors to an openGauss database and is a good starting point for a question-answering, search, or RAG use case.

Y Wang

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.5

OpenSearch Integration

apify/opensearch-integration

Transfer data from Apify Actors to Amazon OpenSearch Service. This Actor is a good starting point for building question-answering systems, search functionality, or Retrieval-Augmented Generation (RAG) use cases.

Apify

4.4

Suumo Scraper

jungle_synthesizer/suumo-scraper

Scrape real estate listings from Suumo.jp

BowTiedRacoon

Advanced Website Domain Name Validator

saswave/advanced-website-domain-name-validator

Advanced domain scraper. Determine if a domain is still valid or has moved. We test multiple scenario before flagging the domain as invalid. Extract technologies stack, social account, emails

SASWAVE

Website To PDF Converter

louisdeconinck/website-to-pdf-converter

Convert websites to high-quality PDF documents with customizable options. This powerful actor allows you to transform website pages with both static HTML and dynamic content into professional-grade PDFs, offering a wide range of customization features such as page format, orientation, margins, …

Louis Deconinck

101

5.0

DineFilter

ohlava/dinefilter

Say what you want to eat and where, we'll find it

Ondřej Hlava

Chroma Integration

Chroma Integration

Change Log

0.1.10 (2025-02-24)

0.1.9 (2025-01-25)

0.1.8 (2024-12-20)

0.1.7 (2024-10-25)

0.1.6 (2024-10-04)

0.1.5 (2024-09-30)

0.1.4 (2024-09-24)

0.1.3 (2024-09-11)

0.1.2 (2024-09-04)

0.1.1 (2024-07-24)

0.1.0 (2024-07-24)

0.0.4 (2024-07-12)

0.0.3 (2024-06-26)

0.0.2 (2024-06-24)

0.0.1 (2024-06-20)

0.0.0 (2024-05-24)

You might also like

OpenAI Vector Store Integration

Pinecone Integration

Weaviate Integration

Opengauss Integration

Milvus Integration

OpenSearch Integration

Suumo Scraper

Advanced Website Domain Name Validator

Website To PDF Converter

DineFilter

Change Log

0.1.10 (2025-02-24)

0.1.9 (2025-01-25)

0.1.8 (2024-12-20)

0.1.7 (2024-10-25)

0.1.6 (2024-10-04)

0.1.5 (2024-09-30)

0.1.4 (2024-09-24)

0.1.3 (2024-09-11)

0.1.2 (2024-09-04)

0.1.1 (2024-07-24)

0.1.0 (2024-07-24)

0.0.4 (2024-07-12)

0.0.3 (2024-06-26)

0.0.2 (2024-06-24)

0.0.1 (2024-06-20)

0.0.0 (2024-05-24)