# Changelog of OpenSearch Integration (`apify/opensearch-integration`) Actor

- **URL**: https://apify.com/apify/opensearch-integration/changelog.md
- **Full Actor documentation**: https://apify.com/apify/opensearch-integration.md

## Change Log

### 0.1.10 (2025-02-24)

- `embeddingBatchSize`: (only Pinecone) batch size for embedding texts. Default: `1000`, Minimum: `1`.

- `usePineconeIdPrefix`: (only Pinecone) Optimizes delta updates with a Pinecone ID prefix (`item_id#chunk_id`) when `enableDeltaUpdates` is `true`. Works only when database is empty.

- **New parameter `dataUpdatesStrategy`:**
  - Replaces `enableDeltaUpdates`.
  - Automatically set to `deltaUpdates` if `enableDeltaUpdates = true`.
  - Options: `deltaUpdates`, `add`, or `upsert`

- **Renamed `deltaUpdatesPrimaryDatasetFields`:**
  - Now `dataUpdatesPrimaryDatasetFields`.
  - Automatically migrated if the old field is present.

- **Backward Compatibility:**
  - Legacy `enableDeltaUpdates` mappings and `deltaUpdatesPrimaryDatasetFields` are supported.

### 0.1.9 (2025-01-25)

- Convert all fields used for delta updates to strings to avoid issues with different types of data.

### 0.1.8 (2024-12-20)

- Do not create string from metadata fields
- Increase backoff time to 900 seconds (15 minutes) (was 300)
- Add Apify's badge to the README

### 0.1.7 (2024-10-25)

- Increase backoff time to 300 seconds (was 120)

### 0.1.6 (2024-10-04)

- Add retry logic with exponential backoff for Qdrant errors.
- Use Langchain Fake Embeddings for testing.
- Parallelize comparison of crawled data with the database.
- Implement a count() method for Pinecone and Qdrant.

### 0.1.5 (2024-09-30)

- Add retry logic with exponential backoff for Pinecone database to handle rate limiting.

### 0.1.4 (2024-09-24)

- Change `milvusUrl` to `milvusUri`.
- Remove `milvusUsername` and `milvusPassword` as they were moved to the `milvusUri` as part of the URI.

### 0.1.3 (2024-09-11)

- Set `performChunking` to `true` by default as some users were not aware of the setting their runs were failing.

### 0.1.2 (2024-09-04)

- Pinecone - add support to update Pinecone index namespace (Optional arg: `PineconeIndexNamespace`)

### 0.1.1 (2024-07-24)

- Fixed issue with Weaviate database when collection was not created before inserting data.

### 0.1.0 (2024-07-24)

- Introduced the `deleteExpiredObjects` setting to enable or disable the automatic deletion feature.
- Previously, outdated data deletion was tied to the enableDeltaUpdates setting. Now, the deletion feature can be controlled independently.

### 0.0.4 (2024-07-12)

- Add integration to Milvus database (Zilliz)

### 0.0.3 (2024-06-26)

- The key in the metadata dictionary has been refactored from 'id' to 'chunk\_id'. This change was necessitated by the requirements of the Weaviate database.
- A new function, 'get\_by\_item\_id', has been introduced. This function fetches objects from the database, including their ids. With this change, it's no longer necessary to store the 'chunk\_id' in the metadata. However, storing the 'chunk\_id' remains beneficial for referencing chunks within the metadata."

### 0.0.2 (2024-06-24)

- Add PostgreSQL database integration (PGVector integration)

### 0.0.1 (2024-06-20)

- Improved README.md and error messages

### 0.0.0 (2024-05-24)

- Initial import