Pricing

Pay per usage

Go to Store

Pinecone Integration

Try for free

Developed by

Apify

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

4.6 (5)

Pricing

Pay per usage

Monthly users

Runs succeeded

>99%

Response time

2.3 days

Last modified

11 days ago

Integrations

Open source

Back to issues Create new issue

It has staring failing, saying chunk size is too big but it is not

Closed

team2 opened this issue

It is just one actor but it keeps happening. I think the api is trying to chunk all 500 chunks in one go.

Jiří Spilka (jiri.spilka)

Hi, thank you for using the Pinecone integration.

The batching logic is handled by the official Pinecone implementation, which computes text embeddings in batches of 1,000.

I'm not sure why your chunk_size is set to 40,000 characters. In most cases, embeddings won't effectively capture the meaning of such long text. If you reduce it to 20,000 (which is still quite long), it should work.

I can also adjust the batch size (if you want), but I suspect the chunk_size might have been an unintentional copy-paste mistake.

Hope this helps!
Jiri

Jiří Spilka (jiri.spilka)

I'll go ahead and close this issue. This is discussed in more details in this issue

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

OpenSearch Integration

apify/opensearch-integration

Transfer data from Apify Actors to Amazon OpenSearch Service. This Actor is a good starting point for building question-answering systems, search functionality, or Retrieval-Augmented Generation (RAG) use cases.

Apify

WCC Pinecone Integration

tri_angle/wcc-pinecone-integration

Crawl any website and store its content in your Pinecone vector database. Enhance the accuracy and reliability of your own AI Assistant with facts fetched from external sources or connect this integration to our Pinecone GPT Chatbot assistant available in Apify Store.

Tri⟁angle

113

Qdrant Integration

apify/qdrant-integration

Transfer data from Apify Actors to a Qdrant vector database.

Apify

PGVector Integration

apify/pgvector-integration

This integration transfers data from Apify Actors to a Postgres SQL database (with PGVector extension).

Apify

Pinecone GPT Chatbot

tri_angle/pinecone-gpt-chatbot

Pinecone GPT Chatbot combines OpenAI's GPT models with Pinecone's database to generate insightful responses. Its interactive chatbot interface presents precise and comprehensive answers to user queries. Benefit from semantic understanding, efficient workflows, and enriched knowledge integration!

Tri⟁angle

OpenAI Vector Store Integration

jiri.spilka/openai-vector-store-integration

The Apify OpenAI Vector Store integration uploads data from Apify Actors to the OpenAI Vector Store linked to OpenAI Assistant.

Jiří Spilka

144

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Apify

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.

Apify

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Apify

Real-time knowledge for LLMs

ai-developer/real-time-knowledge-for-llms

Unlock the Full Potential of Your LLM with Real-Time Web Knowledge! Say goodbye to outdated responses, misinformation, and hallucinations. Now you can ground your Language Model with the freshest information from the web. NO API NEEDED!