Pinecone Integration avatar
Pinecone Integration

Pricing

Pay per usage

Go to Store
Pinecone Integration

Pinecone Integration

apify/pinecone-integration

Developed by

Apify

Maintained by Apify

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

4.6 (5)

Pricing

Pay per usage

29

Monthly users

120

Runs succeeded

95%

Response time

4 days

Last modified

14 days ago

TE

It has staring failing, saying chunk size is too big but it is not

Closed
team2 opened this issue
2 months ago

It is just one actor but it keeps happening. I think the api is trying to chunk all 500 chunks in one go.

jiri.spilka avatar

Hi, thank you for using the Pinecone integration.

The batching logic is handled by the official Pinecone implementation, which computes text embeddings in batches of 1,000.

I'm not sure why your chunk_size is set to 40,000 characters. In most cases, embeddings won't effectively capture the meaning of such long text. If you reduce it to 20,000 (which is still quite long), it should work.

I can also adjust the batch size (if you want), but I suspect the chunk_size might have been an unintentional copy-paste mistake.

Hope this helps!
Jiri

jiri.spilka avatar

I'll go ahead and close this issue. This is discussed in more details in this issue

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.