Pinecone Integration avatar

Pinecone Integration

Try for free

No credit card required

View all Actors
Pinecone Integration

Pinecone Integration

apify/pinecone-integration
Try for free

No credit card required

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Do you want to learn more about this Actor?

Get a demo
CU

Reduce Input and output token sizes for pinecone integration

Closed

Custombizio opened this issue
2 months ago

See attached file. I am trying to integrate WCC with Pinecone to send the vector files to Pinecone.

jiri.spilka avatar

Thank you for your interest in the Pinecone integration!

This issue occurs when the text is too long to compute text embeddings. To resolve this, you need to split the data into smaller sections, called chunks. The parameters chunkSize and chunkOverlap are crucial for this process. The ideal settings will depend on your use case, as proper chunking can optimize retrieval and improve response accuracy.

Please enable performChunking and set the values according to your needs:

1{
2  "performChunking": true,
3  "chunkSize": 2000,
4  "chunkOverlap": 200
5}

You can find more information in the Actor documentation or the Pinecone documentation.

I'll close the issue now. Let me know if you have any further questions.

Developer
Maintained by Apify

Actor Metrics

  • 42 monthly users

  • 19 stars

  • 87% runs succeeded

  • 5.8 days response time

  • Created in Jun 2024

  • Modified 4 days ago