Hi Tony, that's weird. Can you please verify that you followed all steps outlined here: https://apify.com/apify/pinecone-integration?fpr=7p4wu and here https://docs.apify.com/platform/integrations/pinecone?fpr=7p4wu

The Pinecone integration shows "success", that means that the connection happened. So the integration should work. It's important to know that you explicitly have to tell the integration which dataset to pull from (datasetId), which fields in that dataset to embed (datasetFields) and if you’re doing deltas, which field(s) to use as a unique key (dataUpdatePrimaryDatasetFields). If any of those are missing (or misspelled), it will happily run through all its steps, discover “oh, there’s nothing here,” and exit with zero vectors written (but still show “Success!”).

Can you verify that you have those 3 elements set correctly?

If I send you the playload of the executed integration, you can certainly see what the settings were. Can you then tell me what I need to change about it? I'll just delete the apiKeys. { "chunkOverlap": 100, "chunkSize": 1000, "dataUpdatesPrimaryDatasetFields": [ "url" ], "dataUpdatesStrategy": "deltaUpdates", "datasetFields": [ "text" ], "deleteExpiredObjects": true, "deltaUpdatesPrimaryDatasetFields": [ "url" ], "embeddingsApiKey": ", "embeddingsProvider": "OpenAI", "enableDeltaUpdates": true, "performChunking": true, "pineconeApiKey": "pineconeIndexName": "n8ndocs", "usePineconeIdPrefix": false, "payload": { "userId": "{{userId}}", "createdAt": "{{createdAt}}", "eventType": "{{eventType}}", "eventData": "{{eventData}}", "resource": "{{resource}}" } }

Here's the corrected payload:

{
  "pineconeApiKey": "<YOUR_PINECONE_API_KEY>",
  "pineconeIndexName": "n8ndocs",
  "datasetId": "{{DEFAULT_DATASET_ID}}",
  "datasetFields": ["text"],
  "enableDeltaUpdates": true,
  "deltaUpdatesPrimaryDatasetFields": ["url"],
  "deleteExpiredObjects": true,
  "expiredObjectDeletionPeriodDays": 30,
  "embeddingsApiKey": "<YOUR_OPENAI_API_KEY>",
  "embeddingsProvider": "OpenAI",
  "performChunking": true,
  "chunkSize": 1000,
  "chunkOverlap": 100,
  "usePineconeIdPrefix": false
}

What changed?

• Added "datasetId"
• You misspelled "deltaUpdatesPrimaryDatasetFields"
• Added the optional field "expiredObjectDeletionPeriodDays" if you want automatic pruning of old vectors

Can you try this and see if it works?

Should I add this to the completed playload?

Yes, you should add this to the completed payload.

Pinecone and OpenAi Api Key is uptodate but Nothing happens.