Pinecone Integration avatar

Pinecone Integration

Try for free

No credit card required

Go to Store
Pinecone Integration

Pinecone Integration

apify/pinecone-integration
Try for free

No credit card required

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Do you want to learn more about this Actor?

Get a demo
OB

MetadataDatasetFields mapping doesn't support array of fields for combining multiple source fields

Open

obscur0x opened this issue
a month ago

When trying to combine multiple source fields into a single metadata field using an array syntax in metadataDatasetFields, the Actor fails with the error: "'list' object has no attribute 'split'".

Current behavior:

  • Single field mapping works: "address": "ubicationAddress" successfully maps the field
  • Combined fields fail: "address": ["ubicationAddress", "address"] throws an error
  • Alternative syntax "address": "ubicationAddress, address" results in empty field

Expected behavior:

  • Should be able to combine multiple source fields into a single metadata field using array syntax
  • Example: "address": ["ubicationAddress", "address"] should combine both fields into the address metadata field

This functionality would be useful for cases where we need to combine multiple fields from the source data into a single metadata field, such as combining street address with location data.

Steps to reproduce:

  1. Set up an Actor with metadata mapping
  2. Configure metadataDatasetFields with array syntax:
1{
2  "metadataDatasetFields": {
3    "address": ["ubicationAddress", "address"]
4  }
5}
jiri.spilka avatar

Hi, thank you for your interest in the Pinecone integration!

And thank you for providing excellent explanations and examples. As you’ve discovered, this functionality is not currently supported. I agree that this combination could be useful in certain cases, but a similar result can be achieved using two fields:

1{
2  "metadataDatasetFields": {
3    "ubicationAddress": "ubicationAddress",
4    "address": "address"
5  }
6}

Why can't you use two fields in metadata?

Using your suggested syntax might complicate the setup, and it would only allow for a simple concatenation.

This is the first request for this kind of field combination. I’ve copied this issue to GitHub as a "nice-to-have" feature.

Developer
Maintained by Apify

Actor Metrics

  • 30 monthly users

  • 19 stars

  • 92% runs succeeded

  • 22 days response time

  • Created in Jun 2024

  • Modified 6 days ago