Deprecated

Pricing

$5.00/month + usage

See alternative Actors

Go to Store

Weaviate Integration

Deprecated

See alternative Actors

Developed by

Datastorm

Easily integrate Apify & Weaviate Push selected fields from Apify Actor into any Weaviate class. If the Weaviate class does not exist the integration will created it. Efficient & user-friendly data handling solution.

0.0 (0)

Pricing

$5.00/month + usage

Total users

Monthly users

Last modified

2 years ago

Developer tools

Automation

Streamline your data operations effortlessly with the integration of Apify and Weaviate. Now, you can effortlessly push selected fields from your Apify Actor directly into any Weaviate class. If the class doesn't currently exist, the integration will automatically create it for you.

Input Fields

Weaviate Class

A class describes a data object, such as in the form of a noun (e.g., Person, Product, Timezone) or a verb (e.g., Move, Buy, Eat). Classes are always written with a capital letter first. This helps in distinguishing classes from primitive data types when used in properties. For example, dataType: ["text"] means that a property is a text, whereas dataType: ["Text"] means that a property is a cross-reference type to a class named Text.

Reference: https://weaviate.io/developers/weaviate/config-refs/schema

Weaviate API Token

Weaviate Host (don't include https. Example: test-data-stzpe1a0.weaviate.network)

OpenAI API Token

Open AI Api Token is used for Vector Embeddings

Field Mappings

Field Mappings between Dataset and Weaviate Class.

datasetColumnName: Name of the column in the Apify Dataset.
dbPropertyName: Name of property in Weaviate Class.
isKeyColumn: Is this column the ID for the Weaviate row.
isMetadata: is this a metadata column. If false then the column will be converted to vector embeddings.

Example:

{
    "datasetColumnName": "url",
    "dbPropertyName": "key",
    "isKeyColumn": true,
    "isMetadata": true,
    "dataType": ["text"]
},
{
    "datasetColumnName": "pageTitle",
    "dbPropertyName": "pageTitle",
    "isKeyColumn": false,
    "isMetadata": false,
    "dataType": ["text"]
}

Output Fields

The output dataset contains the following fields

numberOfDocuments

Number of Documents sent to Weaviate

totalSeconds

Total time in seconds for the actor to run

On this page

Weaviate Integration
- Input Fields
- Output Fields
  - numberOfDocuments
  - totalSeconds

Share Actor:

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.7

Pinecone Integration

apify/pinecone-integration

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Apify

418

3.8

Kafka Integration

brasil-scrapers/kafka-integration

This integration facilitates the processing of data from an Apify dataset and its delivery to a Kafka topic. It is configured via a schema that includes details about the dataset, Kafka configuration, and batch processing size.

Brasil Scrapers

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.7

RabbitMQ Integration

brasil-scrapers/rabbitmq-integration

This integration processes data from an Apify dataset and delivers it to a RabbitMQ queue. It is configured via a schema that includes details about the dataset and RabbitMQ connection settings.

Brasil Scrapers

OpenSearch Integration

apify/opensearch-integration

Transfer data from Apify Actors to Amazon OpenSearch Service. This Actor is a good starting point for building question-answering systems, search functionality, or Retrieval-Augmented Generation (RAG) use cases.

Apify

4.4

Power Webhook Integration

pocesar/run-webhook-digest

Allows you to provide multiple HTTP endpoints, that receive a more complete JSON from the run, and allow you to hit those endpoints using a proxy, and enable you to do conditional webhook calls with some lines of Javascript code and you can link/chain one actor to another

Paulo Cesar

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.5