No credit card required

Pinecone Integration

apify/pinecone-integration

No credit card required

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

add crawling results from website to pinecone

Closed

mindaxis opened this issue

i get these errors: View full log for older lines View full log

2024-04-17T02:22:53.184Z Created a chunk of size 1102, + 2024-04-17T02:22:53.185Z which is longer than the specified 1000 2024-04-17T02:22:53.185Z Created a chunk of size 3719, + 2024-04-17T02:22:53.186Z which is longer than the specified 1000 2024-04-17T02:22:53.187Z Created a chunk of size 1973, + 2024-04-17T02:22:53.190Z which is longer than the specified 1000 2024-04-17T02:22:53.191Z Created a chunk of size 2119, + 2024-04-17T02:22:53.191Z which is longer than the specified 1000

chunks are to big. not sure where i can configure the size of the chunks and why they are too big. i did the same for a other website and it works...

Jan Turoň (jan.turon)

Hello, thanks for the report. Just released new version which should fix your problems. Feel free to check it out :)

Add comment

Developer

Apify

Actor metrics

25 monthly users
3 stars
85.5% runs succeeded
1.1 days response time
Created in Jun 2024
Modified 1 day ago

Categories

Integrations

For creators

WCC Pinecone Integration

tri_angle/wcc-pinecone-integration

Crawl any website and store its content in your Pinecone vector database. Enhance the accuracy and reliability of your own AI Assistant with facts fetched from external sources or connect this integration to our Pinecone GPT Chatbot assistant available in Apify Store.

Tri⟁angle

Pinecone GPT Chatbot

tri_angle/pinecone-gpt-chatbot

Pinecone GPT Chatbot combines OpenAI's GPT models with Pinecone's database to generate insightful responses. Its interactive chatbot interface presents precise and comprehensive answers to user queries. Benefit from semantic understanding, efficient workflows, and enriched knowledge integration!

Tri⟁angle

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

20.3k

434

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.1k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

68.1k

155

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

47k

161

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.1k

Facebook Reel Scraper

jeremy_frost/facebook-reel-scraper

This scraper will get Reel details from Facebook pages of your choice.

Jeremy Frost

129

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.