No credit card required

OpenAI Vector Store Integration

jiri.spilka/openai-vector-store-integration

No credit card required

The Apify OpenAI Vector Store integration uploads data from Apify Actors to the OpenAI Vector Store linked to OpenAI Assistant.

Back to issues Create new issue

Fields Reading Problem

Open

fillipeweb opened this issue

When receiving data from Facebook ad library scraper by Curious Coder the run crashes reading the fields.

Dataset fields:

[ "ad_archive_id", "collation_count", "page_name", "page_id", "snapshot.body.text", "snapshot.cards[0].body", "snapshot.cards[0].link_description", "snapshot.caption", "snapshot.cta_type", "snapshot.link_url", "total_active_time", "start_date", "end_date" ]

Jiří Spilka (jiri.spilka)

Thank you for reporting the issue!

The crash was caused by improper handling of nested or missing fields and array-based syntax (e.g., snapshot.cards[0].body). The following fixes were made:

Fields like snapshot.cards[0].body or snapshot.body.text are now safely handled, returning empty values if missing or out of range instead of crashing.
Array indexing and slicing (e.g., snapshot.cards[:].body) are now supported.

I have tested it, and it seems to be working without errors. Please try the latest version and let me know if any issues persist. Thank you! Jiri

Add comment

Developer

Jiří Spilka

Actor Metrics

25 monthly users
11 bookmarks
89% runs succeeded
1.5 days response time
Created in Apr 2024
Modified 5 days ago

Categories

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.6k

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

120

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

457

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.3k

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

54.1k

371

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.4k

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

4.7k

Smart Article Extractor

lukaskrivka/article-extractor-smart

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Lukáš Křivka

4.5k

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Website Screenshot Generator

apify/screenshot-url

Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.

Apify

3.1k