Pricing

Pay per event

Go to Store

tsboi index

Try for free

Developed by

Ikenna Chidoka

Indexing for LLMs. This application crawls specified websites, processes their content into a searchable vector database, and enables users to ask natural language questions about the content.

0.0 (0)

Pricing

Pay per event

Total users

Monthly users

Runs succeeded

>99%

Last modified

4 days ago

SEO tools

Start URLs

startUrlsarrayOptional

One or more URLs of pages where the crawler will start. Note that the Actor will additionally only crawl sub-pages of these URLs. For example, for start URL https://www.example.com/blog, it will crawl pages like https://example.com/blog/article-1, but will skip https://example.com/docs/something-else.

Max pages

maxCrawlPagesintegerOptional

The maximum number pages to crawl. It includes the start URLs, pagination pages, pages with no content, etc. The crawler will automatically finish after reaching this number. This setting is useful to prevent accidental crawler runaway.

Default value of this property is 9999999

OpenAI API key

openAIApiKeystringOptional

Enter your OpenAI account and an API key. This is needed for vectorizing the data and also to be able to prompt the OpenAI model.

Query

querystringOptional

The query you want to ask the model about the crawled data.

Re-crawl the data

forceRecrawlbooleanOptional

If enabled, the data will be re-crawled even if cached vector index is available.

Default value of this property is false

Ask Website with AI

fayoussef/ask-website-with-ai

Analyzes websites using AI (Gemini/OpenAI) to answer questions from scraped content. It can explore internal links for comprehensive answers, taking a list of URLs and questions. Ideal for targeted data extraction and content summarization.

youssef farhan

5.0

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

AI_Builder

607

4.3

/llms.txt Generator

jakub.kopecky/llmstxt-generator

The /llms.txt Generator 🕸️📄 extracts website content to create an llms.txt file for AI apps 🤖✨ like LLM fine-tuning and indexing. Output is available 📥 in the Key-Value Store for easy download and integration into workflows. 🚀

Jakub Kopecký

446

2.7

Website Content Vector Retriever

hamza.alwan/website-content-vector-retriever

Hamza Alwan

AI Content Humanizer 🤖✨

easyapi/ai-content-humanizer

Transform AI-generated content into natural, human-like text with customizable length and tone. Perfect for content creators, marketers, and writers looking to make their AI content more authentic and engaging. 🤖✍️

EasyApi

5.0

Google People Also Ask Scraper

ib4ngz/google-people-also-ask-scraper

Scrapes questions that appear in the `People also ask` section on the Google search results page according to the keyword entered with the max depth you want

Iqbal R

Google Indexing API Bulk URL Submission

mabdulmoghni/google-indexing-api-bulk-url-submission

This Actor allows you to submit multiple URLs for indexing in bulk through Google's Indexing API. It avoids the need to manually request each URL to be indexed via the Google Search Console interface. With this tool, you can quickly submit up to 100 URLs at once.

Mohamed Moo

Google Bulk Index Checker

caprolok/google-bulk-index-checker

Google Bulk Index Checker is a swift, user-friendly tool designed to verify if a website is indexed by Google. It provides instant indexing status updates, helping SEO professionals and webmasters ensure their sites are visible on Google search. Essential for efficient SEO management.

Caprolok

Instagram Business Intelligence Pro

red.cars/instagram-business-intelligence-pro

Transform Instagram data into actionable business insights with zero setup. Get competitor analysis, influencer research, content strategy, and market sentiment from simple natural language queries.