Pricing

Pay per usage

Go to Store

AI Web Agent

Try for free

Developed by

Apify

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

4.2 (7)

Pricing

Pay per usage

Total users

1.2k

Monthly users

111

Runs succeeded

35%

Response time

39 days

Last modified

2 months ago

Open source

Agents

Back to issues Create new issue

Crawling is not giving results

Closed

contributive_bubble opened this issue

Crawling is not giving results

Pavlína Vencovská (paja)

Hey,

sorry for the inconvenience. We needed to reprioritized our workload and we will get back to these use cases in about 3 months. We are checking the issues for bugs but this case seems to be more of a situation which simply doesnt work for AI scraping use case. We will test it and try to tweak it when the Actor is based on our roadmap, but even than it may happen that this use case will not be doable with AI scraping tool.

We are going to close the issue now, but 1. will come back to it later and 2. feel free to reopen to ask further questions.

Add comment

Dynamic Web Scraper

josejet/dynamic-web-scraper

Dynamic Web Scraper is an Apify Actor that gathers information online by simulating user browsing behavior on the web. It reduces the time and amount of scraped web pages by using a model (ChatGPT) to make decisions regarding browser navigation and results evaluation.

Pepa <b>J</b>

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

2.1k

GPT Browser

anchor/gpt-browser

A GPT browser to use OpenAI prompt on any website. Put a list of URLs and a prompt, then the GPT agent will give you the answer you need. Fast, easy, and not limited with OpenAI ChatGPT restrictions. The best way to search and use GPT on large number of websites. Upload Excel or CSV. Screenshots 📸

Anchor

Mastra.ai MCP Agent

jakub.kopecky/actor-mastra-mcp-agent

🤖 AI agent using mastra.ai with Apify MCP Server. 🚀 Runs queries via OpenAI models, taps Apify Actors for web data, and outputs to datasets. 🛠️

Jakub Kopecký

Opinion Compass Agent

jan.turon/opinion-compass

An AI agent that analyzes individuals' stances on specific statements using public social media data. You enter a person's name and an opinion statement, and the Actor evaluates multiple sources to provide a detailed assessment with supporting evidence. The agent is built using LangGraph and Python.

Jan Turoň

Backlink Building Agent

daniil.poletaev/backlink-building-agent

The Backlink Building Agent automates backlink outreach by finding relevant pages & websites, extracting contacts from these websites, and then crafting personalized outreach sequences based on the content to these partners. These sequences can be used on email, LinkedIn, Twitter, & WhatsApp.

Daniil Poletaev

Webpage Singer 🎶

josef.prochazka/webpage-singer

Ever wondered what a website would sound like as a song? This Actor takes any webpage, turns its content into lyrics, and transforms it into a track in your favorite genre. Just drop in a URL, pick a style, and let the AI do the rest.