Pay $1.50 for 1,000 results

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

Pay $1.50 for 1,000 results

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

Back to issues Create new issue

Not working

Closed

saidur297 opened this issue

I was trying to collect texts from the url's but it takes a long time and cannot provide me any data at all. Please fix the issue. For your reference I am attaching my run url below.

David Deng (6SigmaG)

Can you send it again? I can't see any messages.

saidur297

I was trying to collect texts from the url's but it takes a long time and cannot provide me any data at all. Please fix the issue. For your reference I am attaching my run url below.

b4debiz2MaXCwZ1gc

David Deng (6SigmaG)

Guess you deleted it so I can't view it.

saidur297

I just resurrect it again and it's live now

Here is the run url - b4debiz2MaXCwZ1gc

David Deng (6SigmaG)

It's still inaccessible~ let me ask the Support

saidur297

Sure

David Deng (6SigmaG)

Can you check the id again?

saidur297

This is the id - b4debiz2MaXCwZ1gc

I've checked again

David Deng (6SigmaG)

I can see other user's runs but not yours, can you provide me with some url directly for testing?

I've been using this Actor for the past few days and haven't had any problems yet

saidur297

I ran it again. It's live now

Here is the run id - EM7QEb4qeHnD2goH2

Please check

David Deng (6SigmaG)

I did a test and I can see the ids used by other friends but still can't see yours ......

saidur297

I don't know what is happening but I am trying to collect data from the attached sites, I tried total 3 times with your actor but no matter how many times I tried it gives no result.

For your reference I am attaching the list of url's here below. You can run the test with my provided URL's and check.

David Deng (6SigmaG)

Thanks for the detailed feedback, I checked the content and I know what the problem was

This actor is only suitable for crawling the content of the homepage, similar to these contents you want to crawl, I found this one is more suitable: Website Content Crawler, I don't know if you have tried it?

saidur297

I tried but also failed to deliver the result.

David Deng (6SigmaG)

I tried it and I think it's an anti-crawler restriction on the other site.

saidur297

Yup, it seems so.

Add comment

Developer

David Deng

Actor Metrics

43 monthly users
0 No stars yet
>99% runs succeeded
2.8 hours response time
Created in Oct 2024
Modified 22 days ago

Categories

Other

Lead generation

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants API and RAG pipelines, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages from the results, and returns their cleaned content as Markdown for further processing by an LLM.

Apify

197

(New) Best Website Traffic Generator

harshmaur/website-traffic-generator

Draw targeted traffic to your websites, mimic real user behaviour and view their stats on Google analytics. Auto discover links on the page and crawl the entire websites in few minutes while giving you complete control. Use the tool to generate page views, stress test the website.

Harsh Maur

1.3k

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

79.2k

576

📩📍 Google Maps Email Extractor

lukaskrivka/google-maps-with-contact-details

Extract Google Maps contact details. Scrape websites of Google Maps places for contact details and get email addresses, website, location, address, zipcode, phone number, social media links. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Lukáš Křivka

182

Bing Search Scraper 🔍

powerful_bachelor/bing-search-scraper

🔍 Bing Search Scraper: Efficiently extract and analyze Bing search results for SEO, market research, and trend analysis. Get URLs, titles, descriptions, keywords, news, videos, and more in JSON, CSV, or Excel formats. Transform data into actionable insights effortlessly! 📊✨

Powerful Bachelor

Shopee Api Scraper

marc_plouhinec/shopee-api-scraper

Query Shopee's unofficial API for product searches by keyword, category, or shop. Access detailed information including prices, orders, stock levels, and ratings. Also retrieve related entities like the category tree, shop listings, and keyword suggestions.

Marc Plouhinec

360

Amazon Product Scraper

junglee/Amazon-crawler

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

Junglee

7.4k

TikTok Sound Scraper

clockworks/tiktok-sound-scraper

Scrape TikTok videos with a chosen sound. Just add one or more sound URLs and extract tiktoks that have it: URLs, likes, country of creation, video and music metadata, creator data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

194

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

27.1k

671

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

3.6k