Fast URL Content Crawler avatar
Fast URL Content Crawler

Pricing

$1.99 / 1,000 results

Go to Store
Fast URL Content Crawler

Fast URL Content Crawler

Developed by

David Deng

David Deng

Maintained by Community

A high-performance web scraper that rapidly extracts and analyzes content from multiple URLs simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

0.0 (0)

Pricing

$1.99 / 1,000 results

0

Total users

8

Monthly users

8

Runs succeeded

>99%

Issues response

18 hours

Last modified

21 days ago

NI

Duplicate charge/runs

Open

nirheu opened this issue
8 days ago

Hi, I ran the actor in my system. Records in my system show 12:32:46 (for 5 sec), same as in the apify platform. But there is another run at 12:32:31 for 9 sec. - why?

NI

nirheu

8 days ago

I see that every run your scraper registered 2 runs. something is not right!

6SigmaG avatar

Hi Nirheu,that’s a really good observation, and I totally understand why it feels confusing.

I just tested the actor again on my side, and I didn’t see the double-run issue you mentioned.

Would it be possible that there are two different actors or overlapping task triggers in your setup?

If you can share the input URL or a bit more about how you’re triggering the actor, I’ll personally run it in my environment and help you confirm exactly what’s going on.

6SigmaG avatar

Thanks for the example! To help me check more accurately, would it be possible to send me the 2 URL of the specific run from your Apify dashboard? That way I can look into the exact case for you.

6SigmaG avatar

I know it might take a moment, but could you please send me both the run ID and the run URL?

You can just click into the run on your Apify dashboard, then copy the page link and the run ID shown there. That would help me a lot!

6SigmaG avatar

Hello Bro~ thanks for sharing the run ID — really appreciate it!

Right now I can’t access the run data yet. Could you please go to Settings → Share run data with developers and make sure my actor is selected there? That way I’ll be able to view the details.

Also, would you mind testing one more time using this URL: https://apify.com/pricing? Once that’s done, I can access the data and check exactly what’s going on.

6SigmaG avatar

Hello bro! I looked into the issue and found the two runs by matching the 27s duration and timestamp. They have different execution times, so it looks like they were two separate tasks — not a duplicate run.

I also noticed the actor was triggered via API, so it’s possible the issue came from the API call itself. You can try running it directly from the Apify dashboard to verify. I’ve also been testing an online tool that uses this actor’s API, and haven’t seen any duplicate runs so far.

I tested your original actor using the same URL on Apify, and only one run appeared.

Anyway, if you need to scrape a specific URL, I suggest using my latest actor here: https://apify.com/6sigmag/fast-url-content-crawler

It’s designed to extract full content from exact URLs, while the previous one only targets homepages.

Hope this clears things up!

6SigmaG avatar

Great observation — the difference in character count makes total sense.

The two actors are designed for different goals. If you’re trying to quickly filter leads, scraping just the homepage is often enough and much faster. But if you need deeper analysis or want to feed more accurate text into your AI model, the exact URL actor is better — it focuses on full text from that specific page and skips unrelated content.

I’d also love to improve the tools further. Would you mind sharing a bit about how you plan to use the data? That way I can make future updates more useful for your case.

6SigmaG avatar

Totally fair question! Yes — neither actor scrapes the entire website. One grabs the homepage, and the other grabs the exact URL you give it.

If you only have a few hundred websites, I suggest trying Flowith. I tested it today on 100 pages — just describe what you want in natural language, and it works well in Agent mode.

Here's my invite code for extra free credits: 👉 E8W45SMT — Sign up at https://flowith.net

If you're working with many URLs, I recommend redesigning your workflow. For example, first collect pages using a site crawler or sitemap → then use AI to pick the most relevant URLs (like business, products, clients) → and finally use my actor to scrape those pages.

Let me know if you want help with that process!