Smart Article Extractor avatar
Smart Article Extractor
Try for free

No credit card required

View all Actors
Smart Article Extractor

Smart Article Extractor

lukaskrivka/article-extractor-smart
Try for free

No credit card required

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

User avatar

pls fix doesnt work with fox news

Closed

cardinal_lobster opened this issue
7 months ago
User avatar

Hello,

Thanks for the report.

  1. I see you are using Max articles per start URL set to 50 which will limit you further.
  2. From the specific URL https://www.foxnews.com/category/us/crime, it doesn't find any more subcategories. So you will need to use more generic pseudo URL like https://www.foxnews.com[.*]
  3. If you want only under /crime, it will need to keep scrolling down and clicking on the button "show more". This requires switching to the browser in the Browser options and adding selector to the button. See run and input as guidance: https://console.apify.com/view/runs/H4HiXiA5kXoYZUewS. Unfortunatel,y browsers are much slower but without them, you cannot click on "show more"
Developer
Maintained by Apify
Actor metrics
  • 180 monthly users
  • 100.0% runs succeeded
  • 2.8 days response time
  • Created in Nov 2019
  • Modified about 2 months ago
Categories