Smart Article Extractor
Pricing
Pay per usage
Go to Store
Smart Article Extractor
📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.
4.7 (6)
Pricing
Pay per usage
108
Total users
4.8k
Monthly users
329
Runs succeeded
>99%
Response time
11 days
Last modified
a month ago
pls fix doesnt work with fox news
Closed
cardinal_lobster opened this issue
2 years ago
https://newsinfo.inquirer.net/category/latest-stories it only scraped 8, pls fix now
2 years ago
Hello,
Thanks for the report.
- I see you are using Max articles per start URL set to 50 which will limit you further.
- From the specific URL https://www.foxnews.com/category/us/crime, it doesn't find any more subcategories. So you will need to use more generic pseudo URL like
https://www.foxnews.com[.*] - If you want only under
/crime, it will need to keep scrolling down and clicking on the button "show more". This requires switching to the browser in the Browser options and adding selector to the button. See run and input as guidance: https://console.apify.com/view/runs/H4HiXiA5kXoYZUewS. Unfortunatel,y browsers are much slower but without them, you cannot click on "show more"
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
