Smart Article Extractor
Pricing
Pay per usage
Smart Article Extractor
📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.
4.7 (6)
Pricing
Pay per usage
103
Monthly users
280
Runs succeeded
>99%
Response time
35 days
Last modified
6 days ago
Empty results from medium.com
Nothing is returned from that page
12024-04-04T09:58:45.807Z INFO Adding article URL: https://medium.com/@daniel.castillo_48013/streamlining-event-driven-architecture-documentation-with-event-catalog-a-step-by-step-guide-6d10d95abaa1 22024-04-04T09:58:46.294Z INFO CheerioCrawler: Starting the crawler. 32024-04-04T09:58:47.526Z WARN IS NOT VALID ARTICLE --- Reasons: [Article has too few words: 145 (should be at least 150)] --- https://medium.com/@daniel.castillo_48013/streamlining-event-driven-architecture-documentation-with-event-catalog-a-step-by-step-guide-6d10d95abaa1 42024-04-04T09:58:47.599Z INFO CheerioCrawler: All requests from the queue have been processed, the crawler will shut down. 52024-04-04T09:58:47.799Z INFO CheerioCrawler: Final request statistics: {"requestsFinished":1,"requestsFailed":0,"retryHistogram":[1],"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":1195,"requestsFinishedPerMinute":37,"requestsFailedPerMinute":0,"requestTotalDurationMillis":1195,"requestsTotal":1,"crawlerRuntimeMillis":1616} 62024-04-04T09:58:47.804Z INFO CheerioCrawler: Finished! Total 1 requests: 1 succeeded, 0 failed. {"terminal":true}
Hello,
Thanks for the report. Unfortunately, Medium can be quite complex to parse and the actor only parsed text from the first paragraph.
You can improve that by using the Extend Output Function to point it to the correct text.
One example would be this
1($) => { 2 return { 3 text: $('article p, article ol').text().trim() 4 } 5}
https://console.apify.com/view/runs/ClHPxNgQaEw3pOYSM
But it would require better selector to get really clean text.
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
