Smart Article Extractor
No credit card required
Smart Article Extractor
No credit card required
📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.
Do you want to learn more about this Actor?
Get a demoI am using this actor to feed into pinecone and would like an easy way to add a unix epoch timestamp instead of the text string date (to do pre-filtering before using the data for a RAG implementation). Is there an easy way to convert the date field to timestamp or add a new field when I use the pinecone integration feature? Many thanks!
Hello,
Thanks for the suggestion. Actually, you can paste this code to the "Extend Output Function" and then use the unixDate
field while keeping the original date as it was.
1($, item) => { 2 item.unixDate = new Date(item.date).getTime() 3 return item 4}
If we get more requests like this, we would add a transformation to the Pinecone integration.
Thanks so much!
Actor Metrics
197 monthly users
-
65 stars
>99% runs succeeded
1.2 days response time
Created in Nov 2019
Modified 4 months ago