7 days trial then $5.00/month - No credit card required now

Forward dataset as POST data

anchor/forward-dataset-webhook

7 days trial then $5.00/month - No credit card required now

This actor forwards the results of an Actor to an endpoint, instead of having to fetch the results manually. It will download the dataset and attach it to the body of a POST request you will specify. It acts as a new webhook. Simplify your Actor process !!!

"Forward dataset Actor" forwards the results of a run, as data of a POST request. It was designed to forward results from crawler.

⏩ Why do I need to forward my Actor dataset ?

If you don't know how to get

🔍 What does this Actor do?

📫 You want to be sent the results of your Actor run, without having to go to the APIFY plateform to fetch it 😫. It avoids a call to the Apify API !

Use case

⏩ avoid fetching results on APIFY
📁 Populate a database quickly
🪄 check data with a monitoring tool
...

👨🏻‍🎓 How to setup ?

Go to one of your Actors (not this one), and add a webhook : it can be in the integration tab if not available in your actor INPUTs.
Simply provide this actor URL as webhook, it should be this format https://api.apify.com/v2/acts/YOUR_ACCOUNT~forward-dataset-webhook/runs?token=YOUR_TOKEN
Then, add your new endpoint in the input "Finish webhook data". That's it. You can test 🙂

🐛 TroubleShooting

we recommend to use "https://webhook.site/ to ease the set up if you encounter some issues
The token is inherited from your APIFY account. That's why you cannot use this actor to fetch the actor's data of another APIFY account.
because this actor was designed initially to forward results from the apify/legacy-phantomjs-crawler, you may need to adapt to your actor integration

⚙️ Advanced configuration

These variables are available to play with

data : the new url to use as a new webhook
datasetId : coming from your APIFY actor webhook.

Environment variables

timeout : The timeout for request in this actor to finish. To be increased if the size of your dataset is big. Unit = milliseconds
format : json or csv. The apify format you would like to receive the data

Developer

Anchor

Actor Metrics

2 monthly users
2 stars
>99% runs succeeded
Created in Oct 2022
Modified 8 months ago

Categories

Developer tools

Automation

Integrations

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

28.8k

733

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.8k

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

26k

187

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

72.4k

253

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.7k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

4.4k

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.2k

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.2k

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.