No credit card required

Find IPs from Proxy Groups

lukaskrivka/find-ips-from-proxy-groups

No credit card required

Simple actor to list IPs that you have allocated in any of your proxy groups. You have to specify the total count of the IPs you have in the groups you want to test for this to work properly.

Dockerfile

1# This is a template for a Dockerfile used to run acts in Actor system.
2# The base image name below is set during the act build, based on user settings.
3# IMPORTANT: The base image must set a correct working directory, such as /usr/src/app or /home/user
4FROM apify/actor-node-basic:v0.21.10
5
6# Second, copy just package.json and package-lock.json since it should be
7# the only file that affects "npm install" in the next step, to speed up the build
8COPY package*.json ./
9
10# Install NPM packages, skip optional and development dependencies to
11# keep the image small. Avoid logging too much and print the dependency
12# tree for debugging
13RUN npm --quiet set progress=false \
14 && npm install --only=prod --no-optional \
15 && echo "Installed NPM packages:" \
16 && (npm list --all || true) \
17 && echo "Node.js version:" \
18 && node --version \
19 && echo "NPM version:" \
20 && npm --version
21
22# Copy source code to container
23# Do this in the last step, to have fast build if only the source code changed
24COPY  . ./
25
26# NOTE: The CMD is already defined by the base image.
27# Uncomment this for local node inspector debugging:
28# CMD [ "node", "--inspect=0.0.0.0:9229", "main.js" ]

INPUT_SCHEMA.json

1{
2    "title": "CheerioCrawler Template",
3    "type": "object",
4    "schemaVersion": 1,
5    "properties": {
6        "proxyConfig": {
7            "title": "Proxy to test",
8            "type": "object",
9            "description": "Select all datacenter proxies or specific groups",
10            "editor": "proxy",
11            "default": 
12                {
13                    "useApifyProxy": true
14                }
15        }
16    }
17}

main.js

1const Apify = require('apify');
2const request = require('request-promise');
3
4Apify.main(async () => {
5    // Get input of your actor
6    const input = await Apify.getValue('INPUT');
7    const { groups, count } = input;
8
9    let ips = {};
10
11    for (let i = 0; i < count * 2; i++) {
12        const proxy = Apify.getApifyProxyUrl({ groups, session: Math.random().toString() })
13        const { clientIp } = await request({ url: 'https://api.apify.com/v2/browser-info', proxy, json: true });
14        await Apify.utils.sleep(1000);
15        console.log(clientIp);
16        ips[clientIp] = true;
17    }
18    await Apify.setValue('OUTPUT', Object.keys(ips));
19});

package.json

1{
2    "name": "apify-project",
3    "version": "0.0.1",
4    "description": "",
5    "author": "It's not you it's me",
6    "license": "ISC",
7    "dependencies": {
8        "apify": "^3",
9        "request-promise": "latest"
10    },
11    "scripts": {
12        "start": "node main.js"
13    }
14}

Developer

Lukáš Křivka

Actor Metrics

11 monthly users
3 stars
72% runs succeeded
Created in Mar 2019
Modified 10 months ago

Categories

Developer tools

Find IPs from Proxy Groups

lukaskrivka/find-IPs-from-proxy-groups

Simple actor to list IPs that you have allocated in any of your proxy groups. You have to specify the total count of the IPs you have in the groups you want to test for this to work properly.

Lukáš Křivka

Facebook Marketplace Scraper

datavoyantlab/Facebook-marketplace-scraper

Scrape Facebook Marketplace listings easily. Extract prices, photos, seller info & more. Export to JSON, CSV, Excel or use API for real-time data. Perfect for market research & e-commerce analysis.

DataVoyantLab

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

26.7k

655

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.6k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

71.5k

223

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.6k

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.

Jakub Drobník

1.2k

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

848

Monitoring Reporter Dashboard

apify/monitoring-reporter-dashboard

The monitoring reporter dashboard is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify