3 days trial then $3.00/month - No credit card required now

X Crawler

lumen_limitless/x-crawler

3 days trial then $3.00/month - No credit card required now

This project is a web scraper designed to extract user data and tweets from X (formerly known as Twitter) using Crawlee and Playwright.

Start URLs

startUrlsarrayOptional

URLs to start with.

Max Requests per Crawl

maxRequestsPerCrawlintegerOptional

Maximum number of requests that can be made by this crawler.

Default value of this property is 100

Developer

lumen limitless

Actor Metrics

7 monthly users
1 star
>99% runs succeeded
Created in Jul 2024
Modified 3 months ago

Categories

Social media

Other

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

URL Metadata Crawler

easyapi/url-metadata-crawler

Extracting comprehensive metadata from web pages. Gather vital information like meta tags, favicons, Open Graph tags, and more, all while enjoying flexible options for customization. Perfect for SEO specialists, developers, and content creators looking to enhance their web presence! 🌐

EasyApi

Example Website Screenshot Crawler

dz_omar/example-website-screenshot-crawler

Automated website screenshot crawler using Pyppeteer and Apify. This open-source actor captures screenshots from specified URLs, uploads them to the Apify Key-Value Store, and provides easy access to the results, making it ideal for monitoring website changes and archiving web content.

Omar Abdlhakim

Amazon Product Scraper

junglee/Amazon-crawler

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

Junglee

7.3k

Email ✉️ & Phone ☎️ Extractor

anchor/email-phone-extractor

Extract emails, phone numbers, and other contact information like Twitter, LinkedIn, Instagram... from websites you provide. Best for lead generation and data enrichment. Export data in structured formats and dominate your outreach game. Capture your leads almost for free, fast, and without limits.

Anchor

5.4k

Twitter Scraper

quacker/twitter-scraper

Scrape tweets from any Twitter user profile. Top Twitter API alternative to scrape Twitter hashtags, threads, replies, followers, images, videos, statistics, and Twitter history. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Quacker

29.4k

112

Google Jobs Scraper

epctex/google-jobs-scraper

The most comprehensive Google Jobs Scraper ever! Extremely configurable, highly customizable, and blazing fast. Retrieve salary, social links, apply links, and all detailed sections. Both for data retrieval and API Integration. Easy use without any limits!

epctex

213

LinkedIn People URL - Mass Profile Finder

anchor/LinkedIn-people-finder

Unlock the power of connection! LinkedIn People Finder puts the profiles you need at your fingertips. Whether it's one person or a hundred, simply input their names and watch as their LinkedIn Profile URLs appear like magic. Don't drown in a sea of searches – let automation be your guide!

Anchor

2.3k

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants API and RAG pipelines, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages from the results, and returns their cleaned content as Markdown for further processing by an LLM.

Apify

190

Amazon ASINs Scraper

junglee/amazon-asins-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions.

Junglee

657