7 days trial then $40.00/month - No credit card required now

Work Scraper

trudax/work-scraper

7 days trial then $40.00/month - No credit card required now

Extract data from the top freelancing websites. Search by URL or search terms, filter by categories, English level, and hourly rate. Get info about freelancers and agencies without login. Download your data as an HTML table, JSON, CSV, Excel, or XML.

Back to issues Create new issue

Search page not displaying all jobs?

Closed

engrossing_car opened this issue

I see that when I search upwork for all us jobs it lists close to 20k jobs.

https://www.upwork.com/nx/jobs/search/?sort=recency&user_location_match=1

But when I try to scrape it, Im getting only 5k jobs. whny am I not able to get all the 20k jobs?

Thx.

Gustavo Rudiger (trudax)

If you are not logged in Upwork return less results. You can also try to use a proxy from a country that is not the US.

engrossing_car

ok will try that. thx.

engrossing_car

one other question. If I want to scrape jobs that were created in the last 48 hours. What is the best way to do that?

Gustavo Rudiger (trudax)

Right now there is no filter that enables you to do that. You can only sort by newest and limit the number of results. Later you can check the createdAt fields on the scraped data.

Add comment

Developer

Gustavo Rudiger

Actor Metrics

12 monthly users
6 stars
99% runs succeeded
3.2 days response time
Created in Jun 2020
Modified 3 days ago

Categories

Jobs

Contact Details Merge & Deduplicate

lukaskrivka/contact-details-merge-deduplicate

Merge and deduplicate all contacts extracted by Contact Details Scraper. Works with multiple datasets. One row per domain.

Lukáš Křivka

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59.4k

510

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.6k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

71.6k

227

Test Youtube Structured Transcript Extractor

karamelo/test-youtube-structured-transcript-extractor

Extract YouTube transcripts instantly. Save time & effort . Get accurate structured transcripts or captions in seconds. Export in various formats,, JSON, XML, HTML, CSV, EXCEL... Boost your productivity!

karamelo

115

Apollo Scraper: Get Work & Personal Emails (No Account Needed)

code_crafter/apollo-scraper

Retrieve both Work and Personal Emails efficiently. Scrape up to 5,000 leads per search URL.

Code Crafter

611

Amazon Reviews Scraper

junglee/amazon-reviews-scraper

Amazon scraper to extract reviews from Amazon products. Scrape and download detailed reviews without using the Amazon API, including rating score, review description, reactions and images. Download your data as HTML table, JSON, CSV, Excel, XML.

Junglee

3.2k

Amazon Product Scraper

junglee/Amazon-crawler

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

Junglee

7.4k

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

3.6k

Crexi.com Property Listings Scraper

memo23/apify-crexi

Unlock the power of Crexi's vast commercial real estate database with our advanced scraper. Transform raw listings into actionable insights, giving you the edge in property analysis, market trends, and investment opportunities. Your key to decisions in the competitive world of commercial real estate