14 days trial then $40.00/month - No credit card required now

Amazon Product Scraper

junglee/amazon-crawler

14 days trial then $40.00/month - No credit card required now

Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.

All issues Create new issue

Inconsistent number of columns, order of columns and name of columns being returned by the Amazon Product Scraper

Closed

Abrams_Books opened this issue

Hi we are using the results of the Amazon Product Scraper to push data to the database on a daily basis, but the data returned by the Amazon Product Scraper is inconsistent number of columns, order of columns and name of columns resulting in schema mismatch and breaking our ETL job. How can we make sure that the Amazon Product Scraper return the same number of columns in the same order and same column name every time it runs.

Abrams_Books

Problem: Inconsistent number of columns, order of columns and name of columns being returned by the Amazon Product Scraper Hi we are using the results of the Amazon Product Scraper to push data to the database on a daily basis, but the data returned by the Amazon Product Scraper is inconsistent number of columns, order of columns and name of columns resulting in schema mismatch and breaking our ETL job. How can we make sure that the Amazon Product Scraper return the same number of columns in the same order and same column name every time it runs?

Run Details: (inconsistent columns returned 104 on 2023-11-18) https://console.apify.com/view/runs/UFCNYQQuWk292RxfH

Run Details: (inconsistent columns Returned 157 on 2023-11-25) https://console.apify.com/view/runs/PDirRxR93aUKeZi16

Lukáš Průša (lukas.prusa)

Hi, I am closing this as a duplicate. The original: https://console.apify.com/actors/BG3WDrGdteHgZgbPK/issues/tHgPJchKcX2dceoWq

Copying the answer here: This can happen either if:

Resulting items contain a list that has a variable number of items. There are several lists in the output.
Some field is missing completely - this is rare.

The solution is either: a) Use fields (pick fields) export parameter to order the results exactly b) Use omit parameter to remove problematic fields c) Use post-processing pipeline (possibly with another actor after webhook) to add empty values to the list or create a new CSV

Add comment

Developer

Junglee

Actor metrics

167 monthly users
90.6% runs succeeded
4.5 days response time
Created in Oct 2018
Modified 6 days ago

Categories

E-commerce

AI Product Matcher

equidem/ai-product-matcher

Match products across multiple e-commerce websites. Use this AI product matching Actor whenever you need to find matching pairs of products from different online shops for dynamic pricing, competitor analysis or market research.

Matěj Sochor

308

Facebook Ads Scraper

apify/facebook-ads-scraper

Extract advertising data from one or multiple Facebook Pages. Get page details, reach estimates, publisher platforms, report count, number of impressions, ad IDs, timestamps, and more. Download Facebook ads data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

Amazon Scraper

junglee/free-amazon-product-scraper

Gets you product data from Amazon. Unofficial API. Scrapes and downloads product information without using the Amazon API, including reviews, prices, descriptions, and ASIN.

Junglee

2.7k

Google Maps Reviews Scraper

compass/Google-Maps-Reviews-Scraper

Extract all reviews of Google Maps places using place URLs. Get review text, published date, response from owner, review URL, and reviewer's details. Download scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Compass

2.3k

UberEats Reviews Scraper

tri_angle/ubereats-reviews-scraper

Ubereats Reviews allows you to scrape reviews by simply adding the UberEats URLs

Tri⟁angle

CostCo Reviews Scraper

tri_angle/costco-reviews-scraper

Quickly scrape product reviews from CostCo

Tri⟁angle

Costco Product Detail Scraper

tri_angle/costco-product-detail-scraper

Scrape full product detail pages from products listed on Costco.com

Tri⟁angle

Amazon Reviews Scraper

junglee/amazon-reviews-scraper

Amazon scraper to extract reviews from Amazon products. Scrape and download detailed reviews without using the Amazon API, including rating score, review description, reactions and images. Download your data as HTML table, JSON, CSV, Excel, XML.

Junglee

2.1k

Allegro Fast Product Scraper

tri_angle/allegro-fast-product-scraper

Allegro Scraper allows you to fastly scrape data from allegro.pl, allegro.cz and allegro.sk from the listing page , one of the most popular online shopping platforms in Europe and the largest e-commerce platform of European origin.

Tri⟁angle