Shopify Products Scraper & AI Shopping Readiness Audit
Pricing
from $0.64 / 1,000 product returneds
Shopify products scraper and catalog export with a 0-100 AI shopping readiness audit. Every store gets a row explaining its result; can read past Shopify's 25,000-product feed limit and says if the catalogue is complete.
Record type
recordType
Required
"product" for a catalogue row, "store-audit" for a per-store readiness audit, "store" for a free status row (not_shopify, shopify_products_unavailable, blocked, blocked_by_robots, no_products, duplicate, invalid_input, error).
Status
status
Required
"ok" for product and audit rows. For store rows: not_shopify, shopify_products_unavailable, blocked, blocked_by_robots, no_products, duplicate, invalid_input or error.
Store
store
Optional
Store domain (without www) after following redirects.
Store URL
storeUrl
Optional
Store origin the data was read from.
Input
input
Optional
The input line this row came from (audit and status rows).
Note
note
Optional
Explanation for status rows, or caveats for an audit (catalogue capped, budget reached, checks not measured).
Product ID
productId
Optional
Shopify product ID.
Handle
handle
Optional
Product handle (URL slug).
Title
title
Optional
Product title.
Vendor (brand)
vendor
Optional
Product vendor as published; null when blank.
Product type
productType
Optional
Merchant product type; null when blank.
Variants
variantsCount
Optional
Number of variants.
Available variants
availableVariantsCount
Optional
Variants the storefront marks as available to buy.
Any variant available
anyAvailable
Optional
True when at least one variant is available.
Min price
priceMin
Optional
Lowest variant price, in the store currency.
Max price
priceMax
Optional
Highest variant price, in the store currency.
Max compare-at price
compareAtPriceMax
Optional
Highest compare-at (was) price, when set.
Currency
currency
Optional
Store currency (ISO 4217) from the store's public metadata or product JSON, when available.
Options
options
Optional
Variant option names (for example Size, Color).
SKUs
skus
Optional
Distinct non-empty variant SKUs.
Variants missing SKU
variantsMissingSku
Optional
Variants with an empty SKU.
Barcode/alt checked
barcodeChecked
Optional
True when this product was in the detail sample, so barcode and alt-text fields are filled.
Barcodes
barcodes
Optional
Distinct variant barcodes (GTIN/UPC/EAN as entered by the merchant). Null when not checked.
Variants with barcode
variantsWithBarcode
Optional
Variants with any barcode value. Null when not checked.
Variants with valid GTIN
variantsWithValidGtin
Optional
Variants whose barcode is a GTIN-8/12/13/14 with a correct check digit. Null when not checked.
Images
imageCount
Optional
Number of product images.
Images missing alt text
imagesMissingAlt
Optional
Images with empty alt text. Null when not checked.
Featured image
featuredImageUrl
Optional
First product image URL.
Images
images
Optional
Every product image in position order: imageId, position, url, width, height, alt, variantIds. alt is filled only when the product's own JSON was read (detailRead true); the store's product feed doesn't include alt text.
Variants
variants
Optional
Every variant: variantId, title, position, sku, barcode, barcodeStatus, barcodeValidGtin, barcodeDuplicateOf, price, compareAtPrice, options (name: value), available, grams, weight, weightUnit, inventoryQuantity, inventoryTracked, sellsWhenOutOfStock, requiresShipping, imageId. From the product feed: sku, prices, options, available, grams. Only when the product's own JSON was read: barcode, weight with unit and the inventory fields. inventoryQuantity is copied only when the store's public product JSON contains a number (many stores hide it); it is never estimated, and stores can hide or cap it. null means not published or not read. barcodeStatus (set when barcodes were checked: the audit sample, or every product with readAllProductDetails on): "valid" (GTIN-8/12/13/14 with a correct check digit), "missing", "invalid" (wrong length, characters or check digit) or "duplicate" (an earlier variant in this store has the same barcode; barcodeDuplicateOf names it, and barcodeValidGtin still says whether the code itself is a valid GTIN).
Product JSON read
detailRead
Optional
true when the product's own JSON (/products/{handle}.json) was read, so barcodes, image alt text, weight units and inventory fields are filled where the store publishes them.
Description words
descriptionWordCount
Optional
Words in the product description after removing HTML.
Product URL
url
Optional
Product page URL on the store.
Created at
createdAt
Optional
ISO 8601 UTC.
Updated at
updatedAt
Optional
ISO 8601 UTC.
Published at
publishedAt
Optional
ISO 8601 UTC.
Store name
storeName
Optional
Store name from the store's public metadata.
Published products (store)
publishedProductsCount
Optional
Product count the store publishes in its metadata, when available.
Catalogue complete
catalogueComplete
Optional
true only when verified: the product feed was read to an empty page (or to the exact /meta.json count), or every product in the store's sitemap was found. false when maxProductsPerStore, the run budget, the run timeout, robots.txt or an error stopped the scan.
Total products known
totalProductsKnown
Optional
The store's product total when known: products read (complete catalogue), /meta.json (exact only below 25,000) or the store's product sitemap. null when unknown.
Total known from
totalProductsKnownSource
Optional
Where totalProductsKnown came from: "products.json (read to the end)", "meta.json" or "sitemap".
Products read
productsRead
Optional
Products read for this store across all routes.
Products by route
productSources
Optional
How many products came from each route: products.json, collections, product-json.
Products scanned
productsScanned
Optional
Products the audit covers.
Variants scanned
variantsScanned
Optional
Variants the audit covers.
Detail sample (products)
detailSampleProducts
Optional
Products whose own JSON was read to check barcodes and image alt text.
Detail sample (variants)
detailSampleVariants
Optional
Variants in the detail sample.
Detail sample (images)
detailSampleImages
Optional
Images in the detail sample.
% variants missing barcode
pctVariantsMissingBarcode
Optional
Detail sample: variants with no barcode at all.
% variants without valid GTIN
pctVariantsWithoutValidGtin
Optional
Detail sample: variants with no barcode or a barcode that is not a valid GTIN.
Barcode check
barcodeCheck
Optional
Barcode totals over the variants checked (the detail sample, or every product read with readAllProductDetails on): variantsChecked, valid, missing, invalid, duplicate (later variants repeating an earlier variant's barcode), duplicateBarcodeGroups, variantsInDuplicateGroups, duplicateBarcodeExamples (up to 10 barcodes with their variant count and example handles), duplicateCheckIncomplete, and exampleHandles per problem. Read-only: nothing is changed in the store.
% missing vendor
pctProductsMissingVendor
Optional
Products with a blank vendor (brand).
% missing product type
pctProductsMissingProductType
Optional
Products with a blank product type.
% missing description
pctProductsMissingDescription
Optional
Products with no description text.
% thin description
pctProductsThinDescription
Optional
Products with 1-29 words of description.
% missing or thin description
pctProductsMissingOrThinDescription
Optional
Products with fewer than 30 words of description.
Duplicate title groups
duplicateTitleGroups
Optional
Distinct titles used by more than one product (case and spacing ignored).
Products with duplicate title
productsWithDuplicateTitle
Optional
Products sharing a title with another product.
% duplicate titles
pctProductsDuplicateTitle
Optional
Share of products sharing a title.
% images missing alt
pctImagesMissingAlt
Optional
Detail sample: images with empty alt text.
% products without images
pctProductsWithoutImages
Optional
Products with no image.
% variants missing SKU
pctVariantsMissingSku
Optional
Variants with an empty SKU.
Readiness score (0-100)
readinessScore
Optional
Deterministic catalogue data-quality score; see README for the formula.
Grade
readinessGrade
Optional
good (90+), fair (70-89), needs work (50-69), poor (<50).
Score breakdown
scoreBreakdown
Optional
Per-metric weight, problem percentage and penalty points.
Top issues
topIssues
Optional
Issues ranked by score impact, with counts and up to 5 example product handles.
Collections
collectionsCount
Optional
Collections in /collections.json (up to 1,000).
Empty collections
emptyCollectionsCount
Optional
Collections with no products.
Thin description threshold
thinDescriptionThresholdWords
Optional
Word count below which a description counts as thin.
Score formula version
scoreFormulaVersion
Optional
Version of the scoring rules.
Audited at
auditedAt
Optional
Run start time, ISO 8601 UTC.
