Knowde Scraper — Chemical Ingredients, Suppliers & TDS/SDS

Chemicals & ingredients marketplace data — Knowde product search, supplier storefronts, certifications, and TDS/SDS metadata.

Knowde Scraper
Knowde Scraper ◄── you are here

Disclaimer: Unofficial Actor for publicly accessible Knowde Marketplace pages. Knowde and related names are trademarks of their respective owners. Not affiliated with, sponsored by, or endorsed by Knowde. Provided for informational and research purposes only. You are responsible for complying with applicable laws and Knowde terms of use.

Scrape the Knowde Marketplace chemical ingredients and polymers catalog by keyword search, product URL, or supplier storefront. Export ingredient attributes, certifications, applications, TDS/SDS document metadata, and supplier contacts as clean JSON — a Knowde scraper / Knowde API alternative for sourcing, competitive intelligence, and MCP / Python / Node.js pipelines.

---

Key Features

• Keyword product search — paginated Knowde search results (36 products per page)
• Product detail enrichment — Enhanced TDS sections, documents, similar products (optional)
• Supplier storefronts — company description, email, phone, HQ, brands, featured products
• Storefront catalogs — crawl supplier /products listings at scale
• Quick filters — With SDS, With TDS, Fast response times
• Structured attributes — ingredient name, physical form, labeling claims, certifications, applications
• Fast HTTP scraping — curl_cffi Chrome TLS impersonation; no headless browser
• Residential proxy ready — sticky Apify sessions help pass AWS WAF on product detail pages

---

Use Cases

Use case	What you get	Why it helps
Ingredient sourcing	Products matching a chemistry keyword + supplier slugs	Build shortlists for R&D / procurement
Supplier intelligence	Storefront contacts, brands, featured SKUs	Map who sells what on Knowde
Compliance screening	Labeling claims + certifications blocks	Filter Non-GMO / Kosher / GRAS candidates
Document discovery	TDS / SDS / declaration metadata	Find which SKUs publish safety & tech sheets
Competitive monitoring	Repeat searches / storefront catalogs	Track new listings in a category

---

When to use this Actor

• Knowde product search by ingredient, polymer, or chemistry keyword
• Supplier storefront extraction (contacts + featured products)
• Product URL enrichment when you already have Knowde PDP links
• Sourcing research — attributes, applications, certifications, document presence

When not to use this Actor

• Official Knowde Developer API workflows that require a Knowde company API client (OAuth)
• Live quote / sample / RFQ submission automation
• List prices or inventory — Knowde is discovery/RFQ oriented; public pages do not expose transactional pricing
• Other chemical portals — this Actor covers Knowde only

---

Input Parameters

Parameter	Type	Default	Description
searchQueries	Array	—	Knowde keyword searches
startUrls	Array	—	Product, storefront, storefront /products, or search URLs
maxItems	Integer	50	Maximum dataset items per run
maxPages	Integer	1	Max pages per search / storefront catalog (1–200)
enrichProducts	Boolean	false	Fetch full PDP for each listing row
includeDocuments	Boolean	true	Include document metadata on enriched products
includeSimilarProducts	Boolean	true	Include similar products on enriched PDPs
withSds / withTds / withFastResponse	Boolean	false	Search quick-filters
requestDelaySecs	Number	0.75	Delay between requests
proxyConfiguration	Object	Residential	Apify Proxy — residential recommended for PDP enrichment

Input Example — search + storefront

{
  "searchQueries": ["glycerin"],
  "startUrls": [
    "https://www.knowde.com/stores/givaudan-naturex"
  ],
  "maxItems": 50,
  "maxPages": 2,
  "enrichProducts": false,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Input Example — enrich product URLs

{
  "startUrls": [
    "https://www.knowde.com/stores/givaudan-naturex/products/naturex-elderberry-fruit-powder-4-anthocyanins-hplc-on700002"
  ],
  "maxItems": 10,
  "includeDocuments": true,
  "includeSimilarProducts": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

---

Output

Dataset rows use recordType: listing | product | supplier | error.

Field	Type	Description
recordType	String	Row kind
url	String	Canonical Knowde URL
productId	String	Knowde product id
name	String	Product or supplier name
companyName / companySlug	String	Supplier
brandName / brandSlug	String	Brand
summary / properties	Array	Attribute blocks (key, items)
details	Array	Enhanced TDS sections (product only)
documents	Array	TDS / SDS / declarations (product only)
email / phone / hqAddress	Mixed	Supplier contacts
searchQuery	String	Keyword that produced the row
scrapedAt	String	ISO-8601 timestamp

Output Example — listing

{
  "source": "knowde",
  "recordType": "listing",
  "url": "https://www.knowde.com/stores/givaudan-naturex/products/example-product-slug",
  "productId": "338991",
  "name": "Example Ingredient Product",
  "companyName": "Example Supplier",
  "companySlug": "example-supplier",
  "summary": [
    {
      "key": "Ingredient Name",
      "name": "Ingredient Name",
      "items": ["Glycerin"]
    }
  ],
  "searchQuery": "glycerin",
  "page": 1,
  "scrapedAt": "2026-08-05T12:00:00+00:00"
}

---

Integration examples

Node.js

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('crawloop/knowde-scraper').call({
  searchQueries: ['glycerin'],
  maxItems: 50,
  maxPages: 2,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items.slice(0, 3));

Python

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("crawloop/knowde-scraper").call(
    run_input={
        "searchQueries": ["glycerin"],
        "maxItems": 50,
        "maxPages": 2,
    }
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item.get("name"), item.get("companyName"))

cURL

curl -X POST "https://api.apify.com/v2/acts/crawloop~knowde-scraper/runs?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"searchQueries":["glycerin"],"maxItems":50,"maxPages":2}'

---

MCP and AI assistants

Use this Actor from AI tools via Apify MCP. Connect your Apify account, then call this Actor by its Store ID / name (crawloop/knowde-scraper).

Example prompts:

• "Run Knowde Scraper for glycerin and return the top 20 product rows as JSON"
• "Scrape a Knowde supplier storefront and summarize email, phone, and featured products"
• "Search Knowde for fumed silica with SDS filter and list supplier slugs"

---

FAQ

Does this return prices?
No. Public Knowde pages are oriented around discovery and RFQ (quote / sample requests), not list prices.

Do I need a Knowde login?
No for public search, storefront, and product pages. Some document downloads may still require a Knowde account in the browser — this Actor returns document metadata when present in the page payload.

Why use residential proxy?
Product detail URLs can trigger AWS WAF challenges on datacenter IPs. Search and many storefront pages often work without proxy; enable Apify RESIDENTIAL for reliable PDP enrichment.

Is this the official Knowde API?
No. Knowde offers a separate Developer API for platform customers. This Actor extracts publicly rendered Marketplace data for automation on Apify.

Can I scrape with Python or Node.js?
Yes — use the Apify client examples above, or call the Actor from MCP / AI assistants.

---

Related

Chemicals & Ingredients Suite siblings will be linked here once published on the Apify Store.