Actor picture

Metadata scraper

autofacts/metadata

Metadata scraper can used to fetch website's base info inlcudes title, description and other seo infos.

No credit card required

Author's avatarAutofactor
  • Modified
  • Users17
  • Runs299

Metadata Scraper provide a way to website base info.

TODO

  1. Added JSON+LD support

Input Parameters

The input of this actor shoule be JSON formated. Fields are:

Field Type Description
startUrls Array Start URLs to start the actor. Category page, product group page or product page urls are all supported.
proxy Object Select proxies to be used by your crawler.

Here is the example:

{
  "startUrls": [
    {
      "url": "https://www.sephora.com/product/make-no-mistake-foundation-concealer-stick-P420440?skuId=1887520&icid2=products%20grid:p420440"
    }
  ],
  "proxy": { "useApifyProxy": true }
}

Data storage

{
  "url": "https://www.sephora.com/product/make-no-mistake-foundation-concealer-stick-P420440?skuId=1887520&icid2=products%20grid:p420440",
  "title": "Make No Mistake Foundation & Concealer Stick - SEPHORA COLLECTION | Sephora",
  "metadata": {
    "viewport": "width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no",
    "description": "Shop SEPHORA COLLECTION’s Make No Mistake Foundation & Concealer Stick at Sephora. This convenient stick offers a medium coverage and a natural matte finish.",
    "og:description": "Shop SEPHORA COLLECTION’s Make No Mistake Foundation & Concealer Stick at Sephora. This convenient stick offers a medium coverage and a natural matte finish.",
    "twitter:description": "Shop SEPHORA COLLECTION’s Make No Mistake Foundation & Concealer Stick at Sephora. This convenient stick offers a medium coverage and a natural matte finish.",
    "og:title": "Make No Mistake Foundation & Concealer Stick - SEPHORA COLLECTION | Sephora",
    "twitter:title": "Make No Mistake Foundation & Concealer Stick - SEPHORA COLLECTION | Sephora",
    "og:type": "website",
    "og:url": "https://www.sephora.com/product/make-no-mistake-foundation-concealer-stick-P420440",
    "twitter:card": "summary_large_image",
    "twitter:image": "/images/Sephora_logo.jpg",
    "og:image": "/images/Sephora_logo.jpg",
    "og:site_name": "Sephora",
    "fb:admins": "1314428622,676965799",
    "twitter:site": "@Sephora",
    "apple-mobile-web-app-capable": "yes",
    "format-detection": "telephone=no",
    "apple-itunes-app": "app-id=393328150"
  }
}

Industries

See how Metadata scraper is used in industries around the world