Website Profile Scraper

Compare profiles from the open web without opening them one by one. From web page URLs, each web record retains profile link, names, profile links, and response status.

The record

The dataset schema names every field before the run. The first working set is requestedUrl, finalUrl, route, scrapedAt, wireBytes, decodedBytes, responseStatus, pagesChecked, profileUrl, entityType, name, and jobTitle. Dataset views keep related fields together without changing the underlying row.

Captured row

{
  "entityType": "Person",
  "responseStatus": 200
}

Input

Website Profile Scraper accepts source URLs. Run controls stay in the same form.

Field	What it controls	Starting value
startUrls	Paste exact URLs from the open web, one per line.	["https://www.kottke.org","https://about.gitlab.com"]
maxItems	Stop after this many dataset rows.	20
maxSeconds	Stop after this many seconds and keep completed rows.	180

Example input

{
  "startUrls": [
    "https://www.kottke.org",
    "https://about.gitlab.com"
  ],
  "maxItems": 3,
  "maxSeconds": 180
}

Price

$100 per 1,000 followed accounts on the Free plan. Other Apify plans use the rates shown in the Pricing tab.

Console, API, schedules, and exports

Runs can begin in Apify Console, from a saved task, or through the Actor API. A schedule can reuse the same input. Completed rows remain in the run dataset for API retrieval and Apify dataset exports.

POST https://api.apify.com/v2/acts/B60RE4TVT4GPgcyAI/runs
GET  https://api.apify.com/v2/datasets/{datasetId}/items

Saved tasks

Twenty task pages cover distinct research, comparison, operations, automation, and export jobs. The opening set is:

• Web profile single-page capture: Review one web record around name, entityType, jobTitle, and affiliation. The saved task uses startUrls, maxItems, and maxSeconds and opens the overview view. Configured in Website Profile Scraper.
• Web profile page comparison: Compare web profiles using requestedUrl, finalUrl, route, and scrapedAt. The identity view keeps the differences close together. Configured in Website Profile Scraper.
• Web profile URL list: Process a saved web input queue with startUrls, maxItems, and maxSeconds. Source and identifier fields remain visible in the source view. Configured in Website Profile Scraper.
• Web profile canonical index: Index web profiles by name, scrapedAt, wireBytes, and decodedBytes. The saved input keeps the same matching keys from run to run. Configured in Website Profile Scraper.
• Web profile metadata register: Assemble a focused web register centered on requestedUrl, finalUrl, route, and scrapedAt. The task keeps startUrls, maxItems, and maxSeconds visible for later review. Configured in Website Profile Scraper.
• Web profile response benchmark: Compare a second field set across web profiles, led by requestedUrl, finalUrl, route, and scrapedAt. Results open as the proof table. Configured in Website Profile Scraper.

Related products

• Website Email Scraper
• Website Data Scraper
• Website Lead Scraper
• Web Event Data Scraper
• Website Contact Scraper

Support

Include the Actor ID, run ID, saved task name, and affected input when reporting an issue. That is enough to locate the run and its dataset.