Webnovel Book Scraper

Collect public book metadata from Webnovel（起点国际） for catalog research, market monitoring, and novel discovery. The Actor accepts Webnovel keyword searches and direct book-detail URLs, deduplicates books by canonical URL, and keeps search provenance on each successful book row.

The default research unit is one public book-detail page. Chapter collection is opt-in and returns chapter metadata only (title and URL); the Actor does not download chapter text.

What it collects

• Title, subtitle, author and public author URL
• Description, genres, tags, language, status, cover URL
• Rating, rating/review/view counts when exposed by the page
• Word count, chapter count, latest chapter, published/updated timestamps
• Matching search query, rank, and source URL
• An optional bounded chapter index

The default Dataset contains only successful book rows. Run, search-page, and failure audits are saved as named Key-Value Store records (RUN_AUDIT and SEARCH_AUDITS) so operational records do not become book result events.

Input

Use searchQueries, startUrls, or both. A direct URL is the most reliable bounded smoke test.

{
  "searchQueries": ["cultivation", "fantasy"],
  "startUrls": [
    { "url": "https://www.webnovel.com/book/lord-of-mysteries_11022733006234505" }
  ],
  "maxBooksPerQuery": 20,
  "maxSearchPages": 3,
  "includeChapterList": false,
  "maxChaptersPerBook": 100,
  "concurrency": 2,
  "requestDelayMs": 500,
  "maxRequestRetries": 2,
  "useApifyProxy": false,
  "proxyCountry": ""
}

Field	Meaning
searchQueries	Keywords sent to Webnovel's public search pages.
startUrls	Public Webnovel book-detail URLs. Unsupported hosts are ignored.
maxBooksPerQuery	Per-query result cap before cross-query deduplication.
maxSearchPages	Maximum pages requested for each query.
includeChapterList	Add up to maxChaptersPerBook public chapter-index entries. No chapter body is fetched.
concurrency	Number of browser pages in parallel, 1-5.
requestDelayMs	Delay before every navigation.
maxRequestRetries	Total browser navigation attempts.
useApifyProxy	Route through Apify Proxy when Webnovel is unstable or region-specific. This does not bypass login or access controls.
proxyCountry	Optional ISO country code such as US.

Output and audit

Each successful Dataset row has record_type: "book" and platform: "webnovel". Stable keys are book_url and, when available, book_id. search_hits contains every query/rank that matched a deduplicated book.

RUN_AUDIT contains discovered, collected, failed, and chapter-list counts plus sanitized failure messages. SEARCH_AUDITS contains one object per attempted keyword search page. Inspect those records before treating a run as complete.

Access and responsible use

• Only public Webnovel pages are requested. The Actor does not log in, solve CAPTCHA, or access private/deleted content.
• Webnovel can return anti-bot or region-dependent pages. A successful build is not evidence of successful extraction; verify book Dataset rows and RUN_AUDIT after a bounded run.
• Site markup and search behavior can change. Parser fallbacks use JSON-LD, embedded page state, and rendered HTML; review failures when fields become unavailable.
• Respect Webnovel terms, robots guidance, copyright rules, rate limits, and applicable law. Do not use the optional chapter list to redistribute copyrighted chapter text.

Current pricing

This Actor is published with Apify PAY_PER_EVENT pricing. One successful book row is the paid economic unit; audit and failure records stay out of the default Dataset.

Event	FREE	BRONZE	SILVER	GOLD+
Book result (apify-default-dataset-item)	$0.0049	$0.0039	$0.0034	$0.0029

Actor Start is $0.00005 per memory-based start event. Platform usage is paid by the run owner, and the minimum accepted maximum-charge cap is $0.10. The source does not emit a custom book-completed event; only successful default-Dataset book rows are billed.

中文说明

该 Actor 仅采集起点国际 Webnovel 的公开书籍详情页，支持关键词搜索和直接书籍 URL。默认每本书输出一条 book 记录；章节功能只采集章节标题和 URL，不抓取正文。反爬、地区限制和页面改版可能导致失败，请结合 RUN_AUDIT 判断覆盖情况，并遵守网站条款、版权和速率限制。