HardwareZone Scraper – SG Forum Threads, Replies & Monitoring avatar

HardwareZone Scraper – SG Forum Threads, Replies & Monitoring

Pricing

from $2.00 / 1,000 thread listings

Go to Apify Store
HardwareZone Scraper – SG Forum Threads, Replies & Monitoring

HardwareZone Scraper – SG Forum Threads, Replies & Monitoring

Scrape HardwareZone, Singapore's biggest forum, without an API or login: board thread listings with keyword filtering, main posts and all replies, with author, reply count, view count and timestamps. Schedule daily runs for SG brand monitoring. Export JSON/CSV/Excel for social listening.

Pricing

from $2.00 / 1,000 thread listings

Rating

0.0

(0)

Developer

Chad

Chad

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

1

Monthly active users

a day ago

Last modified

Share

HardwareZone Scraper – Singapore's Biggest Forum (No API, No Login)

Scrape HardwareZone (forums.hardwarezone.com.sg) — Singapore's biggest forum: latest threads per board, and full thread content with all replies — via public HTML endpoints, output as structured data.

Output Fields

Board Thread Listing (ListingRow, content is null)

FieldTypeDescription
post_idstringThread ID
sitestringAlways hardwarezone
boardstring | nullBoard ID (the forumId used in the query)
titlestring | nullTitle
authorstring | nullThread starter
reply_countnumber | nullReply count (the raw page may show abbreviations like "895" or "29K" — converted to an integer)
view_countnumber | nullView count (same handling for "104K" / "4M" abbreviations)
created_atstring | nullPost time (ISO 8601, with a +0800 offset)
last_reply_atstring | nullLast reply time (ISO 8601, with a +0800 offset)
post_urlstring | nullThread URL
contentstring | nullBody text (null in listing mode)
source_modestringScrape mode
source_querystringQuery used (board ID)
scraped_atstringScrape timestamp (ISO 8601)

Thread Content (ThreadRow, same fields as above, plus content populated)

FieldTypeDescription
contentstring | nullFull thread body text (HTML tags stripped, whitespace collapsed)

The thread row's board is always null (thread mode doesn't take a board ID as input, and board info isn't on the thread page); reply_count / view_count / last_reply_at are always null (these fields only exist on the board listing page).

Replies (ReplyRow, full thread mode only)

FieldTypeDescription
reply_idstringReply ID (the floor post's element ID; falls back to {threadId}-{floor} when missing)
post_idstringParent thread ID
sitestringAlways hardwarezone
floornumber | nullFloor number (1-based, numbered continuously across pages; null when the floor can't be read because the post sits behind the age-verification wall — see Notes below)
authorstring | nullAuthor
contentstring | nullReply content (HTML tags stripped, whitespace collapsed; null when hidden behind the age-verification wall)
created_atstring | nullReply time (ISO 8601, with a +0800 offset; null when hidden behind the wall)
scraped_atstringScrape timestamp (ISO 8601)

Modes

ModeInputOutputBilling
forumforumIds (board IDs)Thread listing$0.002/row
threadthreadIds / threadUrlsThread content ($0.008/thread) + all replies ($0.003/reply)by volume

Input Fields

FieldTypeDefaultDescription
modeenumforumMode: forum / thread (required)
forumIdsarray["16"]Board IDs, e.g. 16 (Eat-Drink-Man-Woman), 234 (Chill-out/Happenings), 9 (Mobile Communication Technology). Find more boards at forums.hardwarezone.com.sg
threadIdsarrayThread IDs
threadUrlsarrayThread URLs; the thread ID is extracted automatically
bulkInputtextareaBulk paste, one item per line, auto-merged into the matching field based on the current mode
keywordsarrayBoard thread mode: title keyword filter (leave empty for no filtering)
maxItemsinteger50Board thread mode: max items per board; full thread mode: max threads to scrape (replies per thread are not limited by this). Maximum 2000
dateFromstringApplies to board thread mode, based on thread post time or last reply time (whichever is newer). Format 3d, 12h, 2w (relative) or MM/DD/YY (absolute date). When set, paging also stops early (pinned threads are exempt from this filter and early-stop check), keeping scheduled monitoring cheaper
proxyConfigurationproxyApify datacenter proxyOn by default; without a proxy you share egress IPs with other runs and get rate-limited by the forum. Turn it off only for local testing or your own proxy

Input Examples

Board Thread Listing

{
"mode": "forum",
"forumIds": ["16", "234"],
"maxItems": 50
}

Full Thread and Replies

{
"mode": "thread",
"threadUrls": [
"https://forums.hardwarezone.com.sg/threads/official-blood-donation-thread-give-blood-save-lives.7166857/"
]
}

Singapore Social Listening

HardwareZone — especially its casual-chat board EDMW — is Singapore's biggest forum, and the source most often bundled into local social-listening monitoring. Want a fuller picture of Asian forum sentiment? Pair it with the author's other Traditional-Chinese sentiment actors: LIHKG (lihkg-scraper, Hong Kong) and PTT (ptt-scraper, Taiwan). All three actors share the same output conventions (snake_case, null for missing values, ISO timestamps), making it easy to merge and analyze together.

Notes

  • Only public content is scraped — no account or token required
  • Uses public HTML endpoints (XenForo forum engine) — no browser required, so it's fast and low-cost
  • Body text has HTML tags automatically stripped, with whitespace collapsed to single spaces
  • Board IDs / thread IDs can be plain numbers (e.g. forumIds: ["16"]) — the actor builds the URL automatically; HardwareZone redirects a plain-number URL to the full URL with the board/thread name, so the result is the same
  • Some posts sit behind an age-verification wall: HardwareZone requires login and age verification to view certain content in full (not limited to adult boards). When scraped without login, these posts only yield author (still populated); content / created_at / floor are honestly reported as null rather than faked. The thread's first post (the main body) has not been observed to be affected by this restriction
  • reply_count / view_count are often shown as abbreviations like "104K" / "4M" on the raw page (not just for very large numbers — mid-sized ones can be abbreviated too), and are uniformly converted to integers
  • Auto-stops after 5 consecutive pages with no new data — no idle burn. When dateFrom is set, paging stops immediately once every non-pinned thread on a page is older than dateFrom (cheaper still; applies to forum mode only — pinned threads are always kept and are not subject to this filter)
  • If HardwareZone (XenForo) redesigns its site or adds anti-scraping measures in the future, this is judged by Apify Cloud smoke test results (go/no-go); if blocked, the fallback is to switch to Apify residential proxy — not over-engineered in advance

FAQ

Q: Do I need to log in to view this data?

A: No. This actor only scrapes public thread listings and posts — nothing that requires login. A small number of posts sit behind an age-verification wall (see Notes above); their content simply isn't retrievable without login in the first place, so it's out of scope.

Q: Why is content / created_at / floor null for some replies?

A: These replies are hidden behind HardwareZone's age-verification wall — content and time can't be read without login. We honestly report null instead of fabricating data; author is still available, and reply_id is always populated.

Q: Can I scrape multiple boards at once?

A: Yes. Add multiple IDs to forumIds, or paste them one per line via bulkInput.

Q: What's the difference between threadIds and threadUrls?

A: Same effect — threadUrls automatically extracts the numeric ID. Both support the plain-number URL (/threads/{id}/) and the full URL (/threads/{title-slug}.{id}/).

Q: Why is the board field null in full thread mode?

A: The thread page itself doesn't carry board info (the board ID only appears in the board listing page's URL), and full thread mode's input is just a threadId — there's no way to know which board it belongs to, so we honestly return null.

Disclaimer

This tool is for academic research and lawful business analysis only. Users must comply with HardwareZone's Terms of Service and applicable laws. Do not use this tool to invade others' privacy, spread false information, or engage in any other unlawful activity. The author accepts no responsibility for any misuse.


HardwareZone scraper, Singapore forum, HWZ, EDMW, SG social listening, brand monitoring Singapore, forum sentiment