Superhero Profile Scraper

Extract comprehensive superhero data with ease. Collect detailed profiles, powerstats, and biographies from a massive database of comic book characters. This high-performance scraper is perfect for building character databases, conducting academic research, or powering interactive fan sites.

---

Features

• High-Speed Execution — Utilizes optimized concurrent requests to gather data significantly faster than sequential scrapers.
• Intelligent Data Cleaning — Automatically filters out empty fields, null values, and placeholder data for a production-ready dataset.
• Sanitized Image Links — Fixes escaped characters in image URLs to ensure portraits display correctly in any web application.
• Multi-Mode Support — Toggle between broad name searches and precise ID lookups to get exactly the data you need.
• Detailed Attributes — Capture everything from physical appearance and power levels to complex family connections and work history.

---

Use Cases

Character Analysis and Research

Analyze the distribution of powerstats across different comic universes. Compare the intelligence, strength, and combat skills of heroes from various publishers for data-driven insights.

Game and App Development

Populate your gaming applications with rich character lore and statistics. Use the structured output to create dynamic character sheets or interactive encyclopedias.

Content Creation and Wikis

Automate the population of fan wikis and community portals. Keep your database updated with the latest hero biographies, aliases, and first appearance details without manual entry.

Market Intelligence

Track character trends and attributes across major publishers like DC and Marvel. Identify patterns in character design, alignment, and team affiliations for industry analysis.

---

Input Parameters

Parameter	Type	Required	Default	Description
mode	String	No	"search"	Operation mode: search (by name) or id (by ID)
search	String	No	—	Hero name to look up in search mode
hero_id	String	No	—	Unique hero ID to fetch in ID mode
results_wanted	Integer	No	20	Maximum number of heroes to collect
fetch_profile	Boolean	No	true	Whether to retrieve full details for search results

---

Output Data

Each item in the dataset provides a structured superhero profile:

Field	Type	Description
id	String	Unique identifier for the character
name	String	The common name of the hero
powerstats	Object	Stats including intelligence, strength, speed, and combat
biography	Object	Real name, publisher, alignment, and origin details
appearance	Object	Physical traits like height, weight, and eye color
work	Object	Professional occupation and base of operations
connections	Object	Team affiliations and relative relationships
image	Object	Direct link to the character's portrait image

---

Usage Examples

Broad Character Search

Extract up to 10 characters matching "Spider" with full profile details:

{
    "mode": "search",
    "search": "Spider",
    "results_wanted": 10,
    "fetch_profile": true
}

Precise Hero Lookup

Retrieve the complete profile for a specific hero using their unique database ID:

{
    "mode": "id",
    "hero_id": "70"
}

High-Speed Discovery

Quickly find all heroes matching a name without fetching deep profile statistics:

{
    "mode": "search",
    "search": "Batman",
    "fetch_profile": false,
    "results_wanted": 50
}

---

Sample Output

{
  "id": "70",
  "name": "Batman",
  "powerstats": {
    "intelligence": "100",
    "strength": "26",
    "speed": "27",
    "durability": "50",
    "power": "47",
    "combat": "100"
  },
  "biography": {
    "full-name": "Bruce Wayne",
    "publisher": "DC Comics",
    "alignment": "good",
    "first-appearance": "Detective Comics #27"
  },
  "image": {
    "url": "https://www.superherodb.com/pictures2/portraits/10/100/639.jpg"
  }
}

---

Tips for Best Results

Optimize for Speed

• Set fetch_profile to false if you only need names and IDs.
• Keep results_wanted small (10-20) for rapid testing.

Refine Your Queries

• Use specific names to reduce ambiguity in search results.
• Verify IDs from search results before using the ID lookup mode.

---

Integrations

Connect your hero data with modern business tools:

• Google Sheets — Export directly for spreadsheet-based character analysis.
• Airtable — Build a searchable visual database of comic characters.
• Zapier — Trigger automated workflows when new data is collected.
• Webhooks — Send extracted hero profiles to your custom API endpoints.

---

Frequently Asked Questions

How do I find a hero's unique ID?

Run a name search first with fetch_profile set to true. The output will contain the id field for every matching hero.

Can I collect data for all heroes?

Yes, you can iterate through IDs sequentially using the ID mode to build a complete local database.

Why are some fields missing?

The scraper automatically removes null or empty values to ensure you only get valid, high-quality data.

---

Legal Notice

This actor is intended for legitimate data collection and research purposes. Users are responsible for complying with the source website's terms of service and all applicable data privacy laws.