Wiley Scraper

👋 Welcome to the Wiley Scraper! This actor extracts book and publication data from Wiley.com. With this actor, you can easily gather data about academic books, textbooks, research publications, authors, pricing, and more from this leading academic publisher.

Introduction

The Wiley Scraper is a web scraping tool that extracts publication data from wiley.com. It is useful for academic research, bibliometrics, competitive analysis, and anyone interested in analyzing academic publications and textbooks.

Use Cases

• Academic Research: Collect book metadata, authors, and publication details for literature reviews.
• Bibliometrics: Analyze academic publications, authors, and publishing trends.
• Dataset Building: Aggregate book metadata (ISBN, pages, publish dates) for research databases.
• Price Monitoring: Track pricing and availability of academic textbooks and publications.

Input 📥

To use this actor, provide the following input fields:

• startUrls (array, optional): Direct URLs to scrape. Can include search pages or book detail pages.
• query (string, optional): Search term or keyword for books and publications.
• maxItems (integer, required): Maximum number of books to extract. Example: 50
• page (integer, optional): Starting page number. Default: 1
• sortBy (string, optional): Sort order for results. Options: author, item_name, publish_date, price, relevance
• sortOrder (string, optional): Sort direction. Options: ascending, descending
• proxyConfiguration (object, optional): Apify proxy configuration. Default: { "useApifyProxy": true }

Note:

• You must provide at least one of startUrls or query.

Example input:

{
  "query": "machine learning",
  "maxItems": 50,
  "sortBy": "publish_date",
  "sortOrder": "descending",
  "proxyConfiguration": { "useApifyProxy": true }
}

Output 📤

The output is a dataset of book objects with the following fields:

{
  "title": "Charmed Knits: Projects for Fans of Harry Potter",
  "url": "https://www.wiley.com/en-ie/Charmed+Knits%3A+Projects+for+Fans+of+Harry+Potter-p-9780470067314",
  "authors": ["Alison Hansel"],
  "authorUrls": [
    "https://www.wiley.com/en-ie/search?filters[author]=Alison%20Hansel&pq=++"
  ],
  "productOptions": [
    {
      "type": "Paperback",
      "price": ""
    }
  ],
  "isbn": "978-0-470-06731-4",
  "image": "https://media.wiley.com/product_data/coverImage300/14/04700673/0470067314.jpg",
  "numberOfPages": "176",
  "publishDate": "May 2007",
  "description": "<b>Sit and Knit a Spell</b>   <p>You'll soon be knitting enchanting things you didn't know were  within your powers. Charmed Knits offers dozens of patterns for  items that evoke the mystique of Harry Potter - a Wizard Robe, an  Invisibility Shawl, a Quidditch Sweater, Ron's Ragg Raglan, a Clock  Blanket, Harry Christmas Ornaments, and more. Easy-to-follow  patterns, color photos of the finished projects, and illustrations  of special stitch patterns and design elements make it easy for all  knitters - from beginners to those at Mrs. Weasley's level&#160;-  to work knitting magic. Charmed Knits whisks you away on a  wonderful journey. Along the way, you can pick patterns inspired by  the Weasleys, stock up at Diagon Alley, show your house colors,  conjure up gifts, or create pieces to help you feel at home in the  magical world of Harry Potter.</p>",
  "aboutTheAuthor": "Alison Hansel is an avid Harry Potter fan and a popular knitting blogger whose daily missives can be read on the blue blog at alison.knitsmiths.us. The online go-to gal for Harry Potter tribute knitting, she has published patterns in the popular online knitting magazines MagKnits and Knitty.",
  "permission": "",
  "tableOfContents": ""
}

How many books can the Wiley Scraper extract?

The scraper paginates through book listings and will extract up to the number specified in maxItems. If you want all available books, set a high value for maxItems.

Why use the Wiley Scraper?

• ⚡️ Fast: Quickly gather academic book data for your needs.
• 🤙 Easy to use: No coding required—just input your search criteria and run.
• ☑️ Well-Maintained: Maintained by the Lexis Solutions team for reliability and updates.
• 🎯 Flexible: Support for multiple input methods (URLs, search queries, sorting options).
• 🔍 Comprehensive: Extracts detailed metadata including authors, pricing, and table of contents.

FAQ 💬

• Can I use this scraper to download full texts?

  • No, this scraper extracts metadata and page-visible information only.

• What if the website changes?

  • If Wiley changes its website structure, the scraper may need to be updated. Please report issues or request updates as needed.

Need to scrape other academic or publishing data sources?

Explore related actors on Apify:

• Barnes & Noble Scraper - Books and publications
• Companies House UK Scraper - UK company registry data
• Kununu - Employer reviews (labor market research)
• Jobs.ch - Swiss job listings
• InfoJobs - Job listings
• JobsDB - Asia job listings
• Jobs.cz - Czech job listings

---

👀 Need help or want a custom solution?

Lexis Solutions is a certified Apify Partner. We can help you with custom data extraction projects.

Contact us via Email or LinkedIn