OAI-PMH Repository Harvester

SRU Catalog Harvester

datamule/sru-catalog-harvester

Point at ANY SRU/SRW library catalog (DNB, Library of Congress, K10plus and thousands more — one LoC standard) and get flat bibliographic rows from a CQL query: title, creator, publisher, date, subject, ISBN and more, plus lossless raw XML. Discovery mode lists a server's indexes. Pay per record.

Research Repository Harvester (Dataverse / DSpace / InvenioRDM)

datamule/repository-platform-extractor

Point at ANY Dataverse, DSpace 7/8, or InvenioRDM/Zenodo install and harvest every dataset's metadata via one unified API — title, authors, DOI/handle, subjects, date, type, license, files, landing page + raw. One actor spans thousands of institutional repositories. Pay per record.

GraphQL Endpoint Extractor

datamule/graphql-endpoint-extractor

Point at ANY GraphQL endpoint: send a raw query (+ optional variables & headers) and flatten the chosen data path into dataset rows plus a lossless raw object — or introspect the schema to discover its types. Works with public or token-gated GraphQL APIs. Pay per record.

IIIF Presentation Harvester

datamule/iiif-presentation-harvester

Point at ANY IIIF manifest or collection (Wellcome, Bodleian, Harvard, Library of Congress and thousands more) and get flat metadata rows: label, description, metadata pairs, rights, thumbnail, canvas count, plus per-canvas image info. Handles IIIF Presentation API 2.x and 3.x. Pay per manifest.

Point at ANY OGC SensorThings API v1.1 instance (FROST-Server, GOST, SensorUp and thousands of air-quality, smart-city and research deployments) and get flat sensor rows — observations, things with coordinates, datastreams with units — plus raw JSON. @iot.nextLink paging, OData filters. Pay per row.

FDSN Seismic Extractor

datamule/fdsn-seismic-extractor

Point at ANY seismic data center (USGS, INGV, GEOFON, IRIS, GeoNet…) and pull earthquakes or station metadata via the uniform FDSN web-services API. Query one center, a list, or all via the fdsn.org registry. Flat rows + lossless raw. Pay per record.

Collect URLs from XML sitemaps for SEO and crawling.

DCAT / data.json Open-Data Catalog Harvester

datamule/dcat-datajson-harvester

Point at ANY DCAT / Project-Open-Data data.json (energy.gov, NASA, CDC & 100s of gov portals) and harvest every dataset's metadata — title, publisher, contact, accessLevel, landing page, downloads + full distribution[] + raw. Streams even huge feeds. Pay per dataset.

GTFS Feed Extractor

datamule/gtfs-feed-extractor

Point at ANY GTFS-static feed URL (BART, MBTA, and thousands of transit agencies worldwide — one global standard) and get flat dataset rows: agency, stops, routes, trips, calendar, stop_times and more. Discovery mode lists a feed's tables. Pay per record.

arXiv Research Paper Scraper

crawlerbros/arxiv-research-paper-scraper

Scrape research papers from arXiv.org - search by query, category, or author; lookup by arXiv ID. Returns title, authors, abstract, PDF URL, DOI, categories, and more. Uses the public arXiv Atom API. No login or proxy required.