Under maintenance

Pricing

from $1.99 / 1,000 search results

Try for free

Go to Apify Store

CORE Open Research Scraper

Under maintenance

Try for free

Search CORE's public open-access research index with bounded pagination, stable normalization, deduplication, safe retries, and optional proxies.

Pricing

from $1.99 / 1,000 search results

Rating

0.0

(0)

Developer

Search API

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Input example

{
  "query": "machine learning",
  "maxItems": 50,
  "pageSize": 25,
  "maxPages": 2,
  "requestDelayMs": 300,
  "useApifyProxy": false
}

The complete input contract is in .actor/input_schema.json.

Field	Type	Default
`query`	string	`machine learning`
`maxItems`	integer	`50`
`maxResults`	integer	—
`pageSize`	integer	`50`
`maxPages`	integer	`1`
`requestDelayMs`	integer	`300`
`requestTimeoutSecs`	integer	`60`
`maxRequestRetries`	integer	`2`
`useApifyProxy`	boolean	`false`
`proxyGroups`	array of strings	`[]`
`proxyCountryCode`	string	—
`proxyUrls`	array of strings	`[]`

maxResults remains a backward-compatible alias for maxItems. The Actor supports direct access, authorized Apify Proxy groups/country selection, or custom HTTP(S) proxy URLs.

Output

Each dataset row contains a stable CORE identity, title, deduplicated author names, public CORE URL, query/page/rank context, and optional abstract, DOI, type, publisher, field, dates, citations, and public download URL. Missing optional values are omitted. Failures and no-results never become placeholder work rows; the OUTPUT key contains status, page counts, total hits, bounded failure categories, connection mode, and completion time.

Dataset records use .actor/dataset_schema.json:

Field	Type	Required
`id`	string	Yes
`coreId`	integer	Yes
`title`	string	Yes
`abstract`	string	No
`authors`	array of strings	Yes
`doi`	string	No
`documentType`	string	No
`publisher`	string	No
`fieldOfStudy`	string	No
`yearPublished`	integer	No
`publishedDate`	string	No
`citationCount`	integer	No
`downloadUrl`	string	No
`url`	string	Yes
`query`	string	Yes
`page`	integer	Yes
`position`	integer	Yes
`sourceRank`	integer	Yes
`totalHits`	integer	No
`source`	string	Yes
`scrapedAt`	string	Yes

The Actor validates HTTP status and content type before parsing JSON, enforces a response-size bound, rejects malformed or changed payloads, retries only temporary failures, deduplicates by CORE ID, and obeys hard page/result limits. It never stores raw API payloads or logs proxy credentials, authorization headers, cookies, tokens, or sensitive response bodies. It does not bypass authentication, CAPTCHA, paywalls, regional restrictions, or other access controls.

Google Search Scraper

searchapi/google-search-scraper

Scrapes organic search results from Google for any query with country, language, and location targeting. Extracts title, URL, snippet, sitelinks, thumbnail, ratings, dates, rich result type, and more.

Search API

Google News Scraper

searchapi/google-news-scraper

Scrapes Google News for any query. Extracts the full canonical news-vertical schema: title, URL, source, publisher (with logo and verified flag), excerpt, thumbnail, publish date, author, category, topics, breaking/featured flags, and more.

Search API

Google AI Overview Scraper

searchapi/google-ai-overview-scraper

Scrapes Google AI Overviews (SGE) for any query. Extracts the overview text and HTML, model/provider, sources, inline references, follow-up/related questions, organic results, extraction confidence, and more.

Search API

155

Bing Visual Search Scraper

searchapi/bing-visual-search-scraper

Uploads a public image to Bing Visual Search and extracts the identified subject, visual matches, and source pages.

Search API

Baidu Tieba Public Threads Scraper

searchapi/baidu-tieba-scraper

Scrape public forum threads and posts from Baidu Tieba (tieba.baidu.com). Extracts thread titles, content, author, replies, and metadata from public forum listings and individual threads.

Search API

CORE Open Access Paper Search

ryanclinton/core-academic-search

Search and extract open access academic papers from CORE -- the world's largest aggregator of open access research with over 300 million metadata records and 40+ million full-text papers. Filter by keyword, year range, and language.

Ryan Clinton

Google Shopping Scraper

searchapi/google-shopping-scraper

Scrapes Google Shopping for any query. Extracts title, product/offer ID, merchant, price, original price, discount, shipping, condition, availability, ratings, reviews, thumbnail, brand, category, variants, and more.

Search API

Google Images Scraper

searchapi/google-images-scraper

Scrapes rich Google Images results with original and preview URLs, source pages and domains, titles, dimensions, aspect ratio, orientation, MIME format, favicons, filters, ad flags, and search metadata.

Search API

Baidu Maps Scraper

searchapi/baidu-maps-scraper

Scrape points-of-interest (POI) from Baidu Maps. Extracts business names, addresses, phones, ratings, reviews, hours, coordinates, and categories. Supports pagination and region filter.

Search API

Yandex Images Scraper

searchapi/yandex-image-scraper

Scrapes Yandex Images for any query. Extracts the full canonical images-vertical schema: image URL + thumbnail, title, alt, dimensions, filesize, source page, MIME type, color, animated flag, license, language, and more.

Search API