Hugging Face Papers Scraper avatar

Hugging Face Papers Scraper

Pricing

from $9.00 / 1,000 results

Go to Apify Store
Hugging Face Papers Scraper

Hugging Face Papers Scraper

Scrapes Hugging Face papers by search query or trending feed. Returns each paper as a flat row with title, authors, abstract, upvotes, and URL. Export to CSV, JSON, Excel, or XML.

Pricing

from $9.00 / 1,000 results

Rating

0.0

(0)

Developer

ParseForge

ParseForge

Maintained by Community

Actor stats

1

Bookmarked

8

Total users

1

Monthly active users

12 days ago

Last modified

Share

ParseForge

Hugging Face Papers Scraper

Scrape Hugging Face papers by search query or trending feed, up to a million per run. Each paper comes with its title, authors, abstract, upvotes, and direct URL. No API key or login. Export to CSV, JSON, Excel, or XML.

Hugging Face's official API needs a token and rate-limits you. This reads the public papers feed directly, filtered by keyword or trending, and returns each match in one fixed schema. It is the fastest way to track artificial intelligence news and research papers without writing code.

Who uses itWhat they scrape Hugging Face for
AI researchersMonitor new papers in their subfield without manually checking the site
Data scientistsBuild datasets of paper metadata for trend analysis or literature reviews
Product managersTrack competitor research and emerging techniques in AI
Content creatorsFind trending papers to write about or share with their audience

What it does

This Actor collects Hugging Face papers by search query or trending feed, and returns each one as a flat row.

  • ๐Ÿ” Search mode: enter any keyword like 'transformer', 'diffusion model', or 'LLM' to get matching papers.
  • ๐Ÿ“ˆ Trending mode: fetch the current trending papers on Hugging Face with one click.
  • ๐Ÿ“Š Flat output: every paper is a single row with title, authors, abstract, upvotes, and URL, ready for spreadsheets.
  • โš™๏ธ Flexible limits: set maxItems from 1 to 1,000,000 to control how many papers you collect per run.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with Hugging Face data

๐Ÿ“š Build a research database.

A PhD student runs the Actor weekly with the query 'diffusion model' and exports the results to CSV to maintain a personal library of relevant papers.

๐Ÿ“ˆ Track AI trends.

A market analyst uses trending mode daily to see which papers are gaining traction, then shares a summary with their team to inform product strategy.

๐Ÿ”Ž Monitor competitor research.

A startup founder sets up a scheduled run for keywords like 'LLM' and 'RAG' to stay aware of new techniques from competitors and academic labs.

๐Ÿ“ฐ Curate AI news.

A newsletter writer scrapes trending papers each morning and picks the most interesting ones to feature in their daily AI digest.

Why choose this scraper

What you get
No API keyScrape public paper feeds without registering an app or dealing with OAuth.
Up-to-dateGet the latest papers as they appear on Hugging Face, including trending items.
Structured dataEach paper is a flat object with title, authors, abstract, upvotes, and URL.
ScalableCollect up to a million papers per run, suitable for large-scale analysis.

How it compares

This Actor is the only one in this group that scrapes Hugging Face papers. The others are OCR tools for receipts and PDFs, so they are not direct competitors for this use case.

FeatureParseForgeReceipt OCR APIPdf OCR APIArtificial Intelligence News
Scrapes Hugging Face papersYesNot listedNot listedNot listed
Search by keywordYesNot listedNot listedNot listed
Trending papers feedYesNot listedNot listedNot listed
Returns paper metadata (title, authors, abstract)YesNot listedNot listedNot listed
No API key requiredYesNot listedNot listedNot listed

Configure the run

Drive the Actor with a search query or switch to trending mode, and set the maximum number of papers to collect. Results are returned in a consistent schema for easy export. The Input tab lists every parameter.

A first run with the defaults:

{
"maxItems": 10,
"searchQuery": "transformer"
}

A larger pull:

{
"maxItems": 200,
"searchQuery": "transformer"
}

Pricing

Pay-per-result: $0.0095 per result collected. You pay only for the results written to your dataset.

Results collectedApproximate cost
100 results$0.95
1,000 results$9.50
10,000 results$95.00

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the Hugging Face Papers Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to Hugging Face through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

$claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/huggingface-papers-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Make sure your searchQuery is spelled correctly and not too specific. Try a broader term like 'AI' or 'model'. Also check that mode is set to 'search' if you are using a query.

The Actor returns fewer papers than maxItems.

This can happen if there are not enough matching papers on Hugging Face for your query or trending feed. Try a different query or increase the time range if available.

I get an error about rate limiting.

The Actor includes automatic retries and delays to avoid rate limits. If you still see errors, reduce the frequency of your runs or contact support.

Some fields are empty in the output.

Not all papers have every field populated. For example, some may lack an abstract or upvotes. This is normal and reflects the source data.

FAQ

QuestionAnswer
Do I need a Hugging Face API key?No. This Actor reads the public papers feed directly, so no authentication or token is required.
What data does each paper include?Each paper is returned as a flat object with fields like title, authors, abstract, upvotes, and URL. The exact fields are shown in the sample output.
Can I scrape trending papers?Yes. Set the mode to 'trending' and the Actor will fetch the current trending papers on Hugging Face.
How many papers can I collect in one run?You can set maxItems from 1 to 1,000,000. The Actor will stop after reaching that number.
Can I search by multiple keywords?The searchQuery field accepts a single string. For multiple keywords, run the Actor multiple times or use a more complex query if supported by the site.
What export formats are supported?You can export the results to CSV, JSON, Excel, or XML from the Apify dataset.
Is this Actor legal to use?Yes, it only accesses publicly available data. However, you should respect Hugging Face's terms of service and robots.txt.
Can I schedule this Actor to run automatically?Yes, you can set up a schedule in Apify to run it daily, weekly, or at any interval.
What if I get no results?Check your search query for typos or try a broader term. Also ensure the mode is set correctly.
Does this Actor handle pagination?Yes, it automatically paginates through results until it reaches maxItems or no more papers are available.

Browse the full ParseForge collection for more scrapers.

๐Ÿ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

โš ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Hugging Face, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.