482 scrapers live47.7K runs1,562 usersRebuilt in the last 30 days: 482 of 482

Scrapers / News & Public Data

OpenAlex Scholarly Works Scraper logo

OpenAlex Scholarly Works Scraper

hipersoft/openalex-scraper

Search 250M+ academic papers via OpenAlex: title, abstract, authors, institutions, venue, citation count, DOI, open-access status and topics. Filter by year, type and open access. For research, R&D and lit reviews. No setup.

Total users

1

Monthly users

1

Total runs

118

Per work scraped

$0.001

Last rebuilt

Oct 28, 2026

Overview

Search the open catalog of scholarly works via the OpenAlex API and get back clean, structured JSON for every paper — title, reconstructed abstract, authors and their institutions, venue, publisher, citation count, DOI, open-access status and research topics. Filter by publication year, work type and open access, and collect thousands of works per search term. No account, no API key. Ideal for literature reviews, R&D scouting, bibliometrics and building research datasets.

OpenAlex Scholarly Works Scraper input — search terms, year range and work type in the Apify Console

Features

  • 🔎 Multi-term search — pass any number of searchTerms (matched against title, abstract and fulltext); each term runs separately and results are deduped by OpenAlex work ID.
  • 📅 Year filtering — bound results with fromYear and toYear to focus on a publication window (0 = no bound).
  • 🔓 Open-access filter — flip openAccessOnly to keep only OA works, and get oaStatus plus a direct oaUrl for each.
  • 🗂️ Work-type filter — narrow to article, preprint, review, book-chapter, dataset and more via workType.
  • 📝 Reconstructed abstracts — toggle includeAbstract to rebuild readable abstract text from OpenAlex's inverted index.
  • 👥 Rich authorship — every author with their affiliated institutions, plus a ready-to-read authorsList string and authorCount.
  • 📈 Bibliometrics built in — citation counts, referenced-works counts, venue, publisher and research topics on every record; scale to maxResultsPerSearch up to 10,000.

What you get

OpenAlex Scholarly Works Scraper output example — papers with authors, citations and abstracts as structured JSON

Each dataset row is one scholarly work:

{
  "searchTerm": "machine learning",
  "title": "Deep Residual Learning for Image Recognition",
  "doi": "https://doi.org/10.1109/cvpr.2016.90",
  "openAlexId": "https://openalex.org/W2194775991",
  "publicationYear": 2016,
  "publicationDate": "2016-06-01",
  "type": "article",
  "language": "en",
  "citedByCount": 210453,
  "referencedWorksCount": 38,
  "authorsList": "Kaiming He; Xiangyu Zhang; Shaoqing Ren; Jian Sun",
  "authors": [
    { "name": "Kaiming He", "institutions": ["Microsoft Research"] }
  ],
  "authorCount": 4,
  "venue": "IEEE Conference on Computer Vision and Pattern Recognition",
  "publisher": "IEEE",
  "isOpenAccess": true,
  "oaStatus": "green",
  "oaUrl": "https://arxiv.org/pdf/1512.03385",
  "topics": ["Deep Learning", "Image Classification"],
  "url": "https://doi.org/10.1109/cvpr.2016.90",
  "abstract": "Deeper neural networks are more difficult to train..."
}

Output schema

Field Type Description
searchTerm string The search term that returned this work.
title string Title of the scholarly work.
doi string (URL) DOI link for the work.
openAlexId string (URL) OpenAlex identifier URL for the work.
publicationYear integer Year the work was published.
publicationDate string Full publication date.
type string Work type (e.g. article, preprint, review).
language string Language code of the work.
citedByCount integer Number of works that cite this one.
referencedWorksCount integer Number of works this one references.
authorsList string Semicolon-separated list of author names.
authors array Authors with their affiliated institutions.
authorCount integer Number of authors on the work.
venue string Journal, conference or venue name.
publisher string Publisher of the work.
isOpenAccess boolean Whether the work is open access.
oaStatus string Open-access status (e.g. green, gold, closed).
oaUrl string (URL) Direct link to the open-access full text.
topics array Research topics associated with the work.
url string (URL) Canonical link to the work.
abstract string Reconstructed abstract text (when includeAbstract is on).

Input

{
  "searchTerms": ["crispr gene editing", "large language models"],
  "fromYear": 2020,
  "toYear": 0,
  "openAccessOnly": false,
  "workType": "article",
  "maxResultsPerSearch": 50,
  "includeAbstract": true
}
Field Description
searchTerms Terms to search across title, abstract and fulltext. One search per term.
fromYear / toYear Publication-year bounds; 0 means no lower/upper bound.
openAccessOnly Keep only open-access works.
workType Optional type filter (e.g. article, preprint, review, dataset).
maxResultsPerSearch Maximum works per search term (1–10,000).
includeAbstract Reconstruct and include each paper's abstract text.

Use cases

  • Run a systematic literature review and export a structured, citation-ranked corpus.
  • Map the most-cited authors, institutions and venues for a research topic.
  • Track emerging preprints and open-access work in a fast-moving field.
  • Build training or RAG datasets of abstracts and metadata for research tooling.

Pricing

Pay-per-event: you're billed a small amount per run and per item scraped — you only pay for what you get. See the Pricing tab for current rates.

FAQ

Do I need an API key? No. This Actor uses the public OpenAlex API with no account, login or API key required — just enter your search terms and run.

How many papers can I scrape per run? Up to 10,000 works per search term via maxResultsPerSearch, and you can pass multiple searchTerms in one run, so a single run can collect tens of thousands of works (deduped by OpenAlex work ID).

Is scraping OpenAlex legal? Yes. OpenAlex is a fully open catalog of scholarly metadata, and this Actor reads only those openly available records through the official API and returns them as-is.

What format is the output? Structured JSON — one row per scholarly work — exportable as JSON, CSV or Excel. Each record includes title, reconstructed abstract, authors with institutions, venue, publisher, citation count, DOI and open-access status.

Can I filter by year or open access? Yes. Bound results with fromYear/toYear, keep only open-access works with openAccessOnly, and narrow to a specific workType such as article, preprint, review or dataset.

Can I integrate this with other tools? The OpenAlex Scholarly Works Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. It works with Make, Zapier, Slack, Airbyte, GitHub, Google Drive and many more, plus the Apify API, JavaScript/Python clients and MCP. Or use webhooks to trigger an action whenever a run finishes.

Building a bibliometrics or literature dataset? These other hipersoft scrapers work well alongside this one:

Notes

This Actor uses the public OpenAlex API and returns that catalog's own metadata as-is, over openly available records with no login required. It is an independent tool and is not affiliated with, endorsed by, or sponsored by OpenAlex or OurResearch.

Input

FieldTypeDescription
searchTerms
Search terms
arraySearch academic works matching these terms (title, abstract, fulltext).
fromYear
From year
integerOnly include works published in this year or later. 0 = no lower bound.
Default: 0
toYear
To year
integerOnly include works published in this year or earlier. 0 = no upper bound.
Default: 0
openAccessOnly
Open access only
booleanOnly include open-access works.
Default: false
workType
Work type
stringOptional filter, e.g. article, preprint, review, book-chapter, dataset. Empty = all.
maxResultsPerSearch
Max results per search term
integerMaximum works to collect per search term.
Default: 50
includeAbstract
Include abstract
booleanReconstruct and include the paper abstract.
Default: true

API

curl -X POST "https://api.apify.com/v2/acts/hipersoft~openalex-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
  "searchTerms": [
    "machine learning"
  ]
}'

Pricing

EventPricePaid plans from
Work scraped
One scholarly work with title, abstract, authors, institutions, venue, citations, DOI and open-access status
$0.001$0.0005
API request
One OpenAlex works page (up to 200 results)
$0.0005$0.0005

You pay only for what the run returns. Set a maximum cost per run and it stops cleanly at that limit.

Related scrapers

Europe PMC Scraper

Bulk-scrape life-science and biomedical literature from Europe PMC (40M+ records: PubMed, PMC, preprints, patents): title, abstract, authors, journal, year, DOI, PMID/PMCID, citation count, MeSH terms, open-access flag and full-text/PDF links. Thousands per run. No setup.

325 runs · 5 users · $0.001 / article scraped

arXiv Papers Scraper

Search and extract arXiv papers: title, abstract, authors, categories, published/updated dates, DOI, journal reference, and direct PDF links. Filter by category and sort by newest, recently updated or relevance. Fetch by arXiv ID too. For research, lit reviews and AI/ML monitoring. No setup.

140 runs · 2 users · $0.0025 / paper scraped

Letterboxd Scraper

Scrape Letterboxd films with ratings, rating counts, genres, director, cast, runtime and synopsis. Feed it film pages, a user's films/watchlist/diary, any list URL, or browse pages. For film data, recommendations and research.

139 runs · 7 users · $0.0042 / film scraped

OpenLibrary Book Scraper

Search millions of books on OpenLibrary by keyword, author, subject or ISBN and get title, authors, publisher, year, subjects, ISBNs, edition count, ratings, page count and cover. Clean, no setup.

124 runs · 5 users · $0.002 / book scraped

Semantic Scholar Scraper

Bulk-scrape academic papers from Semantic Scholar's 200M+ corpus: title, abstract, AI TLDR summary, authors, venue, year, citation & influential-citation counts, fields of study, DOI/PubMed/arXiv IDs and open-access PDF links. Filter by year, field and citations. Thousands per run. No setup.

123 runs · 7 users · $0.001 / paper scraped

Wikipedia Scraper

Search Wikipedia or look up exact articles and get the full plain-text content, summary, categories, image, Wikidata ID and monthly pageview trends. Any language. Great for research, RAG and AI datasets. No setup.

121 runs · 1 users · $0.001 / article scraped
Need a source that isn't here?

Send the site and the fields. We build it and you get it first.

Request a build