Pmc Profile Scraper

Introduction

The Pmc Profile Scraper is a powerful Apify Actor designed to extract structured data from PubMed Central (PMC) articles. It efficiently scrapes article metadata, author information, and full content, enabling researchers, analysts, and developers to gather valuable insights from scientific publications. This tool streamlines data collection for medical research, academic studies, and content analysis, saving time and ensuring high-quality, machine-readable outputs.

Features

• Comprehensive Article Extraction: Retrieves full article titles, content, and metadata from PMC URLs.
• Author Profile Insights: Extracts detailed author affiliations, contributions, and contact information.
• Multi-URL Support: Handles multiple start URLs in a single run for batch processing.
• Structured JSON Output: Delivers clean, parseable data with fields like URL, title, and content.
• Reliable Scraping: Built on CheerioCrawler for fast, error-resistant web scraping.
• Research-Ready Data: Ideal for academic and medical data aggregation, with support for conditions like IBS, colorectal cancer, and more.
• Easy Integration: Outputs compatible with JSON, CSV, and Excel for seamless downstream analysis.

Input Parameters

Parameter	Type	Required	Description	Example
startUrls	array	Yes	Array of PMC article URLs to scrape.	["https://pmc.ncbi.nlm.nih.gov/articles/PMC4249226/"]

Example Usage

Input

{
  "startUrls": [
    "https://pmc.ncbi.nlm.nih.gov/articles/PMC4239510/"
  ]
}

Output

[
  {
    "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC4239510/",
    "title": "\n            Ehealth: Low FODMAP diet vs Lactobacillus rhamnosus GG in irritable bowel syndrome - PMC\n        Lock",
    "content": "World J Gastroenterol. 2014 Nov 21;20(43):16215–16226. doi: 10.3748/wjg.v20.i43.16215\n\nEhealth: Low FODMAP diet vs Lactobacillus rhamnosus GG in irritable bowel syndrome\nNatalia Pedersen\nNatalia Pedersen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Natalia Pedersen\n\n1,2,3,4,5,6, Nynne Nyboe Andersen\nNynne Nyboe Andersen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Nynne Nyboe Andersen\n\n1,2,3,4,5,6, Zsuzsanna Végh\nZsuzsanna Végh\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Zsuzsanna Végh\n\n1,2,3,4,5,6, Lisbeth Jensen\nLisbeth Jensen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Lisbeth Jensen\n\n1,2,3,4,5,6, Dorit Vedel Ankersen\nDorit Vedel Ankersen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Dorit Vedel Ankersen\n\n1,2,3,4,5,6, Maria Felding\nMaria Felding\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Maria Felding\n\n1,2,3,4,5,6, Mette Hestetun Simonsen\nMette Hestetun Simonsen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Mette Hestetun Simonsen\n\n1,2,3,4,5,6, Johan Burisch\nJohan Burisch\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Johan Burisch\n\n1,2,3,4,5,6, Pia Munkholm\nPia Munkholm\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Pia Munkholm\n\n1,2,3,4,5,6\n\nAuthor information\nArticle notes\nCopyright and License information\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\n\nAuthor contributions: Andersen NN, Pedersen N and Munkholm P designed the research; Pedersen N and Andersen NN performed the research; Jensen L, Simonsen MH, Ankersen DV and Felding M educated patients in the use of LFD; Pedersen N, Végh Z and Burisch J prepared the data tables and performed the statistical analyses; Pedersen N wrote the paper, which was critically revised by all co-authors.\nCorrespondence to: Natalia Pedersen, MD, Digestive Disease Centre, Medical Section, Herlev University Hospital, Herlev Ringvej 75, 2730 Copenhagen, Denmark. natalia.pedersen@zeniavej.dk\nTelephone: +45-2-9919548 Fax: +45-2-9919547\n\nReceived 2014 Jun 11; Revised 2014 Jul 14; Accepted 2014 Jul 24; Issue date 2014 Nov 21.\n\n©2014 Baishideng Publishing Group Inc. All rights reserved.\nPMC Copyright notice\n\nPMCID: PMC4239510  PMID: 25473176\n\nAbstract\nAIM: To investigate the effects of a low fermentable, oligosaccharides, disaccharides, monosaccharides and polyols diet (LFD) and the probiotic Lactobacillus rhamnosus GG (LGG) in irritable bowel syndrome.\nMETHODS: Randomised, unblinded controlled trial on the effect of 6-wk treatment with LFD, LGG or a normal Danish/Western diet (ND) in patients with IBS fulfilling Rome III diagnostic criteria, recruited between November 2009 and April 2013. Patients were required to complete on a weekly basis the IBS severity score system (IBS-SSS) and IBS quality of life (IBS-QOL) questionnaires in a specially developed IBS web self-monitoring application. We investigated whether LFD or LGG could reduce IBS-SSS and improve QOL in IBS patients.\nRESULTS: One hundred twenty-three patients (median age 37 years, range: 18-74 years), 90 (73%) females were randomised: 42 to LFD, 41 to LGG and 40 to ND. A significant reduction in mean ± SD of IBS-SSS from baseline to week 6 between LFD vs LGG vs ND was revealed: 133 ± 122 vs 68 ± 107, 133 ± 122 vs 34 ± 95, P < 0.01. Adjusted changes of IBS-SSS for baseline covariates showed statistically significant reduction of IBS-SSS in LFD group compared to ND (IBS-SSS score 75; 95%CI: 24-126, P < 0.01), but not in LGG compared to ND (IBS-SSS score 32; 95%CI: 18-80, P = 0.20). IBS-QOL was not altered significantly in any of the three groups: mean ± SD in LFD 8 ± 18 vs LGG 7 ± 17, LFD 8 ± 18 vs ND 0.1 ± 15, P = 0.13.\nCONCLUSION: Both LFD and LGG are efficatious in patients with IBS.\nKeywords: Irritable bowel syndrome, Web-based management, Low FODMAP diet, Lactobacillus rhamnosus GG, Disease severity, Irritable bowel syndrome-quality of life\nCore tip: This is one of the first studies confirming the efficacy of a low fermentable, oligosaccharides, disaccharides, monosaccharides and polyols diet (LFD) in a Danish population with IBS. The Lactobacillus rhamnosus GG (LGG) also has beneficial effects on IBS symptoms, particularly in diarrhoeal and alternating IBS subtypes. Web-based monitoring (such as at: www.ibs.constant-care.dk) of disease severity and quality of life appears to be feasible among patients with IBS. LFD and LGG should be recommended for patients with IBS. The web-based monitoring of disease severity is promising means and should be more widely implemented among patients with IBS.\nINTRODUCTION\nPharmaceutical treatment with laxatives, antidiarrhoeals, antispasmodics or antidepressants in patients with irritable bowel syndrome (IBS) offers only a mild palliation of clinical symptoms[1-4]. Alternative treatment interventions such as cognitive behavioural[5], hypnotic[6], zone therapy[7], dietary interventions[8] and probiotics[9] have been suggested as potential treatment options for patients with IBS[10,11].\nThe low fermentable, oligosaccharides, disaccharides, monosaccharides and polyols (FODMAP) diet (LFD) was developed based on poor absorption of the short-chain carbohydrates in the small intestine, which in IBS patients can cause gas production and increase intestinal osmolarity[12-15]. The FODMAP components comprise fructose, lactose, fructo- and galacto-oligosaccharides (fructans, and galactans), and polyols (such sorbitol, mannitol, xylitol and maltitol) all of which putatively have three common functional properties: poorly absorbed in the small intestine, osmotically active molecules, and rapidly fermented by bacteria. The mechanism of LFD is assumed to be a decrease in the production of hydrogen and methane in the bowel upon minimizing the intake of these short-chain carbohydrates[16,17]. A recent study by Shepherd et al[14], revealed a reduction of global abdominal symptoms in up to 75% of patients with IBS, however, this result has not yet been replicated.\nProbiotics containing the strain Lactobacillus rhamnosus GG (LGG), with six billion per capsule, has been proven to reduce symptoms in children with functional gastrointestinal disorders, but the efficacy in adult IBS patients remains uncertain[18-20].\nSelf-management and education in IBS patients have been shown to have a beneficial effect on the disease burden and economic burden[21-23]. Web-based concepts for treatment and follow-up of patients with inflammatory bowel disease have been successfully developed and shown to improve disease course, optimizing patients’ compliance, improving quality of life and generating economic benefits for the health care system[24-26].\nThe aim of this study was to conduct a randomised, controlled trial for 6-wk with patients randomised according to either treatment with LFD, LGG capsules, or a non-intervention control group following a normal Danish/Western diet (ND). Furthermore, we evaluated the feasibility of a web