Pmc Profile Scraper

Introduction

The Pmc Profile Scraper is a powerful Apify Actor designed to extract detailed content from PubMed Central (PMC) articles, enabling researchers, analysts, and professionals to gather comprehensive data on medical publications efficiently. By scraping article URLs, it retrieves key information such as titles, full content, author details, and associated keywords, making it an invaluable tool for academic research, medical literature analysis, and content aggregation. This Actor streamlines the process of collecting structured data from PMC, saving time and ensuring high-quality outputs for various analytical needs.

Features

• Comprehensive Article Extraction: Scrapes full article content, including titles, abstracts, author information, and publication details from PMC URLs.
• Keyword and Condition Matching: Automatically identifies and tags relevant medical conditions and keywords, enhancing data categorization for research purposes.
• High Reliability: Built with robust error handling to manage varying article structures and ensure consistent data retrieval.
• Scalable Performance: Supports multiple URLs in a single run, with efficient crawling to handle large datasets without compromising speed.
• Structured JSON Output: Delivers clean, machine-readable data in JSON format, ideal for integration with databases or analysis tools.
• Customizable Inputs: Allows users to specify start URLs, providing flexibility for targeted scraping.
• Privacy and Compliance: Respects PMC's terms of service and focuses on publicly available content for ethical data collection.

Input Parameters

Parameter	Type	Required	Description	Example
startUrls	array	Yes	An array of URLs pointing to PMC articles to scrape. Each URL should be a valid PMC article link.	[{"url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC4249226/"}]

Example Usage

To run the Pmc Profile Scraper, provide the input parameters in JSON format. Here's an example:

{
  "startUrls": [
    {
      "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC4239510/"
    }
  ]
}

The Actor will process the URLs and return structured data. An example output for the above input is:

[
  {
    "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC4239510/",
    "title": "\n            Ehealth: Low FODMAP diet vs Lactobacillus rhamnosus GG in irritable bowel syndrome - PMC\n        Lock",
    "content": "World J Gastroenterol. 2014 Nov 21;20(43):16215–16226. doi: 10.3748/wjg.v20.i43.16215\n\nEhealth: Low FODMAP diet vs Lactobacillus rhamnosus GG in irritable bowel syndrome\nNatalia Pedersen\nNatalia Pedersen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Natalia Pedersen\n\n1,2,3,4,5,6, Nynne Nyboe Andersen\nNynne Nyboe Andersen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Nynne Nyboe Andersen\n\n1,2,3,4,5,6, Zsuzsanna Végh\nZsuzsanna Végh\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Zsuzsanna Végh\n\n1,2,3,4,5,6, Lisbeth Jensen\nLisbeth Jensen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Lisbeth Jensen\n\n1,2,3,4,5,6, Dorit Vedel Ankersen\nDorit Vedel Ankersen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Dorit Vedel Ankersen\n\n1,2,3,4,5,6, Maria Felding\nMaria Felding\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Maria Felding\n\n1,2,3,4,5,6, Mette Hestetun Simonsen\nMette Hestetun Simonsen\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Mette Hestetun Simonsen\n\n1,2,3,4,5,6, Johan Burisch\nJohan Burisch\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Johan Burisch\n\n1,2,3,4,5,6, Pia Munkholm\nPia Munkholm\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\nFind articles by Pia Munkholm\n\n1,2,3,4,5,6\n\nAuthor information\nArticle notes\nCopyright and License information\n\n1Natalia Pedersen, Johan Burisch, Pia Munkholm, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n2Nynne Nyboe Andersen, Department of Epidemiology Research, Statens Serum Institut, 2300 Copenhagen, Denmark\n\n3Zsuzsanna Végh, Digestive Disease Centre, Medical Section, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n4Zsuzsanna Végh, Department of Medicine, Veszprém Megyei Csolnoky Ferenc Kórház, 8200 Veszprém, Hungary\n\n5Lisbeth Jensen, Mette Hestetun Simonsen, Nutrition Department, Herlev University Hospital, 2730 Copenhagen, Denmark\n\n6Dorit Vedel Ankersen, Maria Felding, Clinical Nutrition, Faculty of Science, University of Copenhagen, 1870 Copenhagen, Denmark\n\nAuthor contributions: Andersen NN, Pedersen N and Munkholm P designed the research; Pedersen N and Andersen NN performed the research; Jensen L, Simonsen MH, Ankersen DV and Felding M educated patients in the use of LFD; Pedersen N, Végh Z and Burisch J prepared the data tables and performed the statistical analyses; Pedersen N wrote the paper, which was critically revised by all co-authors.\nCorrespondence to: Natalia Pedersen, MD, Digestive Disease Centre, Medical Section, Herlev University Hospital, Herlev Ringvej 75, 2730 Copenhagen, Denmark. natalia.pedersen@zeniavej.dk\nTelephone: +45-2-9919548 Fax: +45-2-9919547\n\nReceived 2014 Jun 11; Revised 2014 Jul 14; Accepted 2014 Jul 24; Issue date 2014 Nov 21.\n\n©2014 Baishideng Publishing Group Inc. All rights reserved.\nPMC Copyright notice\n\nPMCID: PMC4239510  PMID: 25473176\n\nAbstract\nAIM: To investigate the effects of a low fermentable, oligosaccharides, disaccharides, monosaccharides and polyols diet (LFD) and the probiotic Lactobacillus rhamnosus GG (LGG) in irritable bowel syndrome.\nMETHODS: Randomised, unblinded controlled trial on the effect of 6-wk treatment with LFD, LGG or a normal Danish/Western diet (ND) in patients with IBS fulfilling Rome III diagnostic criteria, recruited between November 2009 and April 2013. Patients were required to complete on a weekly basis the IBS severity score system (IBS-SSS) and IBS quality of life (IBS-QOL) questionnaires in a specially developed IBS web self-monitoring application. We investigated whether LFD or LGG could reduce IBS-SSS and improve QOL in IBS patients.\nRESULTS: One hundred twenty-three patients (median age 37 years, range: 18-74 years), 90 (73%) females were randomised: 42 to LFD, 41 to LGG and 40 to ND. A significant reduction in mean ± SD of IBS-SSS from baseline to week 6 between LFD vs LGG vs ND was revealed: 133 ± 122 vs 68 ± 107, 133 ± 122 vs 34 ± 95, P < 0.01. Adjusted changes of IBS-SSS for baseline covariates showed statistically significant reduction of IBS-SSS in LFD group compared to ND (IBS-SSS score 75; 95%CI: 24-126, P < 0.01), but not in LGG compared to ND (IBS-SSS score 32; 95%CI: 18-80, P = 0.20). IBS-QOL was not altered significantly in any of the three groups: mean ± SD in LFD 8 ± 18 vs LGG 7 ± 17, LFD 8 ± 18 vs ND 0.1 ± 15, P = 0.13.\nCONCLUSION: Both LFD and LGG are efficatious in patients with IBS.\nKeywords: Irritable bowel syndrome, Web-based management, Low FODMAP diet, Lactobacillus rhamnosus GG, Disease severity, Irritable bowel syndrome-quality of life\nCore tip: This is one of the first studies confirming the efficacy of a low fermentable, oligosaccharides, disaccharides, monosaccharides and polyols diet (LFD) in a Danish population with irritable bowel syndrome (IBS). The Lactobacillus rhamnosus GG (LGG) also has beneficial effects on IBS symptoms, particularly in diarrhoeal and alternating IBS subtypes. Web-based monitoring (such as at: www.ibs.constant-care.dk) of disease severity and quality of life appears to be feasible among patients with IBS. LFD and LGG should be recommended for patients with IBS. The web-based monitoring of disease severity is promising means and should be more widely implemented among patients with IBS.\nINTRODUCTION\nPharmaceutical treatment with laxatives, antidiarrhoeals, antispasmodics or antidepressants in patients with irritable bowel syndrome (IBS) offers only a mild palliation of clinical symptoms[1-4]. Alternative treatment interventions such as cognitive behavioural[5], hypnotic[6], zone therapy[7], dietary interventions[8] and probiotics[9] have been suggested as potential treatment options for patients with IBS[10,11].\nThe low fermentable, oligosaccharides, disaccharides, monosaccharides and polyols (FODMAP) diet (LFD) was developed based on poor absorption of the short-chain carbohydrates in the small intestine, which in IBS patients can cause gas production and increase intestinal osmolarity[12-15]. The FODMAP components comprise fructose, lactose, fructo- and galacto-oligosaccharides (fructans, and galactans), and polyols (such sorbitol, mannitol, xylitol and maltitol) all of which putatively have three common functional properties: poorly absorbed in the small intestine, osmotically active molecules, and rapidly fermented by bacteria. The mechanism of LFD is assumed to be a decrease in the production of hydrogen and methane in the bowel upon minimizing the intake of these short-chain carbohydrates[16,17]. A recent study by Shepherd et al[14], revealed a reduction of global abdominal symptoms in up to 75% of patients with IBS, however, this result has not yet been replicated.\nProbiotics containing the strain Lactobacillus rhamnosus GG (LGG), with six billion per capsule, has been proven to reduce symptoms in children with functional gastrointestinal disorders, but the efficacy in adult IBS patients remains uncertain[18-20].\nSelf-management and education in IBS patients have been shown to have a beneficial effect on the disease burden and economic burden[21-23]. Web-based concepts for treatment and follow-up of