Skip to main content
Journal cover image

Researchers, Patients, and Stakeholders Evaluating Comparative-Effectiveness Research: A Mixed-Methods Study of the PCORI Reviewer Experience.

Publication ,  Journal Article
Forsythe, LP; Frank, LB; Hemphill, R; Tafari, AT; Szydlowski, V; Lauer, M; Goertz, C; Clauser, S
Published in: Value Health
October 2018

OBJECTIVES: The Patient-Centered Outcomes Research Institute (PCORI) includes patients and stakeholders alongside scientists in reviewing research applications using unique review criteria including patient-centeredness and patient and/or stakeholder engagement. To support extension of this unique collaborative model to other funders, information from the reviewers on the review process is needed to understand how scientists and nonscientists evaluate research proposals together. Thus, this study aimed to describe reviewers' perspectives of the interactions during the in-person review panel; to examine the value and challenges of including scientists, patients, and stakeholders together; and to understand the perceived importance of PCORI's review criteria. METHODS: This study utilized anonymous, cross-sectional surveys (N = 925 respondents from 5 funding cycles: 470 scientists, 217 patients, 238 stakeholders; survey completion rates by cycle: 70-89%) and group interviews (N = 18). RESULTS: Reviewers of all types describe PCORI Merit Review as respectful, balanced, and one of reciprocal influence among different reviewer types. Reviewers indicate strong support and value of input from all reviewer types, receptivity to input from others, and the panel chair's incorporation of all views. Patients and stakeholders provide real-world perspectives on importance to patients, research partnership plans, and study feasibility. Challenges included concerns about a lack of technical expertise of patient/stakeholder reviewers and about scientists dominating conversations. The most important criterion for assigning final review scores was technical merit-either alone or in conjunction with patient-centeredness or patient/ stakeholder engagement. CONCLUSIONS: PCORI Merit Reviewers' self-reports indicate that the perspectives of different reviewer types are influential in panel discussions and Merit Review outcomes.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Value Health

DOI

EISSN

1524-4733

Publication Date

October 2018

Volume

21

Issue

10

Start / End Page

1161 / 1167

Location

United States

Related Subject Headings

  • Stakeholder Participation
  • Research Personnel
  • Patient Participation
  • Patient Outcome Assessment
  • Humans
  • Health Policy & Services
  • Cross-Sectional Studies
  • Comparative Effectiveness Research
  • Academies and Institutes
  • 4407 Policy and administration
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Forsythe, L. P., Frank, L. B., Hemphill, R., Tafari, A. T., Szydlowski, V., Lauer, M., … Clauser, S. (2018). Researchers, Patients, and Stakeholders Evaluating Comparative-Effectiveness Research: A Mixed-Methods Study of the PCORI Reviewer Experience. Value Health, 21(10), 1161–1167. https://doi.org/10.1016/j.jval.2018.03.018
Forsythe, Laura P., Lori B. Frank, Rachel Hemphill, A Tsahai Tafari, Victoria Szydlowski, Michael Lauer, Christine Goertz, and Steven Clauser. “Researchers, Patients, and Stakeholders Evaluating Comparative-Effectiveness Research: A Mixed-Methods Study of the PCORI Reviewer Experience.Value Health 21, no. 10 (October 2018): 1161–67. https://doi.org/10.1016/j.jval.2018.03.018.
Forsythe LP, Frank LB, Hemphill R, Tafari AT, Szydlowski V, Lauer M, et al. Researchers, Patients, and Stakeholders Evaluating Comparative-Effectiveness Research: A Mixed-Methods Study of the PCORI Reviewer Experience. Value Health. 2018 Oct;21(10):1161–7.
Forsythe, Laura P., et al. “Researchers, Patients, and Stakeholders Evaluating Comparative-Effectiveness Research: A Mixed-Methods Study of the PCORI Reviewer Experience.Value Health, vol. 21, no. 10, Oct. 2018, pp. 1161–67. Pubmed, doi:10.1016/j.jval.2018.03.018.
Forsythe LP, Frank LB, Hemphill R, Tafari AT, Szydlowski V, Lauer M, Goertz C, Clauser S. Researchers, Patients, and Stakeholders Evaluating Comparative-Effectiveness Research: A Mixed-Methods Study of the PCORI Reviewer Experience. Value Health. 2018 Oct;21(10):1161–1167.
Journal cover image

Published In

Value Health

DOI

EISSN

1524-4733

Publication Date

October 2018

Volume

21

Issue

10

Start / End Page

1161 / 1167

Location

United States

Related Subject Headings

  • Stakeholder Participation
  • Research Personnel
  • Patient Participation
  • Patient Outcome Assessment
  • Humans
  • Health Policy & Services
  • Cross-Sectional Studies
  • Comparative Effectiveness Research
  • Academies and Institutes
  • 4407 Policy and administration