Skip to main content

Reviewing the reviewers: comparison of review quality and reviewer characteristics at the American Journal of Roentgenology.

Publication ,  Journal Article
Kliewer, MA; Freed, KS; DeLong, DM; Pickhardt, PJ; Provenzale, JM
Published in: AJR Am J Roentgenol
June 2005

OBJECTIVE: The purpose of our study was to determine which manuscript reviewer characteristics are most strongly associated with reviewer performance as judged by editors of the American Journal of Roentgenology (AJR). MATERIALS AND METHODS: At the AJR, manuscript reviews are rated by the journal editors on a subjective scale from 1 (lowest) to 4, on the basis of the value, thoroughness, and punctuality of the critique. We obtained all scores for AJR reviewers and determined the average score for each reviewer. We also sent a questionnaire to 989 reviewers requesting specific information regarding the age, sex, radiology subspecialty, number of years serving as a reviewer, academic rank, and practice type of the reviewer. The demographic profiles were correlated with the average quality score for each reviewer. Statistical analysis included correlation analysis and analysis of variance modeling. Reviewer quality scores were also correlated with the scoring of individual reviews and ultimate disposition of 196 manuscripts sent to the AJR during the same period. RESULTS: Responses to the questionnaire were obtained from 821 reviewers (83.0%), for whom quality scores were available for 714 (87.0%). Correlation analysis shows that the quality score of reviewers strongly correlated with younger age (p = 0.001). A statistically significant correlation between quality score and practice type was seen (p = 0.008), with reviewers from academic institutions receiving higher scores. No significant correlation was found between quality score and sex (p = 0.72), years of reviewing (p = 0.26), academic rank (p = 0.10), or the ultimate disposition of the manuscript (p = 0.40). The quality score of the reviewers showed no variation by subspecialty (p = 0.99). CONCLUSION: The highest-rated AJR reviewers tended to be young and from academic institutions. The quality of peer review did not correlate with the sex, academic rank, or subspecialty of the reviewer.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

AJR Am J Roentgenol

DOI

ISSN

0361-803X

Publication Date

June 2005

Volume

184

Issue

6

Start / End Page

1731 / 1735

Location

United States

Related Subject Headings

  • Surveys and Questionnaires
  • Radiology
  • Publishing
  • Periodicals as Topic
  • Peer Review, Research
  • Nuclear Medicine & Medical Imaging
  • Middle Aged
  • Manuscripts, Medical as Topic
  • Male
  • Humans
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Kliewer, M. A., Freed, K. S., DeLong, D. M., Pickhardt, P. J., & Provenzale, J. M. (2005). Reviewing the reviewers: comparison of review quality and reviewer characteristics at the American Journal of Roentgenology. AJR Am J Roentgenol, 184(6), 1731–1735. https://doi.org/10.2214/ajr.184.6.01841731
Kliewer, Mark A., Kelly S. Freed, David M. DeLong, Perry J. Pickhardt, and James M. Provenzale. “Reviewing the reviewers: comparison of review quality and reviewer characteristics at the American Journal of Roentgenology.AJR Am J Roentgenol 184, no. 6 (June 2005): 1731–35. https://doi.org/10.2214/ajr.184.6.01841731.
Kliewer MA, Freed KS, DeLong DM, Pickhardt PJ, Provenzale JM. Reviewing the reviewers: comparison of review quality and reviewer characteristics at the American Journal of Roentgenology. AJR Am J Roentgenol. 2005 Jun;184(6):1731–5.
Kliewer, Mark A., et al. “Reviewing the reviewers: comparison of review quality and reviewer characteristics at the American Journal of Roentgenology.AJR Am J Roentgenol, vol. 184, no. 6, June 2005, pp. 1731–35. Pubmed, doi:10.2214/ajr.184.6.01841731.
Kliewer MA, Freed KS, DeLong DM, Pickhardt PJ, Provenzale JM. Reviewing the reviewers: comparison of review quality and reviewer characteristics at the American Journal of Roentgenology. AJR Am J Roentgenol. 2005 Jun;184(6):1731–1735.

Published In

AJR Am J Roentgenol

DOI

ISSN

0361-803X

Publication Date

June 2005

Volume

184

Issue

6

Start / End Page

1731 / 1735

Location

United States

Related Subject Headings

  • Surveys and Questionnaires
  • Radiology
  • Publishing
  • Periodicals as Topic
  • Peer Review, Research
  • Nuclear Medicine & Medical Imaging
  • Middle Aged
  • Manuscripts, Medical as Topic
  • Male
  • Humans