Why Not License Referees?
Let’s train and evaluate the folks who get to make or break careers.
By Tom Winter
The referee system in scholarly publishing offers us many benefits and also carries with it attendant problems. The problems need to be addressed.
Referees are arguably the linchpins of academic scholarship: they do the heavy lifting for editors, they provide editors with vicarious expertise, and they monitor the gateway to publication and thus to tenure and promotion. Their presence in the editorial process is the guarantee to deans and program directors that scholarship is scholarship.
Referees are also, however, the bottleneck of the publication system. Dilatory or slothful referees idly and thoughtlessly put careers on hold.
A by-product of the referee system is that nowadays the scholar never outgrows the status of a graduate student. In a sense, this is good: the great advantage of a professorial career is the concomitant license to be a student all one’s life. But the referee system, in effect, promotes the chosen referee to autocratic graduate committee chair while demoting the author-scholar back to the days of writing dissertation chapters to suit the committee’s approval. The scholar-author was in some ways better off as a graduate student. Though the referee has the arbitrary power of a graduate committee, the referee never has to deal with the “student’s” feelings, and the “student” never gets to discuss the report with the referee.
The system needs changing. People with this much power should be trained. The only requirement for referees is the trust of an editor that the referee is knowledgeable in the subject area. Referee selection parallels the old way of publication where, as recently as the 1970s, authors were published because they knew the editors. In publication, of course, there has been a (mostly) salubrious change. This change has not yet befallen the selection of the referee. Everyone who does it is an amateur at it, and, too often, it shows.
Editors of the journals in every field should get together and establish a training and even a licensing program for referees. Becoming a licensed referee could then count in a professor’s annual reviews.
At a minimum, to begin, editors should establish one rule: there should be a thirty-day deadline, after which the paper would go to another referee. Further, some old rules that used to go without saying must now be explicitly spelled out for a new generation of editors and their referees. For example, just as the chair of a search committee does not get the job, the referee does not become coauthor. The editors could come up with other rules.
They should also establish a checklist for evaluating the article and for rewriting the report so it is fit for the author to see. Finally, another checklist is necessary: since every scholarly author’s professional life is at present at the mercy of amateurs, a checklist must address how to respond to a referee’s report. Every referee response should be the subject of an author’s prompt reply, to which the editor should give a hearing. Both for the editor and the author, allowing a referee report to stand without response is the equivalent of a judge hearing one side of a case, or of a juridical system that lets a witness go without cross-examination.
A referee must think on three levels:
1. Obviously, the referee must consider the article itself (that is where most referees now stop).
2. The referee should be aware of the human being who will read the report.
3. The referee should have in the back of his or her mind that the author, too, has a say and can respond to a review directly to the journal’s editor.
The referee report checklist above is only a stopgap but is a necessary start. In the end, scholars must insist on nothing less than referee certification, like a pilot’s license, with ratings. Until then, we have the virtual equivalent of student-pilots acting as pilots in command, with passengers. The Federal Aviation Administration forbids this because student-pilots who carry passengers put lives at risk. Luckily for us in academe, all that is at risk is our careers.
Tom Winter teaches Latin and Greek at the University of Nebraska–Lincoln and has been in college teaching since 1966. His e-mail address is twinter1@unl.edu.
Comment on the article
Note: Comments are reviewed prior to posting and will not appear on this page immediately
|