Academics pay a lot of attention to the quality of their writings. It is generally a point of pride to publish flawless documents, and this is felt in scientific disciplines just as much as in literary ones. If I told you how much time the members of a scientific experiment such as CDF at the Tevatron or CMS at CERN (the ones I work in) spend in the review of their articles before these are sent to the publishers, you would be startled. Actually, let me just do it, since I promised it earlier this week.
The thing works like this: you, alone or with a small group of researchers, produce a scientific analysis and write a draft detailing your result. If you have gotten to that point, the analysis has already withstood close scrutiny as you presented it several times at the relevant internal "physics" meetings, receiving annoying questions all along. Among the questions, 20% were probably constructive, 30% were meaningless, 40% were pedantic, and a further 10% were asked just to make you feel inferior. But you got to the bottom of it, presented the analysis for pre-approval, gave a collaboration-wide approval talk, and feel happily accomplished.
Yet, you have not accomplished anything yet: the publish-or-perish rule dictates that you publish a written article, lest all your efforts will amount to nothing. And publishing a written article is a whole different matter from converging to an approved result. In fact, at this point, you have to get past a internal review committee of three peers. These are called "godparents" at CDF -a benign name indicating people who try to help, or an ominous one alluding to mafia bosses, depending to how you perceive it; in CMS they are called more neutrally "ARC" for "analysis review committee".
The internal reviewers scrutinize both your result (although it has already withstood extensive checks, while your godparents were on leave fishing) and the text you produce. On the latter, they advise on the quality of writing, they enforce certain conventions (from important choices such as the mathematical notation, to less meaningful ones such as the use of the serial "Harvard" comma in lists of items, to masturbation-level ones concerning the color of lines in a plot). Once they are ready, the paper is released for collaboration-wide review.
You would think that at this point -once your internal reviewers are happy- the article is close to being made public. Wrong! Any of the 600 (CDF) or 2500 (CMS) collaborators is now entitled to have a free shot at you, sending a detailed list of requested rewordings and corrections. I have oftentimes received, or alas, sent, lists of comments much longer than the paper itself. Authors need to answer each and every single comment received, and make sure that the paper is changed accordingly; unless they oppose the offered change, in which case they need to explain the reason of their denial, convincing the internal reviewers that they are right and the offending comment is wrong.
After the first reading, a second draft incorporating the changes is approved by the internal reviewers and again sent around, and there again all the collaborators have a free shot. More nasty comments and requests for corrections pour on you, a new iteration follows, a new placet by the internal reviewers is waited for. At the end, the collaboration takes a live final reading of the whole article, where again everything may be rewritten. Whether an improvement is made or not at this final stage, is a quite tough question.
Then, finally, the article is sent to the scientific magazine, where external reviewers will have a chance to further bother you. But this last step feels like a caress after a slap in the face. While the internal review may have lasted months, this last step is usually limited just by the speed at which the magazine finds reviewers and twists their arm into sending a positive judgement back.
Now, if you think that the above baroque, surreal, ridiculous procedure is crazy, you might be right. But unfortunately if an academic is jealous of the quality of his or her writing, you well imagine how hard it is to get an agreement between a thousand or two of them. So there is little else to do but follow the rules, if you want to publish.
I will not discuss further whether this procedure makes sense, but I wish to just point out here one of its striking positive qualities. It is extremely democratic! As a collaborator, you sometimes play the good guy -the one who tries to publish and gets all the heat- and sometimes play the reviewer, or the peer who sends nasty comments and corrections just for the sake of it. And further, your comment as a PhD student may be worth just as much as that of a senior professor -nobody knows everybody else, so if they do not know you, they must take you seriously!
A different question, however, is whether the iter could be sped up. We live in an age of competition: the old days when CDF was the only experiment capable of playing with 1800-GeV collisions is long gone, and now DZERO competes with CDF. ATLAS and CMS, on the other side of the Atlantic, are sharpening their knives in the attempt at being the first experiment to claim evidence for this or that new physics effect. Can the procedure be made shorter ? Of course, it can. And I believe that all the experiments are working toward making their review procedures faster, while keeping the highest standards.
One final point I wish to make is the following: the time wasted in the internal reviews is huge. I believe that the scientific output of any of the large collaborations I mentioned might increase by at least 20% if the main authors of a scientific result were held responsible of their drafts, and collaboration-wide reviews were canceled. But then, of course, you might be seeing your name appear on the first page of a publication using "centER-of-mass energy" instead than the British-kosher "centRE". The horror, the horror.
(Be sure to understand one thing: I am not blaming anybody nor anything in particular for the above baroque procedures, or for the annoying reviews. I myself am a master-masturbator, since I have sat in internal review committees for over a dozen publications, significantly annoying a couple hundred people in the process; what is more, I have been for the past two years a member of one special group in CDF, called "Spokespersons Publication Review Committee" which really looks for nuisances in each and every publication draft that CDF produces; and in two years as a SPRG member, I have annoyed basically all the remaining colleagues within CDF. But I am not catholic, so I may jolly well cast the first stone even if I am a big sinner!)
Scientists, Ye Pedantic Jerks
Comments