Quantcast
  • Register
PhysicsOverflow is a next-generation academic platform for physicists and astronomers, including a community peer review system and a postgraduate-level discussion forum analogous to MathOverflow.

Welcome to PhysicsOverflow! PhysicsOverflow is an open platform for community peer review and graduate-level Physics discussion.

Please help promote PhysicsOverflow ads elsewhere if you like it.

News

PO is now at the Physics Department of Bielefeld University!

New printer friendly PO pages!

Migration to Bielefeld University was successful!

Please vote for this year's PhysicsOverflow ads!

Please do help out in categorising submissions. Submit a paper to PhysicsOverflow!

... see more

Tools for paper authors

Submit paper
Claim Paper Authorship

Tools for SE users

Search User
Reclaim SE Account
Request Account Merger
Nativise imported posts
Claim post (deleted users)
Import SE post

Users whose questions have been imported from Physics Stack Exchange, Theoretical Physics Stack Exchange, or any other Stack Exchange site are kindly requested to reclaim their account and not to register as a new user.

Public \(\beta\) tools

Report a bug with a feature
Request a new functionality
404 page design
Send feedback

Attributions

(propose a free ad)

Site Statistics

205 submissions , 163 unreviewed
5,047 questions , 2,200 unanswered
5,345 answers , 22,709 comments
1,470 users with positive rep
816 active unimported users
More ...

  What are some historical examples where journal peer-reviewing blatantly failed?

+ 4 like - 0 dislike
3416 views

By historical "failures" of the journal peer-reviewing process, I specifically mean cases, where a paper about today in mainstream physics accepted and more or less important physics has been rejected (first) as the author(s) tried to submit it to a peer-reviewed journal.

I know that I have heard or read that this happend even to today very famous physicists, but I have trouble in retrieving these examples and the corresponding sources where one can read about it.

So can people give me some examples which I can use to underline the importance of the Reviews section of PhysicsOverflow, for example here ?

(Converse cases, where nonsense is accepted in peer-reviewed journals (and even globaly hyped in popular media channels!) are unfortunately easier to find, in particular today ... )

asked Aug 26, 2014 in Resources and References by Dilaton (6,240 points) [ revision history ]

1 Answer

+ 5 like - 0 dislike

Famous examples are easy to find, but the worst cases are things which you can't document--- they are cases of self-censorship, where important results are not published because the authors know already that they won't pass review, from introspection, so they work on something else. This has the effect of letting prominent journal referees navigate the research direction of a whole field, and to reduce the true creative work to a handful of people at the top.

But you can find outright failures of peer review very easily. Peter Higgs's paper was rejected on the first submission (the referees thought it was wrong), and then accepted a few weeks or months later on second revised submission, after Higgs added one prosaic sentence at the end. The one sentence obviously was not important, what happened was likely that either the referee or the editor read Brout/Englert, or else they ran it by someone who knew something about something, like Gell-Mann or somebody, who then said ok.

By contrast, Marco Frasca's recent papers based on a nonsense non-result have gotten positive enough reviews to get published in journals (and they get cited too). A paper with completely wrong or speculative results paradoxically doesn't have such a hard time, because such a paper is never threatening to anybody, it doesn't contradict something you thought you knew. This is especially true if it pretends to be in a different field, and is sent to experts who can't be bothered to check the arguments in detail, or don't have time. Open peer review fixes this.

The experimental failures are most notorious, they get the most press, because here you have fabricated data, and this is usually easy for people who work in similar experiments to catch, but not for a randomly chosen referee. So open peer review can immediately and quickly catch such fraud, but journals have admitted fabricated data in the past. Open peer review can also catch bad methodology, for example, see this stackexchange answer regarding nonsense:  http://physics.stackexchange.com/questions/23725/is-the-emdrive-or-relativity-drive-possible .

You don't have to go famous examples--- my own paper with Jennifer Schwarz ( http://arxiv.org/abs/cond-mat/0301495 ) faced a split decision (one referee for publishing, the other against), and the one against was more adamant. I was forced to make the language of the proof of the main theorem much more formal and general, and less comprehensible, Jen was forced to do redundant work on figures and evidence for obvious things, it was a major annoyance, and the paper quality was gradually diminished in the process (you can compare first to last revision). This was not even a major controversial paper, it was just a precise clarification of what was going on in Fisher-Schwarz depinning models. I had just started working outside of academia, so the hostility was much greater than for worse papers with less important results coming from an academic institution. The referee against never changed his mind, the PRL editor just accepted it anyway (after a full year of back and forth) despite the referee's judgement. You can't count on such enlightened editors.

That's another effect of peer review--- the results are biased towards admission of papers by famous academic authors, and against those coming from unknown people outside of academia. This bias is terribly political, and has the effect of shutting up the discourse to a small handful of experts.

An extremely common situation is not wrong results, or good results suppressed, but a generally accepted wrongness and slow decay, coming from papers which misrepresent earlier results to make their current result seem more new. This is the situation in this stackexchange question: http://physics.stackexchange.com/questions/45626/fermi-surface-nesting-and-cdw-sdw-sc-orders . The paper is relatively honest and original regarding density functional calculations, but contains misunderstandings regarding the subject of the simulation. It also wants to argue that standard heuristics fail, that makes their calculation more important, but it is not clear that these heuristic fail, their arguments do not support them. The referees job is to evaluate the DFT, not the summary of other literature in the paper. That stuff can easily slide when you have a handful of referees, it can't go by in open peer review. Plus, it's an honest mistake, all you need to do is point it out, and it should get fixed.

All papers on string theory were rejected as a matter of routine in mainstream physics journals from 1970 on, the papers appear in a handful of journals which still accepted string theory work, most prominent is Nuclear Physics B.

In prehistoric times, Ernst Stueckelberg's renormalization paper was rejected in 1941, Stueckelberg invented modern perturbation theory.

Lack of citation of people who are not known is never punished, but lack of citation to famous papers is punished. This creates a bad citation climate, where citations accrue by a rich-get-richer method. For an example of citation mistakes, there's David John Candlin's paper on Candlin variables (Grassman variables, fermionic path integral), which was published but hardly ever cited, people instead citing a later textbook review of Berezin's with no reference to Candlin.

The peer review process as we know it today never worked as intended, that is, it never worked to keep the journals accurate. There are wrong papers all over the literature, to find one, open any journal and read. What it did do was increase the power of a certain group of top people to control what was in the literature. When these dictators are good people (like, say, Witten), you get good literature. When the dictators are small-minded, you get closed fields with no progress, because people know that original work will be rejected.

There is no need to rely on dictatorship anymore, we have an internet, and anyone with a refereeing comment should be able to make it easily and quickly, and get an answer from the author. This is ten-thousand times more grueling than convincing two referees and an editor, and paradoxically enough, also more forgiving, because even when there are hostile referees, the upvotes you get from silent folks will show the controversy (if it exists) and it is very fast to find what are actual mistakes that you made, and what is just political nonsense. All that is required is no censorship whatsoever, and complete inclusion.

answered Aug 26, 2014 by Ron Maimon (7,720 points) [ revision history ]

Your answer

Please use answers only to (at least partly) answer questions. To comment, discuss, or ask for clarification, leave a comment instead.
To mask links under text, please type your text, highlight it, and click the "link" button. You can then enter your link URL.
Please consult the FAQ for as to how to format your post.
This is the answer box; if you want to write a comment instead, please use the 'add comment' button.
Live preview (may slow down editor)   Preview
Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
Anti-spam verification:
If you are a human please identify the position of the character covered by the symbol $\varnothing$ in the following word:
$\varnothing\hbar$ysicsOverflow
Then drag the red bullet below over the corresponding character of our banner. When you drop it there, the bullet changes to green (on slow internet connections after a few seconds).
Please complete the anti-spam verification




user contributions licensed under cc by-sa 3.0 with attribution required

Your rights
...