Scientific skepticism is the noble pursuit and accumulation of evidence, based on the scientific method, which is used to question and doubt claims and assertions. A scientific skeptic will hold the accumulation of evidence as fundamentally critical to the examining of claims. Moreover, a true skeptic does not accept all evidence as being equal in quality, but, in fact, will give more weight to evidence which is derived from the scientific method and less weight to poorly obtained and poorly scrutinized evidence.
In the world of real scientific skepticism, evidence published in a peer-reviewed, high impact factor journal far outweighs evidence taken from other sources. Peer review is the evaluation of a scientific work by one or more people of similar competence (usually in the same field) to the producers of the work. Mostly, the peer review is blinded, in that the reviewers generally don’t know the authors (although it may not be difficult to uncover, especially if the paper is in an esoteric field of science). Peer review constitutes a form of self-policing of science by qualified members of a profession within the field of research. It is through this system of criticism and review that makes many journals, and the articles published within, powerful pieces of evidence in science.
In addition to peer review, there are other ways to ascertain the quality of research in a particular journal. Articles in high quality journals are cited more often because high quality journals just attract the best scientific articles. Higher quality journals employ a more meticulous and exhaustive peer-review.
Although somewhat controversial, journals are ranked using a metric called “impact factor” that essentially expresses numerically how many times an average article in a particular journal is cited by other articles in an index of all other journals in the same general field. The impact factor could range from 0 (no one ever cites it) to some huge number, but the largest is in the 50-70 range. One of the highest impact factor journals is the Annual Review of Immunology, which is traditionally has an impact factor in the 50′s–this would indicate that an average article published in that journal is cited by other medical articles an average of 50 times (an outstanding number). Continue reading “Proliferation of fake peer-review journals”