In reporting the scandal about the Norwegian cancer research, the NYT had the following unnerving comments:
A special feature of epidemiological studies like Dr. Sudbo’s is that they involve large numbers of patients and are unlikely to be repeated by other laboratories. Replication is considered the most reliable test of scientific quality.
The full text is here
It is a severe accusation to a scientific field (and in fact to all social science fields) in which observational studies are popular.
It seems to me that the author, Nicholas Wade, doesn’t understand the meaning of “replication,†at least in social science. He narrowly defined “replication†as “repeated by other laboratories.†We certainly won’t be able to replicate the study per se, and we may not be able to get the same numbers (e.g., odds ratios) from other studies. However, what is important in social science is that we can replicate the study findings, and that the findings are consistent in different populations and in different types of studies.

