RSSIn my experience most of the people doing statistics do not understand it. This of course is a consequence of making every single person study statistics. They even teach some of its ideas in elementary schools. Statistics mania. I remember one case when in some university some “statisticians” refuted the ability to understand statistics by some mathematicians that had not taken “statistics” courses. These “statisticians” obviously didn’t even know that the mathematical foundation of statistics involve topics of which even most engineers never hear (example: functional analysis, with calculus in measurable spaces, (advanced) theory of probabilities). There was in the NYT once upon a time an article telling the story how in some experiment 99% of the doctors gave the wrong advice based on the given data. Even professors of medicine. Therefore, the argument of the doctors that you provide do not move me one millimeter.
Placebo:
Suppose we study 100 people standing under the rain. 90 of them end up with their heads wet. Conclusion: Standing under the rain gets your head wet.
The study has been conducted without placebo, i.e., no one was told that he was under the rain when he was not.
Does the lack of placebo invalidate the study and the conclusion? Of course not. The study and the conclusion are very sound.
Randomness:
The same hundred people above did not randomly pick their geographical positions, they were told to stand in the areas marked with their initials. In some cases even more than one person ended up in the same area. Some areas were empty.
Does the lack of randomness invalidate the study and it conclusions? Of course not.