Dueling PhDs
Our chief consultant writes:
We come to the hardest problem to set a layman: suppose there are two (or more) experts, that is, people who disagree strongly about some scientific or technical question, each of which has some claim to expertise. Call this “dueling PhDs.” You, as a layman, are called upon to decide between them. What do you do?
We assume that the matter is advanced or esoteric enough that there’s no question of you actually checking the math yourself. Also, that it’s not a matter of current research, where the answer really isn’t known. (That excludes, for instance, Stephen Hawking and Roger Penrose disagreeing about the Nature of Space and Time.)
You could try to evaluate the credentials of either side, working out whose PhD is stronger; or take of vote of scientists working on the matter; or, perhaps, decide on the basis of motivation, asking who is funded by whom. Slightly more useful is analyzing the rhetoric, on the assumption that someone with a poor scientific case is more likely to try to cover it with noise. All of these techniques leave us uneasy, and though we have some suggestions on how to use them we prefer a harder, more time-consuming method as a more reliable way of getting at something like the truth.