One reason there is so much Bad Science, as I have said many times, is that there is too much science. Rather, too much activity in the name of science. There are too many people calling themselves scientists, and too much money spent in the name of science.
Except for the rare scientists who labor for themselves or for those who have a direct interest in their output, which is to say, those who have skin in the game, most scientists almost never suffer for poor work. Indeed, they can even put out the most atrocious theorizing, as you and I have seen together these many years, as long as that theory aligns with whatever narrative is current in their individual fields. Indeed, this is the very history of science.
How nice would it be to dock the pay, even retroactively, of scientists whose models and theories turn out to match Reality badly, or not at all? Hit ’em where it hurts. No better political strategy. And where does it hurt the most? In the wallet. Not in the theory. Fear of failure would then be real, and gripping. It would cause a dramatic fall in the rampant over-certainty from which we all suffer.
The National Association of Scholars has some ideas along these lines.
They have put forward a series of suggested Acts that Congress might adopt to kick scientists’ butts and bring them, at least to some extent, back to Reality.
Now as we all know lobbyists write the laws for Congress, the members of that august body being too busy rooting up funds for their next campaigns. Bowing to this truth, the NAS helpfully drafted a slew of Acts to put scientists’ models to the test or else no funding. This is the way.
Take the proposed Mathematical Modeling Reform Act. It has such items as “Preregistered Mathematical Models. The {Centers for Disease Control and Prevention} after {Month Day, Year} may include only preregistered and publicly accessible mathematical models in all forecasts, policymaking, and interventions.” (You have to love how easy they make it for Congresspersons: just fill in the blanks.) What’s a model? The Act gives the definition:
“Preregistered mathematical models” shall be defined as mathematical models whose registered report, including associated protocols, prospective validation practices, specified, agreed-upon rules for judging success and/or the need for recalibration, computer codes, data analysis scripts, and statistical analyses are archived on an online digital repository in a manner sufficient for continuing independent inspection, replication, reproduction, and/or verification. This online digital repository shall have archival and accessibility capacities at least equal to those possessed by the Open Science Framework on December 31, {Year}.
Naturally, the phrase prospective validation practices is near and dear to my heart. This is the Predictive Way I have been rattling on about for years, shouting into the void pleading for ears to hear. See the Class for why!
Then there is the Weight of Evidence Act which requires agencies to spell out “‘weight-of-evidence’ judgments with transparent and explicit rules with consistent definitions, consistent inclusion criteria, consistent exclusion criteria, and consistent weighting criteria”. The Reproducible Policy Act mandates federal agencies “shall within five calendar years of {Month Day, Year} rescind all significant regulatory actions and highly influential scientific assessments that the commission described in subsection (4) determines no longer possess sufficient scientific justification.”
The Replication Studies Funding Act would create an Office of Reproducibility Research, which I do not love because of the marriage of Parkinson’s Law and Pournelle’s Iron Law of Bureaucracy. Give them the chance to create a metric that proves they’re doing their job, and they’ll do so, then maximize it and then reify it so that it becomes The Science. Far better to require putting science used in policy to the test and demand its replication.
On the other hand, some metrics can sometimes be used to good effect. Perhaps that is so with the proposed Negative Research Act: “After {Month Day, Year}, the {National Science Foundation} may not fund any research grant program, or provide dedicated funding to any scientific discipline, which reports more than 65% positive results during five consecutive years of funding.”
The idea is that only “good” news is welcomed by peers in peer-review, and it’s about time for some bad. The exact specification makes me nervous, however.
“What about DIE, Briggs? They hit that?”
They did, in the Science Depoliticization Act.
Agency Depoliticization. The {National Science Foundation} may not:
- use ideological litmus tests in any administrative policy;
- use discriminatory concepts in any training for staff, partner institutions and individuals, or grant recipients;
- encourage, discourage, require, or forbid staff, partner institutions and individuals, or grant recipients to endorse, assent to, or publicly express a given ideology, political stance, or view of social policy in any administrative policy; or
Et cetera, et cetera. This includes no preferential funding for Victims, which ought to cause a lot of howling.
They have a few more. Take a look. Of course, there seems little chance of passing any of this now. But once Dictator-On-Day-One Trump seizes office, as the left insists with all their might will happen, then Trump will simply dictate science must adhere to Reality.
Subscribe or donate to support this site and its wholly independent host using credit card click here. Or use the paid subscription at Substack. Cash App: \$WilliamMBriggs. For Zelle, use my email: matt@wmbriggs.com, and please include yours so I know who to thank.
Excellent thoughts. But as you sagely note, the totalitarian/statists will die before surrendering dei. The left is utterly immune to facts, reason, and consequences EXCEPT where those things threaten their grasp of power. Then they are ruthlessly defensive
So it will continue to impossible to do proper science as long as they hold sway.
Yes, reality always wins. Sadly, that is sometimes Pyrrhic.
We must pursue the alternatives. Just as the bureaucratic state originally insinuated itself into decent society to do its damage, so we too must be patient. Be the virus that cuts them at the source. A “bacteriophage of reason,” so to speak.
Details on request.