{"id":603,"date":"2018-05-14T08:30:00","date_gmt":"2018-05-14T12:30:00","guid":{"rendered":"http:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/?p=603"},"modified":"2018-05-13T20:05:45","modified_gmt":"2018-05-14T00:05:45","slug":"causal-inference-in-ecology-the-challenge-of-falsification","status":"publish","type":"post","link":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/blog\/2018\/05\/14\/causal-inference-in-ecology-the-challenge-of-falsification\/","title":{"rendered":"Causal inference in ecology &#8211; The challenge of falsification"},"content":{"rendered":"<p><a href=\"http:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/causal-inference-in-ecology\/\">Causal inference in ecology &#8211; links to the series<\/a><\/p>\n<p>It sounds so simple. You have a hypothesis. You design an experiment to test it. If the predicted result doesn\u2019t happen, reject the hypothesis and start over. That\u2019s how science works, right? We can\u2019t <em><strong>prove<\/strong><\/em> a hypothesis, but we can reject them. That\u2019s how we make progress. That\u2019s what makes science empirical. End of story right? Would I be asking that question if it were?<\/p>\n<p>Let\u2019s look at the logic a bit more carefully.<\/p>\n<p>The hypothesis we\u2019ve been using as an example is simple: If we apply nitrogen fertilizer, the yield of corn will increase. Our experiment is to till the soil in a field thoroughly, plant genetically uniform<sup><a id=\"ffn1\" class=\"footnote\" href=\"#fn1\">1<\/a><\/sup> corn, and apply fertilizer on one part of the field and not the other. The test of our hypothesis is whether yield in the fertilized part of the field exceeds yield in the unfertilized part of the field. For the sake of argument, let\u2019s suppose that the fertilized part of the field has the same yield (or less) than the unfertilized part of the field. Would you conclude that adding nitrogen fertilizer doesn\u2019t increase corn yield? I wouldn\u2019t, and I\u2019ll bet you wouldn\u2019t either. Why wouldn\u2019t we conclude that? My logic would run like this:<\/p>\n<ul>\n<li>I\u2019m aware of a lot of other experiments, including some I\u2019ve run myself, where adding nitrogen fertilizer to corn (and to other plants for that matter) increases yield.<sup><a id=\"ffn2\" class=\"footnote\" href=\"#fn2\">2<\/a><\/sup> There must have been something <em><strong>wrong<\/strong><\/em> with the experimental conditions.<\/li>\n<li>The experimental conditions include <em><strong>everything<\/strong><\/em> about the experiment.\n<ul>\n<li>It could be that I didn\u2019t do a good job of tilling the field and mixing the soil. Maybe the part of the field that I left unfertilized happened to have much higher soil fertility, more than enough to compensate for the added nitrogen in the part of the field with lower fertility. Maybe the part of the field I fertilized happened to have minerals in the soil that immediately bound the nitrogen so that it wasn\u2019t available to the plants.<\/li>\n<li>It could be that there was something wrong with the fertilizer. Maybe it was a bad batch and for some reason the nitrogen wasn\u2019t in a form that\u2019s available for plants.<\/li>\n<li>Maybe I didn\u2019t do a good job of randomizing the genetic background, and I happened to have families of low-yield plants in the nitrogen fertilizer treatment.<\/li>\n<li>Maybe I put on so much nitrogen that I \u201cburned\u201d the corn.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>The bottom line is, there are a <em><strong>lot<\/strong><\/em> of ways that the experiment could have gone wrong. When an experiment fails to give the prediction we expected, our natural tendency is to reject the hypothesis we were testing, but strictly speaking, we don\u2019t know whether our hypothesis is wrong, or whether there was something about our experimental conditions that made the experiment a bad test of the hypothesis.<\/p>\n<p>In short, falsifying a hypothesis is hard, and we can never be certain that it\u2019s false. It\u2019s only by assessing the reasonableness of the experimental conditions that we can determine whether it\u2019s our hypothesis or the experimental conditions that are faulty.<\/p>\n<p>To my mind this is why we trust causal inferences from carefully controlled experiments more than those from observational studies. In a carefully controlled experiment, we make everything about the treatment and control as similar as possible, except for the difference in treatment. That way if we see a treatment effect, we have a lot more confidence in ascribing the result to the treatment not something else, <em><strong>and<\/strong><\/em> we have a lot more confidence in saying that the treatment has no effect (and our hypothesis is satisfied) if we fail to observe the expected result.<\/p>\n<p>Next time we\u2019ll talk about how to apply similar logic to observational studies and explore the challenge of making causal inferences from them.<\/p>\n<ol id=\"footnotes\">\n<li id=\"fn1\">Or genetically randomized <a href=\"#ffn1\">&#x21a9;<\/a><\/li>\n<li id=\"fn2\">To be honest. I\u2019ve never run such an experiment with corn, but I\u2019ve run crude, unintentional experiments on a lot of plants I grow in my yard. I forget to fertilize some, and the difference is obvious. <a href=\"#ffn2\">&#x21a9;<\/a><\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Causal inference in ecology &#8211; links to the series It sounds so simple. You have a hypothesis. You design an experiment to test it. If the predicted result doesn\u2019t happen,&#8230; <a class=\"read-more-button\" href=\"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/blog\/2018\/05\/14\/causal-inference-in-ecology-the-challenge-of-falsification\/\">Read more &gt;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[],"class_list":["post-603","post","type-post","status-publish","format-standard","hentry","category-statistics"],"_links":{"self":[{"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/posts\/603","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/comments?post=603"}],"version-history":[{"count":3,"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/posts\/603\/revisions"}],"predecessor-version":[{"id":606,"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/posts\/603\/revisions\/606"}],"wp:attachment":[{"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/media?parent=603"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/categories?post=603"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/darwin.eeb.uconn.edu\/uncommon-ground\/wp-json\/wp\/v2\/tags?post=603"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}