You all know about the issues of weighting samples to achieve representativeness. In polling this is an art. But even if you get to representativeness, depending on the average sample sizes the polls themselves will exhibit a distribution of outcomes about a mean. Therefore with a large enough sample space of polls you can find one at a tail of the distribution of outcomes. Today with the proliferation of polling this is getting to be more and more of a problem. Look at this musing by Joshua Micah Marshall: A Feingold Comeback? He notes: “A new independent poll has Feingold down by only 2 points.” A thickly polled state will come back with a range of results. Even non-internal polls (which are often curated for maximum effect on the press, and so shouldn’t be trusted) will exhibit a normal distribution of results, so if you want to hinge an argument on one poll, it is fast becoming a trivial task to find that poll to satisfy your needs. In 2008 the less intelligent set of conservative bloggers expressed ideologically motivated skepticism of polls (grounded in the fact that they were too stupid to know any better). What excuse does the self-proclaimed “reality based” party of pointy-headed intellectuals have in 2010?
Whatever happens, 2012 will be even worse. The number of polls is going to up, and verbally oriented bloggers and reporters will cherry-pick outliers to produce whatever narrative they wish to roll out.