![George Bishop](https://www.uc.edu/news/articles/legacy/enews/2010/02/e11356/jcr:content/image.img.cq5dam.thumbnail.500.500.jpg/1534517176698.jpg)
'Dubious' Achievements from Polling World Revealed in UC Prof's Rankings
Heres a statistic that is impossible to argue against: When shown numbers that result from a compromised or poorly-designed poll, 100 percent of those reading the poll come away misinformed.
University of Cincinnati Professor of Political Science George Bishop, one of the nations top experts on proper polling methods, has teamed up with the University of New Hampshires David Moore to again do battle against examples that came out in 2009 of just that kind of polling. Their
second annual Dubious Polling Awards,
which have just been published by the media ethics Web site
., lists 10 of the most suspect moments in polling from the last year.
Employing a scale of 1-5 crossed fingers to indicate just how flawed each example on the list was, Bishop and Moore decided three examples rated the worst ranking of five crossed fingers:
That was just the start of questions, though, Bishop and Moore report, as basic information as to whether Strategic Vision actually had any offices they claimed to operate out of four cities and where the workforce was that did their polling began to be asked.
The problem was, Bishop and Moore write, that the figure claimed in the survey was anywhere from seven to 14 times as high as any comparable study, and Burnham refused to provide any documentation to back up how his survey was conducted. When called on it, the Bloomberg School then refused to investigate.
The problem is revealed when you learn that less than one-in-four respondents could accurately link the term cap-and-trade to the energy and environmental field, and more than 50 percent of those asked admitted they knew nothing at all about such policy. Bishop and Moore, then, are left with the conclusion that the polling organizations could only conduct polling by feeding information to the respondents, producing polling results that were all over the place. The Zogby poll on the subject showed opposition to such a policy by a two-to-one margin, while cap-and-trade when polled by CNN produced a result of two-to-one in favor of the idea. As they note: Once pollsters give information to their respondents, their samples no longer represent the larger population, which has not been fed that same information.
Plenty of others were in the running for honors, including more of the biggest names in the polling business. Thats just the point, though, in an exercise like the Dubious Polling Awards, which highlights the fact that bad polling can come from anywhere, large firms or small, political issues or otherwise. Its up to the end user to be discerning in what any polling is actually showing.
Establishing that standard has been a career-long quest for UCs Bishop, whose most recent book is The Illusion of Public Opinion: Fact and Artifact in American Public Opinion Polls. Not all polling is created the same way, nor practice the same way.
"The quality of measurement in public opinion surveys varies considerably between academic and commercial polling organizations, says Bishop. The results of mass media-sponsored polls often give the impression that a definitive public opinion exists on numerous issues of public policy when there is, in fact, widespread public ignorance and poorly informed opinions on such issues at best."
As an example, Bishop cites the recent Pew Research Center poll showing how little most Americans know about politics and public affairs. Asked 12 relatively simple questions about news and current events, most Americans could not answer even half of them correctly.
(You can take the political news quiz for yourself and see how you fare at the Pew Research Web site.
Bishops partner on the project, David Moore, has a long and distinguished history in the public opinion field, as well. Currently a senior fellow with the Carsey Institute at the University of New Hampshire, he is a former vice president of the Gallup Organization and was a senior editor with the Gallup Poll for 13 years. His most recent work is the book The Opinion Makers: An Insider Exposes the Truth Behind the Polls.
Bishop and Moores entire story about this years Dubious Polling Awards can be read online at the Stinky Journalism Web site.
Related Stories
Mural by UC grad honors U.S. military history
![Local 12 logo](/content/dam/refresh/uc-news/news-icons/dark/wkrc-logo-dark.png)
July 17, 2024
Local 12 highlighted a new mural by University of Cincinnati graduate and artist Brandon Hawkins that pays tribute to U.S. military history.
Social media fuels extreme political rhetoric
![Local 12 logo.](/content/dam/refresh/uc-news/news-icons/dark/wkrc-logo-dark.png)
July 17, 2024
UC College of Arts and Sciences Professor Jeffrey Blevins tells Local 12 that online algorithms fuel political polarization on social media.
NIS program opens new horizons for international student
July 17, 2024
In his pursuit of physics and a taste for research, Akash Khanikor ventured from his hometown in India's Assam to the University of Cincinnati, drawn by the promise of hands-on exploration early in his undergraduate career as a NEXT Innovation Scholar.