Skip to Main Content

Critical Evaluation and Identification of Sources

Consider Source Bias I

Factual Reporting vs. News Analysis
"Evaluating news sources is one of the more contentious issues out there. People have their favorite news sources and don't like to be told that their news source is untrustworthy.

For fact-checking, it's helpful to draw a distinction between two activities:

  • News Gathering, where news organizations do investigative work, calling sources, researching public documents, checking and publishing facts, e.g. the getting the facts of Bernie Sanders involvement in the passage of several bills.
  • News Analysis, which takes those facts and strings them into a larger narrative, such as 'Senator Sanders an effective legislator behind the scenes" or 'Senator Sanders largely ineffective Senator behind the scenes.'

Most newspaper articles are not lists of facts, which means that outfits like The Wall Street Journal and The New York Times do both news gathering and news analysis in stories. What has been lost in the dismissal of the New York Times as liberal and the Wall Street Journal as conservative is that these are primarily biases of the news analysis portion of what they do. To the extent the bias exists, it's in what they choose to cover, to whom they choose to talk, and what they imply in the way they arrange those facts they collect. The news gathering piece is affected by this, but in many ways largely separate, and the reputation for fact checking is largely separate as well." [italics and emphasis added]

Quoted from Michael A. Caulfield's Web Literacy for Student Fact Checkers. 26: Evaluating News Sources.

Consider Source Bias II

Some organizations have researched news organizations and charted the general accuracy of their news reporting and their political positions. Prominent among these is Ad Fontes Media. Ad Fontes has created and periodically updates a Media Bias Chart which categorizes news sources on two dimensions--accuracy of their factual and investigative reporting on one dimension and, in a second dimension, their editorial positions on a left to right scale. Ad Fontes also exposes their rating methodology.

Rating systems like this can be a useful adjunct to your own research and evaluation of the news sources that you rely on. Sources that do their own investigative work and are accountable to journalistic standards of fairness and accuracy are going to be more reliable than news organizations that do not commit these standards.

Understanding Bias

undefined