Monday, May 30, 2005

How Google News works

Joi writes about a presentation by Krishna Bharat titled: Inside Google News where Bharat explained how Google News works. [Dan Gillmor pressed Krishna for more transparency on the algorithm and the list of sources.]

Google News basically crawls news sites, finds "story clusters", ranks the sources, figures out how prominently each source is running the story, figures out whether its a big story or a little story, figures out geographic references, and builds the pages for the various geographic and language editions. He was talking to an audience of editors so there were many questions about how the "editing" process worked and many people couldn't seem to believe it was algorithmic. Some people seemed afraid that Google News would replace them. The point that he made and was clear from the process that he explained is that it uses the decisions that the editors of the various media make about what story to run and where in deciding how important a story was. It was basically aggregating the decisions of the editors, not replacing them. Without the editors and the "front page process" Google News couldn't decide what story to lead with. At least in its current form.

The derivative conclusion you can come to is that Google News is just amplifying or reinforcing systemic biases in MSM editorial and NOT helping to address these issues. I think this make Google News very news media friendly and also provides an opportunity for bloggers and projects like Global Voices to still have a very important role. I guess that if Google New started incorporating more of the alternative press, they could shift the bias.