18 April 2011

MOUNTAIN VIEW, California: The head of Googles search evaluation team shakes his head dismissively at the idea that the firms winning Internet-sifting formula is completed.

Far from it. Software engineers reverently refine Googles search algorithm so consistently that it often ends a day a tad different from when it started.

Scott Huffmans team tested many more than 6,000 changes to its search engine in 2010, with 500 of them passing the grade to become permanent.

We have changed engines on a flying plane so many times it has become second nature to us, Google fellow Amit Singhal said, referring to how Internet firms modify services while they are live online.

Alongside changing the engines, the plane has become quieter, the ride got more comfortable, and we even changed your seat while you were sleeping, he continued. We just do it in small steps that go unnoticed.

Singhal said Googles search is tweaked, on average, twice in a working day. On the one hand, we want to be moving quickly and we want to make great changes, Huffman said. On the other hand, we dont want people to come to Google and say they dont recognize it.

Google in February took the unusual step of spotlighting an improvement to its secret search formula in the U.S.

The move was part of an ongoing duel between the search titan and low-quality websites that feature only content copied from elsewhere on the Internet or use techniques to trick their way high in results.

The feedback has been tremendously positive from users, Singhal said in an interview at Googles headquarters in Mountain View, California.

Overwhelmingly, the change raised ranks of high-quality sites and dropped ranks of low-quality sites.

Huffmans team is responsible for insuring that ideas for improving Google search results do just that.

People are not just expecting a search engine to return every document that has most of the words typed in a query box, Huffman said. They want the context understood; there are a lot of nuances hidden within that.

For example, someone searching with the word Japan is likely interested in real-time news about the tsunami tragedy there as well as other information about the nation.

One of Huffmans favorite broken queries from a couple of years ago was the term Thai restaurant.

General Web searches kept giving top rank to a Thai restaurant in the upstate New York city of Schenectady.

I used to go complain to the ranking people, Huffman recalled with a laugh. Im in Mountain View. It might be a great Thai restaurant, but Im not going to Schenectady to get Pad Thai. It just isnt going to happen.

Google began letting users set locations so that the search engine could factor proximity into the produced results when appropriate.

Proposed changes to Googles formula are first tested on a separate set of computers that imitate real-world search. Those deemed worthy are next sent to evaluators around the world who act as online searchers and rate the relevance of results in various languages and regions.

Google then does live testing, with promising algorithm enhancements carefully blended into results served up by the main search engine.

At any given time, some percentage of our users is actually seeing experiments, Huffman said.

It is interesting because users dont know what is happening, he continued. Of course, we dont put things out there that are terrible; we have filters to know when something is bad.

Google believes that delivering the most relevant search results to people as fast as possible is best for their bottom line and steers away from useless spam websites and content farms.

If we care about our users dont care about money everything else just falls in line, Singhal said.

Copyright The Daily Star 2011.