Guess What? Traditional Search Engine Reviews are Flawed! What Does That Say About the Engine?

: Image via Wikipedia

Fascinating post by Louis Gray, over louisgray.com, one of my favorite blogs about all things Web and social media-related. Apparently, Microsoft hosted a get-together Tuesday evening about semantic search engine Powerset and its incorporation into Microsoft’s Live Search. One of the topics discussed was how search engine reviewers perform their “craft” and how ineffective their process really is in gleaning an understanding of this complex endeavor. And the effect of this inefficient review might be to sink the better option.

This result seems particularly true as search engines become more complex in design and practice. To truly understand how effective a search engine might be, one needs to spend some time with the engine, put it through its paces and delve deep into the results. “Teaching” search engines to “think” like humans takes time, and recognizing when the engine “gets it right” should also take time.

As I have said before here, when search engine’s compete to grab out attention, we the researchers stand to win the grand prize. In Louis Gray’s words, for Microsoft, “building the better mousetrap” will only be half the battle in the war of the ‘engines. Can’t wait to see the “results.”