Google Beats Bing at 'Jeopardy!'
In two weeks, the show will air a much-hyped man vs. machine challenge, pitting champs Ken Jennings and Brad Rutter against IBM's latest computer.
Google beats Bing at Jeopardy!
Ahead of the heavily promoted man vs. machine challenge (in which champs Ken Jennings and Brad Rutter will face off against IBM's latest computer, Watson), a computer expert Stephen Wolfram pit the two search engines against each other.
Wolfram fed a random sample of 200,000 Jeopardy! clues to the engines and tallied how many times they retrieved the correct answer on the first try in the top document displayed, according to the New York Post.
Google had the correct answer in the first page of results 69 percent, Ask.com came in a close second with 68 percent, and Bing had 63 percent. Wikipedia only had the right answer 23 percent of the time.
Google also had the correct answer as the first result 66 percent of the time, with Bing trailing at 65 percent, and Russia's Yandex.com with 58 percent. Ask.com had 51 percent.
The average person gets the correct answer 60 percent of the time. Jennings did so 79 percent.
"In the last couple of weeks, though, I've gotten curious about what's actually involved in doing the 'Jeopardy' task. . . What's the most obvious way to try doing 'Jeopardy,' " Wolfram, 51, wrote in a blog item on his Web site.
IBM also did early tests with search engines while developing Watson, finding accuracy about 50 to 60 percent of the time.
"[Because you]cannot have the host read 10 documents for you," IBM spokesperson Michael Loughran says, "Fifty to 60 percent accuracy would not even qualify you for Jeopardy!, never mind let you compete with champions."