Eye-tracking Proves Real-Time Search Not Useful
OneUpWeb recently released the results of an eye-tracking study on Google’s new real-time results integrated into SERPs—and it looks like the search giant might have just wasted $15M (the estimated cost of Google’s deal with Twitter).
The study segmented web users into two groups: consumers and information foragers. It took consumers 7.09 seconds to look at the real-time results, even though they’re listed just below the news results and before the organic results. In fact, they scrolled below the fold to view the image results before they fixated on the real-time area, the eleventh area they focused on.
Information foragers took slightly longer to turn to the real-time results: 7.39 seconds. It was the thirteen area their eyes focused on—but the first 12 areas were all just above the real-time results in the news results. (The search task here was to research a selected current news item using the search engine of choice—for 89% of all participants, that was Google.) (Side note: I’m not sure why the times in the above graph are so much higher than the numbers OneUpWeb also provided that I used in these paragraphs.)
The second search task was segmented by group—the consumers were to look for a product they were considering to buy for themselves or for someone else as a gift. Information foragers were to again look for information on a current news topic. Interestingly, in this second set, consumers were five seconds faster than information foragers to focus on real-time results.
Meanwhile, 20% of consumers and 30% of information foragers actually clicked on real-time results, as opposed to 69% of consumers and 60% of information foragers that clicked on the top 5 results excluding real-time.
I’ve long argued that real-time results will only be helpful for a very small, select set of data—and for that set, most people would know to go to Twitter or Facebook in the first place anyway. I’m not the only one. The Guardian’s Charles Arthur points to several others who feel the same way, most notably Nick Carr, who sardonically chronicles the efforts to organize the web’s information around 140-character ephemera.
And yet Google insists that this information is useful and must be foisted upon the user. Aruther quotes Marissa Mayer last summer:
We think the real-time search is incredibly important, and the real-time data that’s coming online can be super-useful in terms of finding out whether – something like, is this conference today any good? Is it warmer in San Francisco than it is in Silicon Valley? You can actually look at tweets and see those types of patterns emerge, so there’s a lot of useful information about real-time interactions that we think ultimately will really affect search.
Apparently users don’t quite agree yet.
What do you think? Are real-time results useful?