Case Study:
Google vs. Bing – Search Engine Preference
by Catalyst Group
This study compares user impressions of the Google and Bing search engines. Catalyst Group shares feedback from participants and eye tracking data regarding advertising space.

This report compares Microsoft’s new search engine, Bing, with Google.
Our goal for this study was to gather users’ general impressions of the Google and Bing search engines, including overall functionality, presentation of content, and overall fit with user expectations and needs. We also wanted to see how much attention users paid to advertising space on the two sites.
Objectives
Gather users’ general impressions of the Google and Bing search engines, including overall functionality, presentation of content, and overall fit with user expectations and needs.
Ad Space Performance
To gauge the amount of attention paid to advertising space on the two sites and to determine if any aspects of the page design might influence this.
Future Use
Gauge users’ reaction to the overall value of the Google and Bing search engines and their willingness to use or continue to use one or the other.
Methodology
1. Participants
- 12 users were tested.
- All users reported they used Google as their main search engine. We were not able to locate users who were not familiar with Google to some extent.
- None of the users had used Bing.
2. Eye Tracking
- Users performed a “hotel search” and a “shopping search for digital cameras” on both Google and Bing.
- Eye Tracking data was collected for the Homepages and Search Results pages (i.e. the 1st and 2nd pages that users saw).
- None of the users had used Bing.
3. Retrospective Analysis
- Users were shown a replay of their Eye Tracking recording and asked to provide a commentary on their thoughts and actions.
4. Think-Aloud & Review
- Users were asked to comment on expectations, likes/dislikes, ease/difficulty, suggested improvements, usefulness, etc.
5. Survey
- Users were asked to complete a short survey to sum up their sentiments.
Key Insights


This is an excerpt from a June 2009 report, download the full version here.
This content was provided by Catalyst Group. Visit their website at www.catalystnyc.com.
Other content shared by Catalyst Group
Wait, I can do what? (A study of Amazon and Netflix on-demand video services)
by Catalyst Group
This report shares findings on the user experience for Netflix and Amazon On-Demand movie services. Follow the process of Catalyst Group from stated objectives through observations and insights. Read Article »
eReader Showdown – Kindle 2 vs. Sony eReader
by Catalyst Group
This report compares the user experience of the Amazon Kindle 2 versus the Sony eReader, looking at aspects such as physical design, interface design and shopping experience. Catalyst Group details their objectives, methodology, insights and observations. Read Article »
Eye Tracking Study: Friends List Layouts
by Catalyst Group
This eye tracking report from May 2009 looks at the usability and design of friends lists on social networking sites Facebook and LinkedIn. Read Article »
Putting the "trust" back in Bank & Trust
by Catalyst Group
Catalyst Group performed both quantitative and qualitative research to compare consumer perceptions of "trust" in terms of banks. Specific institutional websites were compared using eye-tracking studies and interviews. Read Article »
Online Dating: Usability Study Report
by Catalyst Group
This study evaluated two top online dating sites for usability - eHarmony and Match.com. Users shared their experiences and perceptions of the two sites in interviews and eye-tracking research was conducted. The results were interesting and pointed out issues with technology facilitating emotional connection and chemistry between users. Read Article »
Extra Credit: An Eye Tracking study of Credit Card Websites
by Catalyst Group
This study takes a look at three major financial services websites: chase.com, capitalone.com, and discovercard.com. The goal was to gain some understanding of what company makes it easiest (and most difficult) for users to complete the crucial task of “applying for a new credit card”. The study was structured to gather and compare eye tracking data during task completion relating to several metrics. Read Article »
Beyond Red and Blue: Insights into the Design of Presidential Candidate Websites
by Catalyst Group
So much has been made of the role of the Internet in the 2008 presidential election. In particular, the Obama campaign made some impressive claims about the success of BarackObama.com in fund-raising and organization of supporters. Even on the most superficial level, the two candidate sites have a lot in common in terms of structure and content. But, to our eyes, there are many differences in terms of the design approaches taken by the two organizations. We wondered how ordinary voters might see these differences, so we conducted a comparative usability study of the two sites. Read Article »
Site Design Should Reward Frequent Users
by Catalyst Group
This report takes a look at interface design challenges and opportunities of catering websites for new and repeat users. Read this article for practical, experience-driven advice and tactics for building websites that survive and succeed. Read Article »
Screen Size Matters: Best Practices for Designing Websites to Match Browser Resolution
by Catalyst Group
Designing your website for various screen resolutions can be tricky but warrants serious consideration. Catalyst Group present different methods for addressing screen resolution, including optimization techniques for a hybrid approach. Read Article »
Net Rage: A Study of Blogs and Usability
by John Franklin, Catalyst Group
Catalyst’s proprietary test of the usability of blogs sheds light on a variety of user-experience related design challenges associated with blogs’ potential to become a mainstream medium for Internet users. Read this white paper to learn more insights gained from this usability study. Read Article »


