Cool stuff and UX resources

< Back to newsletters

Introduction

Why is computer system usability becoming so popular?

Some of us were interested in usability issues (also known as "human factors," "software ergonomics," etc.) when all we had was keypunched input and paper printouts for output. Few people were interested in the interfaces. Next we dealt with character-based interfaces (green screens) on moderate-sized monitors, and eventually colored interfaces on even larger monitors.

Most of the original users dealt primarily with accessing databases, while later users moved to interacting with a multitude of different applications. In most cases, the number of users was relatively small (from ten to a few hundred), and they tended to use the systems enough to become quite experienced. When users did have serious concerns about a difficult interface, the major complaints were responded to by making changes to the next software release. Having a small number of experienced users meant that a poorly designed user interface could (and often did) go unnoticed.

Times have changed. With most new systems being Web sites, hiding poor interfaces is no longer possible. For example, Randy Souza reported a revealing study in the Forrester Report (October, 2000). He conducted a study of shopping experiences using 30 well-known online retail sites. He found that not one Web site delivered both acceptable content and ease-of-use. Among other findings, he reported that only:

63% provided navigation that was available and consistent at all times,
53% had a useful search capability, and
53% had a checkout process that was fast and distraction-free.
Many popular computer systems (Web sites) are now being used by millions of people per day. Consider the following number of unique visitors reported for one month from Media Metrix:

Yahoo! 52,000,000
Microsoft Sites 51,000,000
About 20,000,000
Amazon 15,000,000
Real Network 14,000,000
eBay 12,000,000
eUniverse 12,000,000
CNET Networks 11,000,000
Ask Jeeves 10,000,000
ZDNet Sites 9,000,000

Assume that we do usability testing and find and fix all problems that created usability difficulties for 99% of users. The remaining problems, which create difficulties for about 1% of users, is still a large (very noticeable) number:

Yahoo! 520,000
Microsoft Sites 510,000
About 200,000
Amazon 150,000
Real Network 140,000
eBay 120,000
eUniverse 120,000
CNET Networks 110,000
Ask Jeeves 100,000
ZDNet Sites 90,000
   

Will effective usability tests help to improve the usability? Unfortunately, many user interface professionals still use very few test subjects when conducting performance tests. Nielsen in his March 19, 2000 Alertbox suggested that usability testers only need to test with 15 users to discover all the usability problems in the design. I suggest that to be 90% confident of finding usability problems that will affect 99% of users requires more like 112 representative test participants.

By using "Nielsen's 15 test subjects," usability professionals will detect problems that only will affect about 85% of users. This means that 15% of users still could have problems. To be more concrete, Amazon, which is used by 15,000,000 people each month, could have over 2 million people each month having difficulty using their site.

The large number of users makes poor Web site design more apparent than ever before.


Message from the CEO, Dr. Eric Schaffer — The Pragmatic Ergonomist

Leave a comment here

Subscribe

Sign up to get our Newsletter delivered straight to your inbox

Follow us