More isn’t better, but (help me with) Something Else is

Sometimes it occurs to me that we designers have tools in our toolbox that we use trustingly but haven’t explained why to others. Such a tool is usually rightfully worthy of our use and trust, but should be accompanied by sound theories and reasons. To that end, I thought I’d spend a little time on the origins of the VUI design component “help me with something else” and its variants.

Ideas around it first began back in 2000 or so on a project at Intervoice for a British Columbian transit company. We were designing a menu of options and were dissatisfied with the in vogue wording used to point to choices that were on a secondary menu. I.e.:

“You can say ‘plan a trip’, ‘get a schedule’, ‘paratransit’, or ‘more options’.”

That sort of phrasing seemed to be clunky and out of character for the design feel we wanted to deliver and we just felt it was inadequate for callers to latch onto.

In an informal discussion, one of my team members said “we need something else”, referring to the current choices being used in the design world, such as “more choices”, “other”, “none of those”, etc. When he said that, we looked at each other and said, “why not try ‘something else’ in the prompt?” So we began thinking about this:

“You can say ‘plan a trip’, ‘get a schedule’, ‘paratransit’, or ‘something else’.”

We liked where that was going, but quickly thought of a semantic problem in that the instruction seemed not to refer so much to additional choices but rather to telling the caller that they could say just about anything else. That, of course, was not the case and would cause interaction issues. Plus, the phrase seemed overly ambiguous, maybe even more so than “more options”. So after a bit of round-and-round about it, we determined that we wanted to try the phrase “help me with something else” (HMWSE).

“You can say ‘plan a trip, ‘get a schedule’, ‘paratransit’, or ‘help me with something else’.”

Though it might seem pedestrian now, this was a pretty novel idea at that time. The “more options” construction came directly from DTMF IVR menu structures, meaning it was deeply ingrained as the default presentation. Furthermore, in the early days of voice interaction design, there was an emphasis on pithy phrasing and HMWSE seemed like a mouthful. However, it had several strong characteristics that appealed to us. It was clear, used more common wording, and we actually heard similar phrasing in everyday conversations around us.

Fate, though, had other plans then. For a couple of reasons, we weren’t able to use the idea in that current design. But I held on to it for several years and finally had the opportunity to try it out again in 2004 at Voice Partners. We were working a significant redesign for a mobile carrier’s customer service line. As you can imagine, there were many functions for callers to choose from in the application. As soon as I saw the struggle with how to represent the concept of other things the callers could choose, I suggested that we try out HMWSE. I walked through its origins and we had some good discussion about why we though it would work. So we tried it in usability testing in opposition to the traditional “more options” and it was then that the strongest reason for the superiority of HMWSE emerged.

As we watched and listened to participants move through and struggle with the menus, two patterns of behavior became clear around their decisions to access more choices. Many of those who used “more options” seemed to be exhibiting surfing behavior triggered by that phrase. That is, they wanted to hear and think about all possible choices before committing to one because “more options” seemed to mean “more options that you might want to hear before you make a decision”. This frequently led, though, to failures in the menus as callers encountered cognitive load problems having to hold all the choices and their possible meanings in mind. Callers who heard and used HMWSE, however, did not encounter nearly the same number of problems. They were not surfing but rather, and this is the key point, they were listening to and then rejecting previously heard choices when they said HMWSE.

“Help me with something else” allowed them to hear, absorb, then discard choices they did not consider valid and specify to the system that new choices should be presented.

This was a major eye-opener for me, and my co-designers. While we had suspected that HMWSE was better, we had discovered a solid cognitive reason for it. Callers clearly preferred not to surf, but to have a way to eliminate choices rather than play a guessing game. Thus, HMWSE became a new best practice for use when menus exceeded a certain length.

Failing menu: “You can say ‘my bill’, ‘my plan’, ‘technical support’, or ‘more options’.”

Winning menu: “You can say ‘my bill’, ‘my plan’, or ‘technical support’. You can also say ‘help me with something else’.”

Now, to be clear, all the other principles of good menu design still apply. Choices must be clear, unique, and aurally distinct, among others. HMWSE is not a ticket to allow “anything goes” menu construction. But, when used with a solid set of menu items that need to span more than one presentation instance, it is the best choice for letting callers know that if they do not hear what they want in the initial list, they have a clear way of indicating that they want to discard the first list and hear another.

“More Options” for HMWSE

In the several years since that discovery, the use of HMWSE has grown in two ways.

First, I’ve encountered situations where a variation of HMWSE works better than the original wording. Semantically the concept is the same, though. An example is:

“You can say ‘car’, ‘bus’, or ‘train’. You can also say ‘I need different transportation.’”

Additionally, we began using a variant of the idea with open-ended prompts. Until the last couple of years, the standard was to coerce the caller into saying anything at a “What are you calling about today?” type prompt in the hopes we could pin a meaning on it. However, many callers are just not sure what to do or what will happen and so are reluctant to give an actionable utterance. At Voice Partners, then at SpeechCycle, rather then “erroring” into a menu, we began very successfully using “what are my choices” and “give me some choices” as ways callers could specify that they preferred a menu over the open prompt. Such phrases allow caller choice and control versus locking them into a specific interaction method.

The other area of growth is a more widespread use beyond up-front menus where HMWSE can still mean “I don’t want any of those so give me different options”. Some examples are follow-up menus after tasks are completed, lists of items to select from, and lists of global actions. Again, as the previous area indicates, these additional contexts sometimes require variations on the wording.

A Note: SE <> HMWSE

One thing I want to be clear about is that the use of HMWSE is better than just offering callers the phrase “something else”. In the past couple of years, I’ve heard systems presenting simply “something else” in menus, and that’s a mistake for reasons mentioned above. It fails on a semantic level to be a clear instruction to obtain other menu choices and instead at best sounds like an invitation to say anything. I strongly discourage its use.

So, don’t be afraid to offer your callers a good range of choices in more than one menu. In HMWSE you have a tested tool to use for that. Yes, there is research that I consider valid that shows that menus with more than four or five items can work well. However, there are contexts in which doing so might not be the best approach. Because of that, HMWSE helps round out the set of tools to help create great voice interactions when offering choices to callers.

Patterns and Experience

Enjoyed giving my two presentations last week at SpeechTEK in New York. Both seem well received, especially the patterns talk. It's gotten 150+ views on Slideshare since, which is very gratifying!

See them both for yourself:

IVR Design Patterns

View more presentations from Phillip Hunter.

People Get Ready

View more presentations from Phillip Hunter.

Sorry for the formatting issues in the second one. They appeared after the upload. Not sure what's going on.

Later this week, I'll offer thoughts on SpeechTEK, and some talking points I covered in the presentations.

Good to see lots of folks!

I don't think I said what you think I said - Interviews and "Natural Language"

"Hi, I've just got a few questions." Not everyone likes it, but I will admit I do. I like to get interviewed. I like to be asked questions. I like to feel like someone cares about my answers, relative truth aside. I like to think the thoughts and words will make their way into a tight, punchy piece that makes a reader or a thousand think a different thought or care more. But, I know enough from a media course and life to know better than to expect much of that.

Now, this week, I received several mentions in a Speech Technology magazine article and I'm glad. It's a bit ironic, given news I'll get to in another post, but I'm enjoying it. At the risk of not getting interviewed in the future, I do need, though, to straighten out a tiny thing or two.

So, if you're not a speech geek, or wanna-be speech geek, skip to the next post, otherwise, a couple of discussion points:

First, the article is a great intro to current thinking about the use of open-prompting (soliciting content constrained by context, not wording). I favor this approach when it makes sense and can be delivered properly. In general, my thoughts are represented well. But, to get to the point, I didn't actually assert "that callers shouldn’t be exposed to a hierarchy of more than five categories." I do think menus structured like that can be problematic and are frequently done poorly, but research (Hura & McKienzie) and deployments (McKienzie, Levine) have shown that the right combination of wording and delivery can allow menus to be fairly lengthy and still be effective. I agree with those findings.

Moving on, the article discusses the idea that a high-frequency example is very important, which is correct. However, open-prompts should almost never start with "How may I help you?" Not only is there a register problem, but putting the call to action before giving the caller space to respond is generally a recipe for disaster, despite enabling barge-in.

Next, "performance anxiety," my (unattributed) quote, is not a technical term. Funny? Yes. Not technical.

Then, the sentence reading "Users are given the option of accessing them by saying something like What are some choices?" really should read "Callers can be given the option to access them by suggesting they say something like "Give me some choices." The difference appears subtle, but trust me, it's important. Control and certainty are increased by this very much directive statement, whereas the other feels too much like browsing.

Lastly, I need to put a finer point on "it’s important to design the back-off menu open-ended like the first prompt." Actually, the true matter is to allow not a full range of open responses, but to look for responses in tuning data for the menu and adding to the grammar utterances that are clearly a response to the open prompt but not in-grammar for the menu. For example, a caller saying "my internet account" to a menu asking them to specify whether their call is about their bill, an order, tech support, or an appointment. And of course adding logic to handle such utterances. Doing this will be effective and caller-pleasing without the trouble of a parallel SLM grammar.

So, these are not slams, but rather just trying to make sure that the right information is out there. The article is, I think and hope, a good discussion starter. Including the last few paragraphs, which are sort of not-directly-on-topic, but are vitally important nonetheless.

Please add your take on the article here. If you want to know more about the concepts presented there or here, or you want to interview me ;), please let me know: phillip at phillipwhunter dot com.

-pnl

UPDATE: Eric Barkin responded very graciously to my post on his SpeechTech blog page. I appreciate his comments and especially agree with the points about the need for a larger design improvement discussion.

WTF? Public Behavior, Infernal Machines, and Voice Interaction/Interface Design

Recently one of the semi-annually popular questions in the voice interface world floated out of its storage closet and back into the email list shared by many speech designers: “What should our applications do when cursing by a caller is detected?” I thought about not responding this time, but realized that we hadn’t really publicly hashed out the argument for not doing anything too special. Plus, we always joke about having an app say something like “Do you kiss your mother with that mouth?” which has been said enough to worry me that maybe someone will take it seriously. So, I responded that trying to be sure of what sub-context is meant by the caller is very difficult and many times the use of vulgarity is in fact not a sign of trouble or frustration. It is more effective to focus our efforts on creating effective and pleasant interactions for the vast majority of callers who are not swearing out of frustration or at all. That’s what I posted to the list.

The response to that was the equivalent of crickets and instead other respondents focused, as before, on maybe doing this or that, all essentially variations on the theme of giving negative reinforcement to the caller or even punishing them, such as going silent for a while or transferring them to a low-priority wait queue. My thought on that is, as a colleague suggested, let’s figure out how to make mallets bop the caller on the head every time they swear.

The bottom line is that designs must accommodate and respond accommodatingly to a wide variety of social behaviors, some of which will differ greatly from the company’s and designer’s point of views and cultural biases. While an organization might understandably choose to have a strict policy regarding how their customers are allowed to treat employees, it is ridiculous to think of requiring similar behavior standards for actions around or even toward inanimate software. It is not wise or even practical to try to enforce ambiguous, dynamic, class- and culture-based behavior norms on people who are not asking for it and are often already upset or stressed by a situation they perceive as been caused by the company. Make no mistake, designers are in the behavior modification business. However, that is true only as far as required to achieve the person’s desired goal within the allowances of the company.

Be nice to the people using your application, but don’t get bothered if they aren’t nice back. Don’t try to change behavior that is not directly relevant to their success. Focus on getting to success.

Data, Art, Design, and a big ID/IxD Success Story

Three events occurred, or were publicized, in the past few days that merit posting here and considering all together. First, an apparently widely-respected visual designer left Google using some strong language about his frustration regarding the design mentality there. I'll let you read his words to get your own impression rather than commenting directly.

You back? Ok.

To paraphrase somewhat, he tells a fresh tale of the decades-old battle of design based on data versus what some like to call "art". We in the Voice Interaction realm have had the same challenges and have often said in our little world that VUI Design is a "science and art". And while I have even held forth on that, I have been uncomfortable for the past few years with that way of characterizing it. One reason is that many of our language structure and wording decisions are actually based on researched and published linguistic and thought paradigms, similar to visual design choices about layout and color. Secondly, designing well is often an exercise in doing so within limitations and with compromises instead of letting one's expressionistic soul run free (That's a great thing for your painting or weekend band. Not usually so good for the business needs of your employer.).

Which leads me to the second event. OK/Cancel is a comic and blog by a couple of guys who took a hiatus from the end of 2007 to now and returned strongly with a great strip and good commentary on the ex-Googler and the data/art debate that fits nicely with my comments above and the article I wrote with Roberto Pieraccini linked to above. This is an area we in speech and all designers need to reflect on in order to truly begin the maturation of our practices, processes, and reputation.

Doing so will, I believe, lead to more of the third event. Thursday's NY Times ran this article in the Inside Technology section, A Tiny Camcorder Has a Big Payday. Pure Digital Technologies, the maker of the very popular Flip camcorder (audio warning) was purchased for $590 million by Cisco (About a 2.5-3x valuation as near as I can tell). To me, this is a triumph of good design. Cisco decided that a profitable company focused on simple, good products could add to Cisco's bottom line for years to come. While their decision was most certainly not all about good design, the philosophy of Pure Digital mostly is. This should serve as reinforcement and encouragement to all designers that combining customer focus, good design principles and practices with persistence and reading the market in-between the lines can and does work because success is success.

Good Design in 2009.

-pnl

Do your dinner guests quiver in excitement...or in fear?

Can you cook? I mean really cook? I mean your friends and family love it when you host the dinner party and your appetizer is the first one attacked at the potluck. If so, chances are that the word recipe has significance similar to "guidelines" or even "suggestions" rather than "rules" or "the straight and narrow". Design is like cooking. And as with cooking, there are those who generate joy and delight during the creation and consumption, there are those who get a job done, and there are those who really ought to re-examine the color of their parachute.

As I was contemplating writing this post and using this metaphor, I came across this from Bill Buxton (in his wonderful book Sketching User Experiences, also linked to earlier): "(L)isting ingredients is always risky. Just because I give you flour, milk, yeast, eggs, and an oven does not mean that you know how to make bread at all, much less the multitude of variations that you might find in a good bakery." This is exactly the sort of analogy I had been thinking about. Just because someone knows the design process and a pattern or two and what the end product is generally supposed to be like does not mean that that person is a designer. He goes on to discuss the complexities and content of designing, but let me make sure this is clear. Neither I, nor he, are drawing a parallel to needing more unrestrained creativity in design. In other words, the parameters of cooking are typically a little larger and looser than the design we practice, and I am not stating that designers should practice wild creativity, though it can be a good thing. I am saying that far too many people calling themselves designers are at best good only at finding and following a recipe and at worst are burning toast. Now, I don't mean most, but simply too many. But that condition has been true for many years and has led to many of the problems that we have with consumer rejection of our interface product. All who call themselves designers need to frequently examine whether they are truly performing a service in the best sense of that word. I have come to believe that there is an element of morality in the design profession, similar to being a physician or a law enforcement official. Which means that practicing design simply to earn a buck or have something to do is lacking ethically and morally. It does a disservice and may even cause harm greater than the negative economic consequences it leads to.

So, if you cannot claim to be even a recipe follower, then I encourage to do some self-examination and consult people you trust about changing careers. If you are a recipe follower, I encourage you to seek the path of becoming a chef. And if you are a chef, I implore you most strongly and even charge you with the responsibility of exercising ethics and morality in your design practice:

Always practice the best design possible.

Always point out when design compromise will lead to intolerable consequences.

Be bold in identifying bad design.

We simply must change the role of design from creating specifications to improving life.

Make 2009 the Year of Good Design.

Happy New year!

Winding down 2008

It's always been funny to me that we feel a sense of something ending as the calendar changes from one year to another. Out of all the things we do customarily that are time-limited, such as projects or pay periods or monthly services, the year-end/new year markings always seems the most artificial to me and yet we treat it with the most emotion. Oh well, holiday-weariness musings aside, I hope this time of year does have plenty of good things to remember and to anticipate.

I will be posting new thoughts soon on trends I see in user interface and interaction, why IVR might have peaked and be in decline, and why bad design is immoral.

For now, for all you designers, I leave you with the strongest possible recommendation to put this book on your Q1 2009 reading list: Sketching User Experiences. It is a great treatise on the need for the design process as well as enlightening concerning what sketching is and why it is so important, which helps me understand why some of us push so hard on doing sample dialogs early in the design process.

Design well!!
-pnl

Published - VUI - Art with Science

The column I referred to a few weeks ago is out now. Thanks TMA Associates! Read it!

Rules and instructions - People behave like water

In a nice Speech Technology mag article from Dr. Susan, she highlights that people, in this case callers to automated systems, frequently behave like water (my interpretation, not hers). That is, they try to find the easiest way to get what they want most of the time. Other times, they barrel over any seemingly arbitrary obstacles when they perceive that there is a way to accomplish what they want.

She rightly points out the fine details of how to deal with these issues in a couple of specific situations. The larger lessons are: a) if you make rules (right or wrong) for customers, make sure they know them and make sure they are consistent across the board; b) to maximize success all the way around, facilitate the fastest, easiest way (according to the customer!) to get where the person wants to go.

Too often, our designs provide interaction that is more like dams and channel locks and less like soothing mountain streams.

"the art of vui"

From a column to be published soon.

The view (we have) of the art of VUI does not parallel the applied education and craft found among the professional practitioners of the classic arts. In those fields, science is as much a tool as instrument, chisel, and brush. The expert composer deftly manipulates the mathematical intricacies of sound over time. The learned sculptor understands how to wield force against the limits of steel and stone. The master painter possesses the insight to blend and bend hue and light, oil and pigment. All three, though, along with the other arts, have a singular, common, and nearly unknowable component in the final product: the emotional result produced in those that experience their work. Yet that causes the artists to know and master their tools and domain even more.