Skip to content

Two Rarely Used Research Methods

Observing in a public areaMy two most recent articles in UXmatters have been about two research techniques that are very common to anthropology and the social sciences but are rarely used in design research. Covert naturalistic observation and participant observation certainly require more work and time than we usually have in UX projects, but it’s worth taking a look at these two methods to see what we can adapt to design research.

Covert Naturalistic Observation
This type of study is known in psychology, anthropology, and other social sciences as covert naturalistic observation. It is the opposite of the techniques we typically use, which are forms of overt naturalistic observation. Being covert means observing behaviors in their natural contexts without any intervention or influence by the researcher and without participants knowing that they’re being observed.

Participatory Observation
Anthropologists and sociologists often practice participant observation, in which they join a group as a participating member to get a first-hand perspective of the group and their activities. Instead of observing as an outsider, they play two roles at once—objective observer and subjective participant…

Effectively Communicating User Research Findings

I presented at UXPA 2013 today on Effectively Communicating User Research Findings.

This is the reason I’ve been way too busy to blog lately. I’ve been working non-stop on this presentation and also my UXmatters article published this week on Creating Better UX Research Videos: http://www.uxmatters.com/mt/archives/2013/07/creating-better-ux-research-videos.php

So check either of these out.

A UX Researcher’s New Year’s Resolutions

New Year

Flickr: RLHyde

Try new things

In 2013, I’ll try new techniques instead of relying on the same routine research activities. For each project, I’ll step back and think about what research activities make the most sense based on the situation. Trying new things and inventing new techniques keeps things interesting.

Work faster

This year, I’ll do some things faster, to be more agile and lean where possible so that research continues to be included in projects. We’ve done a good job of selling clients and project team members on the value of including user research in projects. The remaining hurdle is that it often takes longer than they would like. There definitely are areas that can be sped up.

Work slower

In 2013, I’m going to use the time I save on working faster to spend more time on the activities that provide the most value. Some things shouldn’t be rushed. Analysis of research data, for example, is the most important, but least understood part of user research. No one ever seems to understand what analysis involves, how long it can take, and how important it is. In 2013, I’m going to fight for the time needed for analysis and do a better job explaining what it involves, why it takes so long, and why it’s so important to give it the time needed.

Get better participants

In 2013, instead of aiming high and settling for what we’re able to recruit, I’m going to create better screeners and spend more time making sure that the people who have been recruited, match the type of people we want to get. I’m going to be especially careful when clients are doing the recruiting of their own customers, employees, or members. I’ll give them better instructions in findings and recruiting people, and I’ll evaluate the types of people that they’ve scheduled.

Publish and present

In 2013, I’ll continue to publish articles in UXmatters and elsewhere. I’ll try to present at a conference. Publishing and presenting are great ways to share your knowledge with others in the field. For more tips on publishing and presenting, see my series of articles on Publishing and Presenting in UXmatters.

Attend more UX events

In 2013, I’ll attend more local UX events. In Philadelphia, we have a very active CHI group, PhillyCHI, but I always find it difficult to get motivated to go out after a long work day and attend their events. Every time I do attend, however, I find that it’s a great way to meet others in the field, and I always learn something useful.

Read more

In 2013, I’d like to read more UX-related books and articles. That’s easier said than done when you’re really busy at work. And after a day practicing UX, it’s difficult to get motivated to read UX in your spare time. Usually, I want to read anything else. Fortunately, a great trend in UX books is towards shorter, more practical books that can be read quickly (for example, the Rosenfeld Media books).

Be thankful for what I have

It can feel good to complain and think about what could be better about your job, but I find that I often don’t think about how good I have it. I’m doing a job I enjoy, that’s challenging, and usually interesting. In 2013, I’d like to focus more on the positive and appreciate what I have. If I find that I have only complaints and nothing to be thankful for, I’ll know that it’s up to me to change things.

Those are my resolutions. I hope I can achieve most, if not all of them, in 2013.

Tattle Tale Participants

Have you ever come across a tattle-tale participant? See if this sounds familiar.

You conduct a user research session (interview, contextual inquiry, focus group, etc.), asking simple questions to get the participants to speak about the subject at a basic level of understanding. Although you may know some of the answers to the questions you’re asking, you ask the questions anyway to hear the answers from the participants’ perspective. Misunderstanding your intent, the participant is alarmed that you don’t know what you’re doing and tattles on you to the client, “It was clear from his questions that he didn’t know anything about our process/system/technology.”

For example, a few years ago I was doing research on a company’s use of SAP. We had a group of interns show us the HR tasks that they do in SAP. Our questions led them to conclude that we didn’t know anything about SAP (which was mostly correct). They tattled to their manager who contacted our main client, alarmed that we weren’t SAP experts. Fortunately, he reassured her that we were user experience experts, and we weren’t supposed to be SAP experts.

What turns a participant into a tattle tale? Usually, it comes from a misunderstanding of our role. As user experience consultants working on many different projects, we constantly have to learn about new organizations, new systems, new processes, new technologies, and new types of people. We interview business stakeholders and conduct user research to learn about these things, but our goal isn’t to become experts. In fact, it’s often better to not be an expert. We have the advantage of seeing a group, system, process, or set of tasks from an outside perspective. Because we don’t already have the same insider knowledge as the business stakeholders and participants,  we can get them to explain things to us as outsiders. To do this, we often need to ask basic questions and sometimes even act “dumb” to get participants to fully explain things that they would otherwise forget to explain or gloss over at a high level.

The worst thing about tattling is that it can make us afraid to ask questions for fear that they might expose our “ignorance.” So make it clear who the experts are – the users and the business stakeholders, and where your expertise lies – user experience. Combining the expertise of business stakeholders, users, and user experience professionals is the key to a successful project.

New Article: Capturing User Research

My latest article for UXmatters is about Capturing User Research. It discusses the pros and cons of various methods of capturing user research from handwritten notes, typing up notes on a laptop or tablet, having someone else take notes, recording the audio, recording with video, taking photos, logging, and simply relying on your memory. 

Read the entire article at UXmatters: Capturing User Research.

IA Summit 2012 presentation: User Research is Unnatural (But That’s Okay)

I just got back from the IA Summit 2012 in New Orleans, where I presented User Research is Unnatural (But That’s Okay). Yes, that may seem like a strange topic for a user researcher to present, but I think it’s very important to remember how strange and unnatural user research can seem for participants. The point of my presentation is that by remaining aware of the awkward and uncomfortable aspects of user research, we can take steps to minimize or eliminate those problems to get better research results.

See my slides on Slideshare:  User Research is Unnatural (But That’s Okay)

This was my first time attending the IA Summit, and it was a great conference with some excellent speakers and intriguing topics. As a user researcher who more often attends UPA and CHI conferences, it was interesting to attend a more design-oriented conference. I’m already looking forward to next year’s IA Summit, which will be in Baltimore.

New article: Communicating User Research Findings

My latest article for UXmatters is about Communicating User Research Findings.

I’ve created a variety of different types of deliverables over the years, to communicate my findings and recommendations from user research. It can be difficult because you often have a variety of different people in the audience, from management, product owners, designers, and developers. Each brings a different level of interest in the findings.

This article discusses the considerations of choosing a deliverable format, types of deliverables, and elements of effective deliverables.

Read the entire article at UXmatters: Communicating User Research Findings.

New article: Career Advice for User Researchers

I just published a new article in my Practical Usability column in UXmatters: Career Advice for User Researchers.

As I approached the ten year anniversary of my first job in usability, I started to reflect on all the things I’ve learned over the years. Originally, I was going to distill the main lessons I’d learned over those years into an article tentatively titled, “Ten things in Ten Years.” Well, I never got around to completing that article, and the ten year anniversary passed. Eventually, the idea evolved into career advice for people new to user research, and I finally got around to publishing it around my 11th anniversary in user research.

The article covers a lot of practical advice for people considering a career in user research, including the following topics:

  • Do you want to be a User Researcher, a Designer, or both?
  • Who do you want to work for?
  • What type of employee do you want to be?
  • Why type of projects do you want to work on?
  • What value does the company you’re considering place on user research?
  • Where does the company you’re considering draw the line between research and design?
  • What is the prestige and reputation of the company you’re considering?
  • Does the job title matter?
  • Where do you want to work?
  • How do you break into the field?
  • Do you need a portfolio?
  • How to cultivate your online presence.
  • What to do once you have a job.

Read the entire article at UXmatters: Career Advice for User Researchers.

New Article: Client Reactions to User Research Findings

As a design researcher, I’ve heard a lot of reactions from clients about the user research findings, both positive and negative. Fortunately, they’ve been mostly positive, but the negative reactions make for the best stories. I’ve written about those in my latest article in UXmatters: Client Reactions to User Research Findings. It includes the following reactions:

  • “Ho hum. Where are the designs?”
  • “We already knew that.”
  • “You’re wrong!”
  • “You talked with only 12 people.”
  • “Why didn’t you mention this problem?”
  • “The recommendations aren’t specific enough.”
  • “We could have done that ourselves.”

Read the entire article at UXmatters: Client Reactions to User Research Findings.