A focus group won't tell you why a checkout flow breaks. A survey won't show you the workaround a user quietly invented at their desk. Choose the wrong UX research tool, and you get a confident answer to a question nobody needed the answer for.
UX research is the systematic study of how real people behave with a product, so design decisions rest on evidence instead of opinion. That part is easy.
The hard part is selection. There are more than a dozen credible methods, and each one exists to reduce a specific kind of uncertainty.
The stakes are practical. A misfired study costs a sprint, burns participant goodwill, and often produces a result that feels rigorous while being quietly wrong. Getting the match right is most of the job.
Key Takeaways
- Method choice follows the question, not the other way around. Decide what uncertainty you need to remove before you pick a tool.
- Two distinctions matter more than the qualitative-versus-quantitative split: what people do versus what they say, and exploring versus validating.
- Every method has a failure mode. Focus groups mislead on usability, surveys capture stated rather than actual behavior, and A/B tests need traffic most teams don't have.
- Sample sizes are method-specific. Five users is right for qualitative usability testing and nowhere near enough for a quantitative study.
- Interviews are still the most-used method in the field, but the strongest insight usually comes from pairing a "why" method with a "how many" method.
- Sequence matters. Generative methods belong early in a project, evaluative methods belong right before launch.
Why Does UX Research Matter?
- It makes products easier to use. If something feels confusing or clunky, people won’t stick around. Research helps remove friction so users enjoy the experience.
- It helps businesses focus on what really matters. Instead of guessing, companies can rely on real feedback to make the right improvements. This is how great teams utilize user research methods to enhance strategy.
- It keeps companies ahead of the competition. Trends change fast. Studying what users want (and what competitors are doing) helps businesses stay relevant.
- It gives users a voice. Interviews, surveys, and testing let companies hear directly from the people who matter most - actual users. This practice extends user research methods into continuous engagement.
- It leads to smarter decisions. Tools like Hotjar and Google Analytics show how people interact with a product, revealing where tweaks can make the biggest impact.
UX Research Flow by Clay

Start with the Question, not the Method
Before choosing anything, get clear on which kind of uncertainty you're trying to remove. Three distinctions do almost all the work.
Qualitative versus quantitative is the one everyone knows. Qualitative methods like interviews, diary studies, and ethnography explain why users behave a certain way.
Quantitative methods like surveys, analytics, and A/B tests tell you what happens and how often. Neither is superior.
Qualitative research finds the problem, and quantitative research proves how widespread it is.
UX Research Methods by Clay

The second distinction is more useful and gets discussed far less: behavioral versus attitudinal. Attitudinal research captures what people say. Behavioral research captures what they actually do. The gap between the two is where most bad product decisions are born.
Users will tell you they'd pay for a feature and then never touch it once it ships. When a stated preference and an observed behavior disagree, trust the behavior.
Third is generative versus evaluative. Generative research happens early, before you've committed to a direction, and it shapes what you build. Evaluative research happens later and tests whether what you built actually works.
Running an evaluative method on a question that needed a generative one is a common and costly mistake, because you end up polishing an idea that was wrong from the start.
Hold these three axes in mind and the right method almost picks itself.
A Method-Selection Matrix
Here's the shortcut. Find the question that matches yours, and the method, rough sample size, and blind spot come with it.
The matrix below maps each of the twelve methods to the question it answers, so you can start from what you need to know rather than from a method you already had in mind.
Method-Selection UX research Table

Pay attention to that last column. Every method has a blind spot, and knowing it in advance stops you from over-trusting a clean-looking result. A survey where most users say they love a feature means little if those same users rarely open it.
Qualitative Methods: Understanding the “Why”
Qualitative research digs into motivation and context. It's how you learn the story behind a behavior, which is exactly what numbers can't give you.
Qualitative UX Research Methods by Clay

User Interviews
When you want to understand attitudes, motivations, and the reasoning behind a decision, there's no better source than the users themselves. User interviews give you direct access to how people think, and they remain the most-used method in the field according to the State of User Research 2025 report, which surveyed 485 researchers worldwide.
The skill is in the questioning. Ask about specific past behavior rather than hypotheticals. "Tell me about the last time you tried to do X" beats "Would you use a feature that does X," because people are unreliable narrators of their own future.
Erika Hall makes this point well in Just Enough Research: users can't predict what they'll do, but they can describe what they actually did. Listen more than you talk, and follow every mention of a pain point with "what happened next."
For most questions, five to eight interviews surface the main patterns without drowning your calendar. Beyond that, you hit repetition fast.
What to Avoid During a User Interview by Clay

The failure mode: interviews are attitudinal, so they tell you what people believe and remember, not what they do. Memory is selective, and people smooth over their own mistakes. Pair interviews with a behavioral method before you act on anything surprising.
When we worked with JOKR, an on-demand grocery startup, interviews surfaced a clear priority we then validated in behavior: people didn't just want groceries fast, they wanted to find an item and check out in seconds. That combination of stated need and observed friction shaped the whole app.
Diary Studies
Diary studies track behavior over time. Participants log their experiences with a product across days or weeks, which reveals long-term patterns a single session can never catch. They're the right call for products used irregularly, or when context and interruptions matter as much as the core task.
The Experience Sampling Method sharpens this further by prompting users to record what they're doing at the moment they do it, rather than reconstructing it later.
Diary Study Timeline by Clay

The failure mode: diary studies live or die on participant discipline. Drop-off is real, entries get thin by week two, and you're still relying on self-report. Budget for over-recruiting and light-touch reminders.
Ethnographic research
Ethnography means watching users in their own environment, doing their real tasks, with all the mess that entails. It surfaces the workarounds people never think to mention and the environmental factors that shape how a product actually gets used.
This is where observation beats interviewing. In our work with Slack, we ran ethnographic studies to understand three very different audiences in their real working contexts.
Watching how people actually used the product, rather than asking them to describe it, exposed unmet needs that directly informed the design. Nobody articulates their own habits accurately. You have to see them.
Where Ethrographic Research Stands by Clay

The failure mode: ethnography is slow, expensive, and qualitative to its core. It tells you what happens and why, never how often. Treat it as the input to a quantitative study, not a substitute for one.
Focus groups
Focus groups bring six to eight users together to react to a product or idea while a moderator steers the conversation. They're good for surfacing the language people use, competing perspectives on the same feature, and early reactions to a concept.
Here's the part most guides bury: never use a focus group to test usability. Group settings manufacture consensus. One confident voice pulls the room, social pressure hides individual confusion, and you walk away with a tidy agreement that evaporates the moment someone sits alone with the interface.
Use focus groups to explore perceptions and vocabulary. Use one-on-one methods to test whether anything actually works.
How to Conduct an Effective UX Focus Group by Clay

From Google's wearable experience to Snapchat’s AR try-on lenses, we've helped teams across every industry design products people actually want to use. Let's talk about yours.
Quantitative Methods: Measuring the “What and How Often”
Quantitative research puts hard numbers on behavior. It's what turns "some users seem confused" into "34% abandon at this step," which is the difference between a hunch and a priority.
Quantitative UX Research Methods by Clay

Surveys and Questionnaires
Surveys collect structured feedback from a large group quickly, which makes them the workhorse for measuring preference and satisfaction across your user base. One recent industry study found surveys are the single most-used UX research method at 79%, ahead of usability testing and interviews.
Keep them under ten minutes, use plain language, mix question types, and pilot the whole thing with a handful of people before you send it wide. A single ambiguous question can poison a dataset.
How to Conduct a UX Survey by Clay

The failure mode is the big one: surveys measure what people say, not what they do. A satisfaction score tells you how users feel about answering your survey, which is not the same as how they behave inside your product. Treat survey results as a signal to investigate, not a verdict.
Usability Testing
Usability testing shows you where a product breaks. You give users real tasks and watch where they hesitate, misread a label, or miss the feedback that tells them an action worked. It's behavioral, it's direct, and it's often the fastest path to an obvious fix.
The famous number here comes from Jakob Nielsen: testing with five users uncovers roughly 85% of usability problems. The logic is diminishing returns. By the fifth participant you're hearing the same issues repeat, so it's more valuable to run several small rounds across iterations than one large round once.
Core Steps of Usability Testing by Clay

The caveat matters as much as the rule. Five users only holds for qualitative usability testing with a fairly homogeneous audience. If you have several distinct user groups, you need three to four per group. And the five-user rule does not transfer to quantitative studies, where you need far larger samples to trust the numbers.
When we worked with Lulo Bank, Colombia's first digital-only bank, usability sessions exposed exactly where trust and clarity broke down for people new to online banking, which let us design a flow that felt secure without feeling complicated.
A/B Testing
A/B testing compares two versions of a design with live users. Half see version A, half see version B, and you measure which performs better against a metric you set in advance. It's the cleanest way to settle a design debate with real behavior instead of opinion.
The failure mode is unforgiving: A/B testing needs volume. Below a few thousand conversions per variant, your result is noise dressed up as significance, and acting on it is worse than not testing at all.
A/B Testing Example by Clay

Small and early-stage teams almost always get more from qualitative usability testing. A/B testing also tells you which version won, never why, so pair a win you don't understand with a few interviews before you generalize the lesson.
Analytics and Behavioral Data
Analytics is the one quantitative method that runs continuously and requires no recruiting. Tools like Google Analytics, plus heatmaps and session recordings from something like Hotjar, capture what every user does at scale: where they click, where they drop off, how far they scroll, and which paths they never take.
It's the closest thing you have to watching your entire user base at once, which is why it's usually the first place to look when a metric moves and nobody knows why.
Google Analytics Audience Overview by Clay

Analytics works best as a detector, not an explainer. It's excellent at telling you a page has low engagement or a funnel leaks at step three. It's useless at telling you the reason. The classic pattern is a page users only reach after an obscure action, so the data shows the drop-off but not the buried navigation causing it.
Treat an analytics anomaly as the start of a qualitative investigation, not the conclusion of one. The number tells you where to look, and a user session tells you what you're looking at.
Evaluative Methods: Validating a Design Before You Ship
Evaluative research checks whether a specific design or prototype works. It sits between qualitative and quantitative and is built for catching problems early, when they're cheap to fix.
Most of these methods use real users, but one, heuristic evaluation, deliberately doesn't.
Card Sorting
Card sorting is the generative partner to tree testing. Instead of checking whether users can navigate a structure you already built, it asks them to build the structure themselves. Give participants a set of content items, physical or digital, and watch how they group and label them. The patterns that emerge show you the categories that match how users actually think, which is the foundation a good navigation sits on.
Use an open sort (users name their own groups) early, when you have no structure yet and want to discover one. Use a closed sort (users file items into your predefined groups) to test a structure you're leaning toward. Aim for 15 to 30 participants, more than a usability test, because mental models vary widely and small samples hide that variation.
The failure mode: card sorting tells you how people would organize content, not whether they can find it later. Those are different questions. A category that feels logical when you're sorting can still fail when you're hunting for one specific item, which is exactly the gap tree testing closes. Run them as a pair, sort first to build, tree test second to validate.
Tree Testing
Tree testing evaluates your information architecture on its own, stripped of visual design. Users navigate a text-only version of your site structure to find specific items, which exposes confusing category names and mismatched mental models before a single screen gets designed.
Tree Testing Example by Clay

Aim for 30 to 50 participants, since navigation patterns need more data than a usability session to read clearly. Its blind spot is the flip side of its strength: it says nothing about visual design, because it deliberately removes it.
Prototype Testing
Prototype testing gathers feedback on early designs, anywhere from paper sketches to clickable mockups. Low-fidelity prototypes test concept and flow, high-fidelity prototypes test detailed interactions, and working prototypes test performance against real data.
What Is Prototype Testing? by Clay

Testing an idea at prototype stage costs a fraction of changing it after launch, which is the entire point. With Nuant, a crypto asset intelligence platform, testing simplified interface concepts early is what revealed that users needed clearer visualizations before the complex dashboard could work.
Heuristic Evaluation
Heuristic evaluation is the odd one out. It uses no users at all. Instead, three to five experts inspect an interface against a set of established usability principles, things like visibility of system status, consistency, error prevention, and clear feedback.
Because it needs no recruiting, it's the fastest and cheapest method on this list, often done in a day or two, which makes it ideal as a first pass to catch the obvious problems before you spend money putting the design in front of real people.
The failure mode is fundamental: experts are not your users. Heuristic evaluation catches violations of known principles, but it misses the problems that only surface when someone with real goals and real context tries to get something done.
It flags what should be wrong in theory, not what actually trips people up in practice. Use it to clear out low-hanging problems early, then confirm with usability testing. It sharpens a design before user testing, it doesn't replace it.
When to Run Each Method?
Method choice isn't only about the question. It's about where you are in the project.
Early, when you're still deciding what to build, lean generative and qualitative. Interviews, diary studies, and ethnography shape the direction, and card sorting shapes the structure. This is also where a discovery-phase mistake is cheapest to catch and most expensive to miss.
UX Research Methods by Clay

In the middle, as designs take shape, move to evaluative methods. A quick heuristic evaluation clears the obvious problems first, then tree testing validates structure, prototype testing validates interactions, and usability testing catches breakage while it's still cheap to fix.
Late, near, and after launch, quantitative methods take over. Surveys measure satisfaction at scale, analytics reveal real usage, and A/B testing settles specific design questions with live traffic. The best teams don't stop there. They loop back to qualitative research whenever the numbers surface a "why" they can't explain.
The UI/UX process works best when research runs continuously rather than as a one-time phase, feeding each design decision instead of arriving after them.
Where Teams Get Research Wrong
A few failure patterns show up again and again, and most are avoidable.
Recruiting the wrong participants quietly wrecks otherwise sound studies. Five users only works when those users match your actual audience, so screen carefully and use a panel or customer database rather than whoever's convenient. Convenience samples produce convenient conclusions.
Skipping the analysis is the second trap. Data collection is the easy half. Value comes from pattern-finding, so use a structured approach like affinity mapping or thematic analysis instead of cherry-picking the quotes that confirm what you already believed.
The third is treating stated preference as fact. This is worth repeating because it's the most expensive mistake in the field. What people say and what people do diverge constantly, and any process that relies only on attitudinal methods will eventually ship something users swore they wanted and then ignored.
AI is starting to help here. In the 2025 industry survey, 80% of research professionals reported already using AI in their workflow, mostly to speed up synthesis and analysis rather than to replace talking to users.
Common User Research Challenges by Clay

Synthetic Users and Where AI Fits
The newest entry on this list is the one to treat with the most caution.
Synthetic users are AI-generated participants, large language models prompted to role-play a slice of your audience and answer research questions in character. The pitch is obvious. They're instant, cheap, available at any hour, and never cancel a session.
For exploratory work, hypothesis generation, and reaching audiences that are genuinely hard to recruit, they can be a reasonable first pass.
The failure mode is serious enough to earn the caution. A model trained on aggregated text reflects what has already been written, not the lived experience, emotion, and context of a real person using your product right now. That produces two predictable problems.
Synthetic responses tend to sound plausible and a little too agreeable, smoothing over the exact friction research exists to find. And because the model echoes its training data, it tends to reproduce common assumptions rather than surface the outlier who breaks them.
The 2026 State of Synthetic Users report captured this directly, with senior researchers naming echo chambers and missing lived experience as their top concerns.
In one study, 19 researchers rebuilt a real project with an LLM and found the synthetic version lacked contextual depth the moment the conversation moved past surface answers.
Writing in early 2026, the ACM's Interactions journal reached the same conclusion: AI-simulated users are a fast complement to research and a potentially misleading substitute for observing real people. A synthetic user can generate an opinion. It can't actually buy your product, abandon your checkout, or get lost in your navigation.
Where AI clearly earns its place today is behind the research, not in front of it. It's genuinely good at synthesizing transcripts, tagging themes across dozens of sessions, and drafting first-pass analysis, which is why 80% of research professionals reported using it in their workflow in the 2025 State of User Research report.
Treat it as an accelerator for the work that comes after you talk to people, keep real users as the source of truth, and the consensus among researchers holds: AI has to sit on top of solid methodology, not stand in for it.
If you need more professional AI assistance, we can help. Whether it's web design, branding, or UI/UX, we'll deliver it with a perfect blend of AI and human creativity. Let’s talk.
Read more
- Clay Global’s Digital Products Case Studies
FAQ
What are the main types of UX research methods?
They fall into three overlapping groups. Qualitative methods (interviews, diary studies, ethnography, focus groups) explain why. Quantitative methods (surveys, analytics, A/B testing) measure what and how often. Evaluative methods (usability testing, card sorting, tree testing, prototype testing, heuristic evaluation) validate or shape a specific design. Most projects use a mix.
What is the difference between qualitative and quantitative UX research?
Qualitative research explores motivation and context with small samples and open-ended data. Quantitative research measures behavior and preference with larger samples and numbers. Qualitative research finds the problem, and quantitative research proves how widespread it is.
What is a primary UX research method?
A primary method gathers first-hand information directly from users, such as interviews, usability testing, surveys, or observation. It contrasts with secondary research, which reuses existing data like published studies, analytics you already have, or competitor analysis.
How do I choose the right UX research method?
Start with the question, not the method. Decide whether you need to know why something happens or how often, whether you're exploring or validating, and whether you need what users say or what they do. Then match that to a method, and factor in your timeline, budget, and project stage.
How many users do I need for UX research?
It depends entirely on the method. Qualitative usability testing works with five users per group. Interviews need five to eight. Surveys need 100 or more to be reliable. Quantitative studies need larger samples still. The five-user rule is specific to qualitative usability testing and does not transfer.
Why is testing with five users considered enough?
For qualitative usability testing, the fifth user rarely surfaces problems the first four missed, so returns diminish quickly. Nielsen's research puts five users at roughly 85% of usability problems found. Running several small rounds across design iterations beats one large round.
What is the difference between behavioral and attitudinal research?
Attitudinal research captures what people say (interviews, surveys). Behavioral research captures what they actually do (usability testing, analytics). When the two disagree, trust behavior. The gap between them is where most flawed product decisions come from.
When should I use qualitative versus quantitative methods?
Use qualitative methods early, when you're deciding what to build and need to understand motivation. Use quantitative methods later, when you need to measure how many users a problem affects or validate a change at scale. Strong research pairs them.
Are focus groups good for usability testing?
No. Group settings create consensus and social pressure that hide individual confusion. Use focus groups to explore perceptions, language, and early reactions to a concept. Test usability one-on-one, where you can watch a single person struggle without the group smoothing it over.
What is the difference between generative and evaluative research?
Generative research happens early and shapes what you build, using methods like interviews and ethnography. Evaluative research happens later and tests whether what you built works, using methods like usability and prototype testing. Using the wrong one for the stage is a common, expensive error.
How is AI changing UX research?
Mostly by speeding up synthesis and analysis rather than replacing user contact. In the 2025 State of User Research survey, 80% of research professionals reported using AI in their workflow. It's useful for tagging transcripts and spotting patterns, but it can't observe a user or judge whether a finding matters.
What is the biggest mistake teams make in UX research?
Treating what users say as what users do. Any process built only on attitudinal methods eventually ships something users claimed to want and then ignored. Validate surprising stated preferences with a behavioral method before acting on them.
How do diary studies differ from other qualitative methods?
Diary studies capture behavior over days or weeks instead of in a single session, which reveals patterns that only show up over time. They suit irregularly used products and contexts where interruptions matter. The tradeoff is participant drop-off and reliance on self-report.
What is tree testing and when should I use it?
Tree testing evaluates your site's navigation structure without any visual design, by having users find items in a text-only hierarchy. Use it before designing screens to catch confusing categories early. It won't tell you anything about visual design, since it deliberately removes it.
What is the difference between card sorting and tree testing?
Card sorting is generative, and tree testing is evaluative. Card sorting asks users to build a structure by grouping content themselves, which tells you how they think about your categories. Tree testing checks whether users can find things in a structure you already built. Sort first to create the navigation, tree test second to validate it.
What is heuristic evaluation and does it replace user testing?
Heuristic evaluation is an expert inspection where three to five reviewers check an interface against established usability principles, with no users involved. It's fast and cheap, which makes it a good first pass to catch obvious problems. It does not replace user testing, because experts miss the issues that only appear when real users pursue real goals.
How do I measure the success of UX research?
Tie research to a metric that moved because of a change you made: conversion rate, task completion time, error rate, or support ticket volume. A number you can trace to a specific design decision proves impact far better than a general satisfaction score reported on its own.
The Real Skill Is Selection
Knowing the methods is table stakes. Any list can give you that. The difference between research that changes a product and research that fills a slide deck is whether the method fit the question, and whether someone checked what the method couldn't see before they trusted it.


About Clay
Clay is a UI/UX design & branding agency in San Francisco. We team up with startups and leading brands to create transformative digital experience. Clients: Facebook, Slack, Google, Amazon, Credit Karma, Zenefits, etc.
Learn more

About Clay
Clay is a UI/UX design & branding agency in San Francisco. We team up with startups and leading brands to create transformative digital experience. Clients: Facebook, Slack, Google, Amazon, Credit Karma, Zenefits, etc.
Learn more


