Tagged: Twitter

Per Axbom reply Twitter

↪ Replying to @mazemilian

@mazemilian I agree. There is a law of diminishing returns in more tests. But: does a "usability test" mean that I am testing 1 feature or 20 features?

@mazemilian By relying on rules like this I believe orgs are testing with too few target groups and not repeating studies often enough.

@mazemilian Because of course the usage obstacles will change not only when redesigning but also by external factors.

🔗 Originally posted on Twitter

Per Axbom reply Twitter

↪ Replying to @mikeosswald

@mikeosswald Important to define what a usability test is, e.g. how users are relevant, how long it runs and how many features are included.

@mikeosswald As I see it, we shouldn't be counting usability issues, we should be always searching critical obstacles to goal fulfillment.

@mikeosswald Also, the rule gives no clues on how fast issues should be fixed and how soon the next study should run...

🔗 Originally posted on Twitter

Per Axbom Twitter

I keep hearing "testing with 5 users unveils 85% of usability problems". Who defines 100% ?! Is there an endgame? Seriously curious. #ux

And I know the original source is Nielsen, but there is very little info on what a usability test is; magnitude, time or number of features.

In this article: nngroup.com/articles/why-y…

The premise at least seems to be that all things remain equal between studies... which in my experience is rarely the case in real life.

There seems to be a lot of assumption about when a usability test is carried out (w/ regards to website lifespan) and how it is carried out.

I understand how the math makes sense in a lab environment ceteris paribus, but UX is affected by many factors not even addressed in tests.

My worry here is that this "rule" tends to undercut what UX brings to the table.

Companies will go: "let's test with 5 users and fix 85% of the problems". And be done with it and not test again in a year.

"Fixing" will of course create new problems as will changes in environment, other touchpoints and competing activities.

Making UX a numbers game diminishes a need to always be chasing design faults. They are never 100% fixed because the world is never static.

Yes, I get what Nielsen means but the approach needs to be much more clarified and wrapped in disclaimers.

Our focus has to be goal fulfillment, not measuring how many usability problems are fixed.

There, I think I'm done now... 😂

If you want to read the original article and study: dl.acm.org/citation.cfm?i…

Working on a revised wording...

🔗 Originally posted on Twitter