{"id":848,"date":"2014-02-16T10:43:39","date_gmt":"2014-02-16T15:43:39","guid":{"rendered":"http:\/\/blog.agilityfeat.com\/?p=848"},"modified":"2014-02-16T10:43:39","modified_gmt":"2014-02-16T15:43:39","slug":"usability-testing-is-like-working-out","status":"publish","type":"post","link":"http:\/\/34.200.113.64\/en\/blog\/2014\/02\/usability-testing-is-like-working-out\/","title":{"rendered":"Why you are as bad at Usability Testing as working out"},"content":{"rendered":"<p><a href=\"http:\/\/weknowmemes.com\/2012\/05\/i-forgot-to-post-on-facebook-i-was-going-to-the-gym\/\"><img loading=\"lazy\" src=\"https:\/\/agilityfeat.com\/wp-content\/uploads\/2014\/02\/i-forgot-to-post-on-facebook-i-was-going-to-the-gym.jpg\" alt=\"i-forgot-to-post-on-facebook-i-was-going-to-the-gym\" width=\"420\" height=\"306\" class=\"alignleft size-full wp-image-849\" \/><\/a>How are those New Year\u2019s resolutions going? If it\u2019s anything like mine, it\u2019s probably not going quite as well as planned. You were really into your new goal for a couple of days, downloaded a new app to help you along, made some kind of plan, and then life got busy. <\/p>\n<p>The old routine kicked in and a few weeks later, you were repeating the same thing again: \u201cI really need to work out more.\u201d<\/p>\n<p><strong>Our team here at AgilityFeat has been conducting interviews with UX practitioners to learn how they are doing usability testing. We started hearing the same kinds of things &#8212; \u201cWe should do more usability testing\u201d &#8212; in a way reminiscent to the whole  \u201cI need to work out more\u201d thing.<\/strong><\/p>\n<p>We all know we need to do it, but it\u2019s often not our top priority. As we\u2019ve continued to explore this problem with failed usability resolutions through conversations, we\u2019ve noticed some trends:<\/p>\n<h2>#1 Everyone values usability testing<\/h2>\n<p>Everyone we talk to sees tremendous value in usability testing.  Anytime you sit down with customers and show them your software, you learn a ton. People look for things you didn\u2019t expect, try to click in places you didn\u2019t make clickable, and stumble on menu structures you thought seemed really clear. <\/p>\n<p>Most people understand this, which is why UX is becoming a more prominent role. <strong>Whenever IT teams do get around to some usability testing, they leave the sessions with the same sort of endorphins you feel after a good workout: \u201cThat felt great!\u201d \u201cWe should do that more!\u201d<\/strong>  <\/p>\n<p><strong>And yet they still don\u2019t \u2026 Why?<\/strong><\/p>\n<h2>#2 Usability testing means many different things<\/h2>\n<p><img loading=\"lazy\" src=\"https:\/\/agilityfeat.com\/wp-content\/uploads\/2014\/02\/Only13lbsToGo-300x210.jpg\" alt=\"Only13lbsToGo\" width=\"300\" height=\"210\" class=\"alignleft size-medium wp-image-852\" \/>Because our company is widely distributed around North and Central America, we\u2019re particularly interested in remote usability testing. When talking with UX practitioners, we\u2019ve been a little surprised to learn how many different approaches to usability testing there are. It\u2019s not just a choice of remote and in-person; there\u2019s a lot of variation on timing, pre-screening, incentives, and more.<\/p>\n<p>Some companies only do usability testing <strong>after a release<\/strong>, to see if users like the new features or behave the way they expected.  Or they do usability testing as a sort of <strong>manual A\/B testing<\/strong> of different features. Some companies <strong>test new features before they\u2019re deployed<\/strong>, and this could involve \u201ctesting\u201d against a mockup or prototype, or sending the user to a private beta URL. <\/p>\n<p>Others conduct usability testing purely in the <a href=\"http:\/\/www.youtube.com\/watch?v=NM9TCeB3v7Q\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>\u201cthink aloud\u201d<\/strong><\/a> style, asking users to accomplish a task on the production site as they sit back silently and take notes. Some prefer to do the usability testing in person to better gauge a subject\u2019s emotional reactions. Others prefer remote usability testing with desktop screen sharing tools, aiming to see the test subject perform in their <strong>natural work or home environment<\/strong>, rather than a fabricated UX lab setting.<\/p>\n<p>Everyone values usability testing, but there are many different compelling motivations to do it &#8212; again, just like exercise. Some of us are looking ahead to summer swimsuits, others are just trying to extend their lifespan. <\/p>\n<p><strong>Every UX practitioner values usability testing and *should be* motivated to do it,  so again, why aren\u2019t people doing more of it?<\/strong><\/p>\n<h2>#3 Finding relevant test subjects is difficult, depending on the size and nature of the organization<\/h2>\n<p>Many companies we\u2019ve researched use usertesting.com to recruit test participants outside of the current customer base. UserTesting provides a base of millions of potential test subjects, which is wonderful, but are those users truly relevant to your application?  <strong>Finding good test subjects can be complicated and time consuming. Some companies we talked with have this down to a science, others struggle with the amount of work it takes.<\/strong><\/p>\n<p>Depending on the type of usability test, some companies go to their own user base or live visitors on their website and try to recruit them. Others take cameras and go out to the homes or businesses of their customers. And one company we talked with particularly values testing their applications with users who are not as internet savvy &#8211; so they use traditional recruitment methods like posting flyers in grocery stores.<\/p>\n<p><strong>Once you get a willing participant, getting them to actually show up and participate is another issue. <\/strong>Signing up for that boot camp exercise class is easy, actually waking up early enough in the morning to fit it in\u2026 not so easy.<\/p>\n<h2>#4 Usability testing has a learning curve<\/h2>\n<p><strong>One of the biggest challenges to remote usability testing is the onboarding process.<\/strong> In order to conduct a 30-minute usability session, you often need 15-20 minutes of prep time to: <\/p>\n<ul>\n<li>Explain the protocol of the session <\/li>\n<li>Explain how you will reward them (the gift card will arrive right after the test, I promise!)<\/li>\n<li>Help them install GoToMeeting or some other desktop sharing tool <\/li>\n<\/ul>\n<p>You\u2019re probably doing this over a phone line and then perhaps switching to the conference call tool once it\u2019s setup.  It\u2019s a lot of setup time for a relatively short interview, and probably never repeated with that particular person again.<\/p>\n<p>When you join a new gym for the first time, you often get a free session with a personal trainer to show you around the equipment and instruct you on how to use it safely. That\u2019s a lot of work if you only do a couple workouts and then quit. No wonder gyms require long contracts!<\/p>\n<h2>#5 How are we going to see results?<\/h2>\n<p><a href=\"http:\/\/www.someecards.com\/encouragement-cards\/new-years-resolution-exercising-going-to-the-gym\"><img loading=\"lazy\" src=\"https:\/\/agilityfeat.com\/wp-content\/uploads\/2014\/02\/exhausted-yearly-gym-new-years-encouragement-ecards-someecards.png\" alt=\"exhausted-yearly-gym-new-years-encouragement-ecards-someecards\" width=\"425\" height=\"237\" class=\"alignleft size-full wp-image-850\" \/><\/a>The endorphins after that first workout of the new year are awesome. Then, the next morning, you get on the scale and see nothing has changed \u2026 yet.  <strong>Persistence is the key to turning a resolution into a lifestyle change, and usability testing is similar.<\/strong><\/p>\n<p>The benefits of regular research are obvious to everyone we meet &#8212; there\u2019s no convincing needed &#8212; but finding a sustainable way to conduct these sessions takes a level of diligence that\u2019s difficult to achieve in the face of the large overhead often necessary to conduct usability testing.<\/p>\n<p>More than one of the interview subjects admitted to feeling almost embarrassed that they don\u2019t do usability testing as often as they\u2019d like. To do it consistently requires getting a real process in place for user recruitment, session protocol, and the incorporation of the results back into the workflow.  <\/p>\n<p><strong>People who do all of this well are seeing great results, and others are holding their software up to the mirror and wishing it would fit into that two-piece bathing suit a little better.<\/strong><\/p>\n<p><em>Many thanks to <a href=\"https:\/\/twitter.com\/nanalq\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Mariana Lopez<\/strong><\/a> and <a href=\"https:\/\/twitter.com\/lindsayifill\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Lindsay Ifill<\/strong><\/a>, who co-authored this post along with <a href=\"https:\/\/twitter.com\/arinsime\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>me<\/strong><\/a> and have contributed significant amounts of time and expertise to the interviews we have been conducting.  We&#8217;re learning a lot and plan to post more on this topic in the future, but contact us via twitter if you have any questions in the meantime.<\/em><\/p>","protected":false},"excerpt":{"rendered":"<p>How are those New Year\u2019s resolutions going? If it\u2019s anything like mine, it\u2019s probably not going quite as well as planned. You were really into your new goal for a couple of days, downloaded a new app to help you along, made some kind of plan, and then life got busy. The old routine kicked [&hellip;]<\/p>","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":""},"categories":[100],"tags":[27,123,49],"jetpack_featured_media_url":"","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v15.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Why you are as bad at Usability Testing as working out - AgilityFeat Panama Software Test Center<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Why you are as bad at Usability Testing as working out - AgilityFeat Panama Software Test Center\" \/>\n<meta property=\"og:description\" content=\"How are those New Year\u2019s resolutions going? If it\u2019s anything like mine, it\u2019s probably not going quite as well as planned. You were really into your new goal for a couple of days, downloaded a new app to help you along, made some kind of plan, and then life got busy. The old routine kicked [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/\" \/>\n<meta property=\"og:site_name\" content=\"AgilityFeat Panama Software Test Center\" \/>\n<meta property=\"article:published_time\" content=\"2014-02-16T15:43:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/agilityfeat.com\/wp-content\/uploads\/2014\/02\/i-forgot-to-post-on-facebook-i-was-going-to-the-gym.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data1\" content=\"6 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/34.200.113.64\/#website\",\"url\":\"https:\/\/34.200.113.64\/\",\"name\":\"AgilityFeat Panama Software Test Center\",\"description\":\"AgilityFeat Panama offers customized, multilevel web and mobile software testing for a variety of industries.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/34.200.113.64\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/agilityfeat.com\/wp-content\/uploads\/2014\/02\/i-forgot-to-post-on-facebook-i-was-going-to-the-gym.jpg\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/#webpage\",\"url\":\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/\",\"name\":\"Why you are as bad at Usability Testing as working out - AgilityFeat Panama Software Test Center\",\"isPartOf\":{\"@id\":\"https:\/\/34.200.113.64\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/#primaryimage\"},\"datePublished\":\"2014-02-16T15:43:39+00:00\",\"dateModified\":\"2014-02-16T15:43:39+00:00\",\"author\":{\"@id\":\"https:\/\/34.200.113.64\/#\/schema\/person\/c8d60d597071526db386b2b8a4afac64\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/agilityfeatpanama.com\/blog\/2014\/02\/usability-testing-is-like-working-out\/\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/34.200.113.64\/#\/schema\/person\/c8d60d597071526db386b2b8a4afac64\",\"name\":\"arin\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/34.200.113.64\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"http:\/\/0.gravatar.com\/avatar\/cc498e210512c707ed769986dd745896?s=96&d=mm&r=g\",\"caption\":\"arin\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/posts\/848"}],"collection":[{"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/comments?post=848"}],"version-history":[{"count":0,"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/posts\/848\/revisions"}],"wp:attachment":[{"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/media?parent=848"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/categories?post=848"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/34.200.113.64\/en\/wp-json\/wp\/v2\/tags?post=848"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}