DESIGN SPRINT 2.0 - USER TESTING - AJ&Smart

[@imolaunger]

I love Brittni. She makes it so fun

[@AJSmart]

Thanks Imola!

[@lucasbarrientos2000]

I just wanted to say thank you guys. For all your videos. Not only are they so much fun to watch, they're also a GREAT source of info/insight for us UXers and Product Designers. I'm super recommending your channel to my team :) Keep up the great work!!

[@AJSmart]

That's just want we love hearing! Thanks so much Lucas :)

[@JenniferDanieleJN]

Using Miro for remote collaboration - AMAZING! Thank you for all the videos - great info. Brittany, you are awesome!

[@bijeshkarki9677]

Freaking love aj&smarts content amd Brittany so much, she just makes so much fun to learn. Thank you ❤

[@AJSmart]

haha thanks Bijesh! Glad you're enjoying our stuff!

[@Ganji2009]

I watch this before every sprint :) 13 minutes well spent. thank you AJ&Smart

[@AJSmart]

Great to hear Gayanjith! Thanks for the lovely feedback!

[@mikebelmont5919]

You're like Disney movie character ❤

[@AJSmart]

haha! You're not the first one to make that comment... ;)

[@princhipehdesigns5922]

great video, I use UserZoom for user testing and I love the fact that user can take the test without the presence of a host and self record either video or voice at their own time.

[@sprintwithcarlos]

😂 I love Brit because she teach me while I am LMAO! I'm learning a lot, next week I'm delivering a two and half workshop on Design Sprint. Love you guys

[@canalsemvinheta3383]

In love with her voiceeee and the way whe explains things

[@AJSmart]

CanalSemVinheta thanksssss ❤️❤️❤️

[@yalord5378]

Okayy Thank you so much, i already watch all the design sprint video

[@TheL96]

Thanks so much for the video, I hope you guys realise how helpful this content is.....we use zoom for remote testing, because of the screen sharing functionality

[@mariaberg-leirvag5131]

Hi! Thanks for all the great videos! I'm wondering - do you have any template for how you summarize for your client? I feel like I might have seen something like a template in one of your videos - but I don't remember where. It would be very helpful to see how you wrap up and deliver a summary to the client. Thanks!

[@varnaksingh]

That is a beautiful orange and hideous green.

[@asystematec]

Great video! Thanks for making and sharing it. One suggestion: maybe put a summary of the main steps/points at the end so that they're easier to remember. :)

[@AJSmart]

Great advice!! We'll do that next time for sure :) There is definitely a lot to remember when it comes to the User test, so this is a great point!

[@cubgrg007]

Awesome video! I had a quick question. Do you think the magic wand question: "Is there anything we could add to this product to make it the best product for you?" is helpful? I find more often than not users go left field with it or just say its perfect the way it is. I've had a hard time finding value in that question. Any thoughts?

[@marcocomparato5564]

Another way to think about this is to always allow these magic-wand questions, as i find that it waters-down this entitlement-thinking in a healthy way. What i mean is that by my allowing anybody to say what they think about their proposed solution, it reaffirms that there is a 'decider' (as well as a 'budget' and 'schedule') and that we are usually working within contstraints. Its not uncommon that the 'solution' is something we just cant afford or maybe are scoping into a future phase. Got an opinion? I got a hundred of them. If only we could do them... Thus even product-owners and stakeholders are reminded that 'everyone has an opinion, not just you' and thus, they start looking to you to sort through and decide what is valuable. Thats a good place to operate from, as commonly, you are the most experienced person in actually delivering these projects, with a team full of business-owners that maybe think this is all just about 'what i wish for...' and then they make your process take too long/cost too much/ and then blame you. in a way the 'How might we' questions kind of help do the same thing. I personally prefer a huge, long list of wish-items where i am able to show that everything, given enough time/money, can be considered, but we are focused on the real/feasable/most-impactful and that our job is not as easy as just thinking up solutions from thin air. it reinforces the message i always see on that AJSmart poster "Ideas Don't matter. Execution Matters!" to welcome ideas from anybody anywhere anytime. (it also keeps things friendlier when drinking after work with colleagues :)

[@ginilustig1323]

We use Zoom! Great video! Brittni is the best.

[@AJSmart]

Thanks Virginia! Zoom is a great tool as well!

[@ILZorya]

Very interesting to know what questions do you ask? And it will be good to see real user testing that you did.

[@AJSmart]

We’re editing the User Test Questions video right now!! You can expect it verrrrry soon :)

[@jamieyoung689]

She is so charming and funny😍

[@antoinecandy]

I have to lead user tests tomorrow but I forgot my sprint book at home t :'( . Just checked you video to remind be the basics ! Thank you

[@MrFlamerFuel]

Great video! I'm trying to find the next one about questions, mentioned @11:17. Someone please help.

[@dennysutanto6728]

Hey AJ Smart, I have so many questions about Design Sprint, so much questions but I want to ask you one by one.. How many ideal users you do for your Testing? According to Norman Nielsen Groups, it should be 5 person,... what about you? Is it enough just 4 or maybe 5 people?

[@REAL2TRUTH]

lolololol the intro of the video had me rolling lololololol the 2 camera thing...lolololololololol awesome vid!!!!

[@TRG222]

I would love a Post design sprint video!

[@NayoSays]

Is there a video with a remote test example where we could see how it works?

[@jenniferjager2949]

I'd love to see a video about summarizing the feedback or an actual email to a client.

[@AJSmart]

Coming soon :)

[@weeza13]

Still very useful in 2021 :)

[@fabricepohlmann302]

great stuff guys :) I'm curious whats next !!

[@AJSmart]

Fabrice Pöhlmann LOADS more to come 😬

[@renebas852]

I am missing Brittny ♡♡♡♡♡

[@radiozinebladi]

best explanation ever ! keep it up :)

[@AJSmart]

Thanks Khalil!! :)

[@SujeeshJoy]

We use Zoom for remote testing only limitation is it will break session into 45 Mins which is the maximum limit for recording

[@jasperruijs]

Uberconference has a web extension that lets you share your screen, and it works even better as hangouts.

[@Bigjunior987]

Do you have any tips so that remote testers which you don't know and they never heard of you won't cancel short before the meeting?

[@AJSmart]

This is a tough one and a risk we're also aware of. We usually make sure to have some kind of personal contact with them so that they realise that there really is a PERSON depending on them. So sending them a nice email that doesn't sound "robotic" is sometimes all it takes :) good luck!

[@jameelsomji5074]

When testing, do you bother with a document camera to show the user interacting with a digital mobile prototype, or do you just use one camera to capture commentary and facial expressions? This goes for both in person and remote testing. Thx :).

[@AJSmart]

Great question! We actually get the user to share their screen with us (a function on Google Hangouts) which makes it easier to guide them through the product. We don't actually capture their facial expressions or body language for these tests. The "tester" would be the one to recognise these things and include them in their findings. Our focus is definitely on how they are interacting with the product and by using probing questions, we get their "emotional" feedback as well... Hope that helps!

[@jameels227]

AJ&Smart ok great. So when it comes to testing mobile app prototypes, are you testing on a laptop, rather than on a phone given that you cannot share the phone screen using google hangouts?

[@AJSmart]

Yes, exactly. So if the test is done in person, we would give them a mobile phone to test on. If it's remote, we would have them open the prototype on their laptop!

[@imolaunger]

In the past I've done mobile testing where we did both video calling and screen sharing. The software was Cisco Webex - the only one I've been able to find that does screen sharing AND a video call simultaneously, though it's really not a joy to use. The test subject and I were in the same room and we were streaming the whole thing for the rest of the team next door. The tester's face was streamed through the laptop's webcam and they were using a real iPhone, but the team next door could see each and every tap and scroll. The hack? Plug the iPhone into a MacBook, launch QuickTime, start a new screen recording, and select the iPhone as a source (using the dropdown right by the red "record" button). This will replicate the phone screen on your laptop screen. This will work with any screen sharing service and you needn't use a document camera!

[@jameels227]

Thank you Imola. Very helpful :)

[@julianaferry]

I use Slack and there is also Zoom.

[@dennysutanto6728]

Yes 👍 it also Zoom... it has better and stable connection compared to Google hangouts for my experience

[@DCTapeworm]

Just curious... how did y'all figure out what equipment/props to use to make these? I'm certain you've posted that info before. If so, please reply with some URL magic. Keep the content coming! It's great.

[@AJSmart]

Trail and error my friend!! I'm assuming you're talking about the user tests and not the videos right? :) For the user tests, we're currently using, Google Hangouts and Zoom (as an alternative to having the clients join in on the calls) zoom.us Does that help? Let us know!

[@DCTapeworm]

Apologies. :) I watched Brittany go through Hangouts and am familiar with Zoom (I've used it numerous times). I meant the camera you're using to film the videos. In one of the episodes of the Product Breakfast Club (one of the first two), Johnathan said he read up on what it took to make videos through a related book. He didn't provide any other info, so I was inquiring after watching this one. :) Hope that helps. I'll assume if I don't get a reply back, then y'all are reasonably busy and I should figure it out on my own. Hope you have a great weekend!

[@AJSmart]

Hey Robert, Jonathan here, I'm assuming you mean the KZbin vids right? We're using 2 cameras: The Sony Alpha 7II (i'm pretty sure) and the Canon G7X which is AMAZING! I love the canon.

[@DCTapeworm]

Hi Jonathan. Yep! That's exactly what I was wondering about. We're looking to do some videos of our own and really liked how these came out. Appreciate the reply. PS: I'm a UX Manager at Sabre, and we've incorporated your Lightning Decision Jam process for our UX teams working on our top projects. Every quarter they come together, do an LDJ on what they want to address as a team (takes an hour), and each designer takes part ownership of the solution. It's helped teams cut back on unnecessary meetings, designate a product owner, and arrange after hours get togethers around particular topics of interest. And that's only after starting it last October. PSS: We also do design sprints, but that's a whole different topic. I personally refer back to your best practices videos (Storyboarding 2.0 is brilliant, and your recent 'Making a map' vid is really good) to save time and make the process more efficient. Btw, look into 'Question Storming' for the Sprint Question segment on Monday. It's a great tool to validate rationale and surface doubts/questions from the Sprint team. PSSS: Holy living f**k, Johnathan Courtney directly answered my question. Made my f**king weekend. Thank you very much, and keep up the great work you're doing.

[@AJSmart]

Don't know if there were enough P.S.'s there to be honest Robert, super disappointed! Really cool that you're using LDJ! I'm working on a "Solo LDJ" exercise at the moment btw, giving it a test run in a closed Facebook group called "Innovation Hackers" - if you're on FB you should join the conversation!

[@YormanNunez]

hmm, I think this is the only video in this series without subtitles. That makes it difficult to follow along for folks like me. I love your content though.

[@JessTelford]

The "Finding User Testers for Design Sprints" video is here: kzbin.info/www/bejne/p5bCnXhmmL1pjac (I couldn't click the thumbnail in this video for some reason)

[@AJSmart]

Thank you very much!! You should be able to click the little "i" icon in the top right when the thumbnail pops up! But that's not super clear in the video! I'm sorry!

[@JessTelford]

AJ&Smart no need to apologise, these videos are amazing! Helped me brush up on my Design Sprint knowledge, so I could run my first solo sprint: twitter.com/jesstelford/status/973076539616108544?s=20

[@AJSmart]

That is so cool to see Jess! Thank you for sharing that with us =)

[@ayushbhardwas]

Orange is not ugly 😤

[@jz1908]

Do you plan to do a Design Sprint 2.0 Video on the Prototyping Step?

[@AJSmart]

yes! coming very soon! Make sure you're subscribed :)

[@jonasarleth]

Why do you write everything on a whiteboard when you have to digitize it after the session?

[@AJSmart]

Jonas! Excellent question. This is mostly for the visual. It's easier to see patterns and therefore group common themes, etc. BUT we just got a sweet interactive whiteboard that we are planning to start using which could be a cool way to digitise the whole process! We'll keep you posted on that ;)

[@susanchopra3204]

Soooo - it's been 8 months, care to share about the interactive whiteboard? I'm curious!

[@anandamatos]

@@susanchopra3204 the interact whiteboard is: realtimeboard.com =]

[@jourdango2615]

 L AJ&Smart Back tomorrow Hello AJ & Smart I've got a difficult design sprint question I haven't been able to find an answer to. The design Sprint's success rests on customer validation, and the design sprint tells you how to run the workshop with the customers and how to do the interview etc. But what it doesn't teach you is how to answer questions like 1) who SHOULD my users be? Who would be the right tatget audience for my product? Which market segment should I cater to? How can I validate that I'm servicing the right market of customers? 2) assuming I've gotten a good 1-2 guesses of who my product is for, how do I get a pool of test users? What are the different options? Fb ads? Create a beta website or something??? Please help me answer these questions. In addition, I would like to ask 3) from an end to end process, would you say do market research first, and then sprint, and then once you have validated some things at the end of the sprint, where does it go from there? Product management? What does a complete 0 to product launch look like? This is valuable! Thank you

[@dhritimansen3307]

on a more off-topic note, I'm sensing vague resemblances in her to January Jones. Is that just me?

[@AJSmart]

I've gotten that before actually!! I think it's the hair... ;)

[@dhritimansen3307]

Def the hair, along with the eyes and facial bone structure def too.

[@chadbowen6839]

Liked

[@AJSmart]

We like you.

[@wise_nut]

She's so cute..... I love you!

[@AJSmart]

Thanks Hazel!

[@pimpalaputty]

What about zoom.us/ instead of Hangouts? We struggled with all of the others for years then we found Zoom and now we are much happier people.

[@AJSmart]

We have used that for some video/podcast style calls! Could be a shout for the tests too!

[@marielilemes]

We use www.useloom.com or skype and recording the session! :D

[@AJSmart]

Thanks for sharing this Marieli!

[@kristiaanneumann3976]

PingPong

[@dayvudmorin]

It's not user testing. You don't test users you test products!

[@AJSmart]

🙄

[@dayvudmorin]

haha I know I know! It's a great video. I just like getting away from that term. I know it's the widely used term for the work I just think it isn't accurate. Thank you for your video. It's great content and well made :)

[@AJSmart]

HOOWEEEE! Good point ;)

[@fredrickroyster5859]

I guess everyone is using Zoom these days in these pandemic times

[@AJSmart]

TRUE! haha

[@Bigjunior987]

Loopback

[@AJSmart]

Interesting! We'll have to try it!