[Openstack-personas] link to persona interview questions
Jacki Bauer
jacki.bauer at RACKSPACE.COM
Thu Apr 3 12:25:48 UTC 2014
I wasn’t in the meeting either, so here’s my update:
* My pilot interview was kind of a bust - the interviewee was a developer who was very junior in his role, had only used AWS a little, OpenStack even less. It sounded like he had already participated in the usability testing, so most of what he spoke to was the Create Instance experience.
* I’ve also had a hard time getting responses back from the candidates I’ve emailed to schedule interviews – I only got 3/8 responded to schedule and 1 email bounced.
I’m interested in hearing how the rest of the interviews went. Was mine an anomaly or do we need to revisit the recruiting phase to get more candidates to select from?
From: Thuy T Duong <ttduong at us.ibm.com<mailto:ttduong at us.ibm.com>>
Date: Tuesday, April 1, 2014 at 11:44 AM
To: "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>>
Cc: Jacki Bauer <jacki.bauer at rackspace.com<mailto:jacki.bauer at rackspace.com>>, Jeffrey A Calcaterra <jacalcat at us.ibm.com<mailto:jacalcat at us.ibm.com>>, Ju Lim <julim at redhat.com<mailto:julim at redhat.com>>, Liz Blanchard <lsurette at redhat.com<mailto:lsurette at redhat.com>>, "Meingast, Melissa" <Melissa.Meingast at hp.com<mailto:Melissa.Meingast at hp.com>>, Michelle Peterson <michelle.peterson at RACKSPACE.COM<mailto:michelle.peterson at RACKSPACE.COM>>, "openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>" <openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>>, "Gallagher, Phyllis" <phyllis.gallagher at hp.com<mailto:phyllis.gallagher at hp.com>>
Subject: RE: [Openstack-personas] link to persona interview questions
Hey team,
I wanted to let you know that Jeff and I won't be able to make the meeting tomorrow. We've submitted the interview we had with Will to the Google Form that Piet created. Thank you!
Cheers,
Thuy
________________________________
Thuy Duong
UX Designer and Researcher
PureApplication System
206.883.3176
ttduong at us.ibm.com<mailto:pgilbert at us.ibm.com>
[IBM Design]
11501 Burnet Rd
Austin, Texas 78758
United States
[Inactive hide details for "Kruithof, Piet" ---03/28/2014 03:11:20 PM---Excellent! Updated form can be found at:]"Kruithof, Piet" ---03/28/2014 03:11:20 PM---Excellent! Updated form can be found at:
From: "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>>
To: Jeffrey A Calcaterra/Raleigh/IBM at IBMUS
Cc: Jacki Bauer <jacki.bauer at RACKSPACE.COM<mailto:jacki.bauer at RACKSPACE.COM>>, Ju Lim <julim at redhat.com<mailto:julim at redhat.com>>, "Liz Blanchard" <lsurette at redhat.com<mailto:lsurette at redhat.com>>, "Meingast, Melissa" <Melissa.Meingast at hp.com<mailto:Melissa.Meingast at hp.com>>, Michelle Peterson <michelle.peterson at RACKSPACE.COM<mailto:michelle.peterson at RACKSPACE.COM>>, "openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>" <openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>>, "Gallagher, Phyllis" <phyllis.gallagher at hp.com<mailto:phyllis.gallagher at hp.com>>, Thuy T Duong/Austin/IBM at IBMUS
Date: 03/28/2014 03:11 PM
Subject: RE: [Openstack-personas] link to persona interview questions
________________________________
Excellent!
Updated form can be found at:
https://docs.google.com/forms/d/1bQFygy9RGCam_Nw9xyrXPSY0TxwIcGALTsuSeir-M5s/edit
Piet
From: Jeffrey A Calcaterra [mailto:jacalcat at us.ibm.com]
Sent: Friday, March 28, 2014 6:22 AM
To: Kruithof, Piet
Cc: Jacki Bauer; Ju Lim; Liz Blanchard; Meingast, Melissa; Michelle Peterson; openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>; Gallagher, Phyllis; Thuy T Duong
Subject: RE: [Openstack-personas] link to persona interview questions
Hi Piet,
We used it yesterday and it seemed to work very well.
Jeff
Jeff Calcaterra
IBM SmartCloud Entry User Experience Design and Research
STG UI Patent Board Chair
email: jacalcat at us.ibm.com<mailto:jacalcat at us.ibm.com>
Portfolio: http://pokgsa.ibm.com/gsa/pokgsa/home/j/a/jacalcat/public/
From: "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>>
To: Jacki Bauer <jacki.bauer at RACKSPACE.COM<mailto:jacki.bauer at RACKSPACE.COM>>, Jeffrey A Calcaterra/Raleigh/IBM at IBMUS,
Cc: Ju Lim <julim at redhat.com<mailto:julim at redhat.com>>, Liz Blanchard <lsurette at redhat.com<mailto:lsurette at redhat.com>>, "Meingast, Melissa" <Melissa.Meingast at hp.com<mailto:Melissa.Meingast at hp.com>>, Michelle Peterson <michelle.peterson at RACKSPACE.COM<mailto:michelle.peterson at RACKSPACE.COM>>, "openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>" <openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>>, "Gallagher, Phyllis" <phyllis.gallagher at hp.com<mailto:phyllis.gallagher at hp.com>>, Thuy T Duong/Austin/IBM at IBMUS
Date: 03/27/2014 03:28 PM
Subject: RE: [Openstack-personas] link to persona interview questions
________________________________
Just wanted to confirm that the link that Jeff had provided is the final questionnaire. If so, I’ll go ahead and add it to the Google form.
Piet
From: Jacki Bauer [mailto:jacki.bauer at RACKSPACE.COM]
Sent: Wednesday, March 26, 2014 9:14 AM
To: Jeffrey A Calcaterra
Cc: Ju Lim; Liz Blanchard; Meingast, Melissa; Michelle Peterson; openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>; Gallagher, Phyllis; Kruithof, Piet; Thuy T Duong
Subject: Re: [Openstack-personas] link to persona interview questions
Thanks Jeff, I think this is totally manageable now and will make for informative pilot interviews.
I think recording these is really important. Has anyone recorded a google hangout before? If I can’t figure out how to do it I might just use webex.
On Mar 25, 2014, at 10:45 PM, Jeffrey A Calcaterra <jacalcat at us.ibm.com<mailto:jacalcat at us.ibm.com>> wrote:
All,
I tried to pare down the survey in the way along the lines that Jackie had suggested. Here are the results: https://docs.google.com/document/d/1iVhjIQ1Rhd-i6HuAB9hvuERQF_x78giOiJsSRhbuCWk/edit
Changes:
1. I pared the questions down to about 1 1/2 pages and added a small introduction.
2. I tried to combine questions as much as possible and ask them more indirectly. For example, I asked "" for both of these:
-Cloud End Users - How do you know how your applications/services are doing? How do you know if there is a problem?
-Cloud Operators - Where and how do you learn about new releases and feature improvements to OpenStack (or cloud tech overall)
Hopefully, the role of the user will make the right areas to probe obvious.
3. Newly added questions are blue. They are mostly trying to get at some of the more direct questions in a more open-ended way.
It seems much more manageable.
Also, I agree with Jackie's goals and added "Common scenarios for OpenStack", which I would also include things like self-service vs. admin provisioned and permissions for end users.
Finally, I'm not sure if everyone was planning to record. We said that it is optional in our emails to participants and we will ask when participants join. I added that to the intro.
Jeff
Jeff Calcaterra
IBM SmartCloud Entry User Experience Design and Research
STG UI Patent Board Chair
email: jacalcat at us.ibm.com<mailto:jacalcat at us.ibm.com>
Portfolio: http://pokgsa.ibm.com/gsa/pokgsa/home/j/a/jacalcat/public/
From: Jacki Bauer <jacki.bauer at rackspace.com<mailto:jacki.bauer at rackspace.com>>
To: Jeffrey A Calcaterra/Raleigh/IBM at IBMUS,
Cc: Liz Blanchard <lsurette at redhat.com<mailto:lsurette at redhat.com>>, "Gallagher, Phyllis" <phyllis.gallagher at hp.com<mailto:phyllis.gallagher at hp.com>>, "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>>, Ju Lim <julim at redhat.com<mailto:julim at redhat.com>>, "Meingast, Melissa" <Melissa.Meingast at hp.com<mailto:Melissa.Meingast at hp.com>>, "openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>" <openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>>, Thuy T Duong/Austin/IBM at IBMUS, Michelle Peterson <michelle.peterson at rackspace.com<mailto:michelle.peterson at rackspace.com>>
Date: 03/25/2014 09:26 AM
Subject: Re: [Openstack-personas] link to persona interview questions
________________________________
Jeff,
Thanks for doing this! I agree with starting with the environment to provide context. And the flow is much better. But I think there are still too many questions for an interviewer to get through.
My recommendation would be to have 4-6 very high level questions. For each of those questions, we have a cheat sheet in front of us with a variety of probing questions that will get us to what we want to learn. A lot of times the interviewee will answer those questions on their own, but if they are going in a direction that isn’t helpful, we can use the cheat sheet to keep them on topic. That way we leave opportunity for discovering things we didn’t think to ask and avoid accidentally leading the interviewee to the answers we are looking for.
The first section of this article describes this method - http://lorrainepaterson.wordpress.com/2010/07/30/user-research-and-persona-creation-part-1-data-gathering-methods/
Also, I still don’t have a good understanding of the goals of this study and what we want the resulting personas to do for us - I think this is making things more difficult for the group, as there is no priority on which topics to cover. I made a pretty lame attempt to write up a goal in the Google doc that Jeff shared.
If people agree with this approach, I have some time today to work on it, or anyone else can jump in.
-Jacki
PS - Sorry everyone for opening the can of worms at the last minute. I meant to look at this last Wednesday and completely forgot.
On Mar 25, 2014, at 7:19 AM, Jeffrey A Calcaterra <jacalcat at us.ibm.com<mailto:jacalcat at us.ibm.com>> wrote:
All,
Here is yet another version...
I had started with my own arrangement of questions yesterday that I was going to send out and blended together what Jacki had done as well. I got the questions down by about a half a page.
A few notes:
1. I started the interview with the environment, which I think is very helpful because that provides much of the context for the subsequent discussion.
2. I tried to combine and remove redundant questions when possible and I put those at the end with comments. Questions that I added are in blue.
3. I added all the Role-specific questions in green.
To me, this seems to flow better as I imagine interviewing a participant. Any feedback?
Jeff
Jeff Calcaterra
IBM SmartCloud Entry User Experience Design and Research
STG UI Patent Board Chair
email: jacalcat at us.ibm.com<mailto:jacalcat at us.ibm.com>
From: Jacki Bauer <jacki.bauer at RACKSPACE.COM<mailto:jacki.bauer at RACKSPACE.COM>>
To: "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>>,
Cc: "Gallagher, Phyllis" <phyllis.gallagher at hp.com<mailto:phyllis.gallagher at hp.com>>, "openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>" <openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>>, Liz Blanchard <lsurette at redhat.com<mailto:lsurette at redhat.com>>
Date: 03/24/2014 01:02 PM
Subject: Re: [Openstack-personas] link to persona interview questions
________________________________
In an attempt to consolidate questions, I went ahead and sorted all of the questions by theme. Almost all the questions are variations on the following:
* What do you do?
* How often do you do it?
* Who do you work with?
* How do you do it?
* What do you do it on / Where do you do it?
* What are your priorities?
* What are your problems?
Here’s the document with the sorted questions - https://docs.google.com/document/d/1E4eujvFhtvBBAuADT9OymXNCkczDV_BpUlje-4Dm2-U/edit?usp=sharing
Obviously we won’t ask people these vague questions, but do the categories represent what we want to learn? Can we eliminate any? Maybe we can come up with one or two main questions per category and leave the others as sub-questions/conversation helpers.
Feel free to leave comments or vote on priorities in the Google doc.
-J
On Mar 23, 2014, at 12:27 AM, Kruithof, Piet <pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>> wrote:
Here is a link to the interview questions for the OpenStack Personas.
https://docs.google.com/forms/d/1bQFygy9RGCam_Nw9xyrXPSY0TxwIcGALTsuSeir-M5s/edit?usp=sharing
One word of warning – there are a lot of questions! It feels like we may need to reduce it a bit or consolidate some of the questions.
Piet
Pieter Kruithof, MS, CPE
UX Design and Research Lead
Cloud OS
pieter.c.kruithof-jr at hp.com<mailto:pieter.c.kruithof-jr at hp.com>
T +1 970 8981918
M +1 512 5762844
"If you think good design is expensive, you should look at the cost of bad design.”
Dr. Ralf Speth, CEO Jaguar
Hewlett-Packard Company
3404 E Harmony Rd.
FTC06
Fort Collins, CO 80528-9544
USA
_______________________________________________
openstack-personas mailing list
openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-personas
_______________________________________________
openstack-personas mailing list
openstack-personas at lists.openstack.org<mailto:openstack-personas at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-personas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-personas/attachments/20140403/cb80ceac/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 1E785331.jpg
Type: image/jpeg
Size: 8326 bytes
Desc: 1E785331.jpg
URL: <http://lists.openstack.org/pipermail/openstack-personas/attachments/20140403/cb80ceac/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: graycol.gif
URL: <http://lists.openstack.org/pipermail/openstack-personas/attachments/20140403/cb80ceac/attachment-0001.gif>
More information about the openstack-personas
mailing list
