Open Stack

Team:

Thank you Jeff and Jacki for the work you've done to improve the questionnaire.

Thank you Piet on inputting the questions into Google Forms.

Regarding recordings, I'm not in favor of it, and I know this is shaping up to be a heated discussion about it (potentially).  Since this information from the interview will be shared upstream, to keep confidentiality and to anonymize things, I'd recommend not to recording.  While I understand note taking is not perfect, we have 4 different teams interviewing for the same 3-4 user roles and at some level, all of the persona interviews will serve as a aggregation and validation point.  I don't personally think we will always be 100% right, but if you think of persona development as a process of continuous improvement (like in Agile and the way OpenStack works), what we should come away with is an initial proposal (and hopefully good set at that as a starting point), and use that to further refine, validate, improve, etc. over time.  Think of like code delivered in OpenStack today, there are going to bugs, and we can fix them over time.

IMHO, if folks do want to record, I might suggest this be done by a company/team basis and that you keep the recording internally according to your company's direction / legal regarding this.

Just my 2 cents,
Ju


On Mar 26, 2014, at 1:03 PM, "Meingast, Melissa" <Melissa.Meingast at hp.com> wrote:

> I’d be inclined to  getting the agreement in writing, per APA guidelines, just to be on the safe side.
>  
> From: Jacki Bauer [mailto:jacki.bauer at RACKSPACE.COM] 
> Sent: Wednesday, March 26, 2014 11:18 AM
> To: Kruithof, Piet
> Cc: Liz Blanchard; Jeffrey A Calcaterra; Ju Lim; Meingast, Melissa; Michelle Peterson; openstack-personas at lists.openstack.org; Gallagher, Phyllis; Thuy T Duong
> Subject: Re: [Openstack-personas] link to persona interview questions
>  
> Yep, you’re right. It seems like we'd have to get a verbal agreement and make no promise of confidentiality.
>  
>  
>  
>  
> On Mar 26, 2014, at 10:52 AM, Kruithof, Piet <pieter.c.kruithof-jr at hp.com> wrote:
> 
> 
> Hey Jacki,
>  
> As a group, we would also need to discuss who would have access to the recordings.  There is kind of a difference between having a participant sign a consent or verbally agree when the recording will be kept safely within a company like RackSpace or HP. 
>  
> In this case, the recordings could be shared with anyone within or potentially outside of the community.  As far as I know, the community has no policies around how this kind of content is shared or distributed. 
>  
> Piet
>  
>  
>  
> From: Jacki Bauer [mailto:jacki.bauer at RACKSPACE.COM] 
> Sent: Wednesday, March 26, 2014 9:37 AM
> To: Kruithof, Piet
> Cc: Liz Blanchard; Jeffrey A Calcaterra; Ju Lim; Meingast, Melissa; Michelle Peterson; openstack-personas at lists.openstack.org; Gallagher, Phyllis; Thuy T Duong
> Subject: Re: [Openstack-personas] link to persona interview questions
>  
> Piet,
> I’m not sure about other companies, but Rackspace legal allows us to get verbal consent. I also have NDA and consent forms that I could have someone sign.
>  
> Liz,
> Even good notetakers can miss things, but especially because there are 4 teams of interviewers, having a recording can allow us to look back and see whether the interviews were done consistently, if one interviewer emphasized something more than another, etc. 
>  
>  
>  
> On Mar 26, 2014, at 10:20 AM, Kruithof, Piet <pieter.c.kruithof-jr at hp.com> wrote:
> 
> 
> 
> There are potentially some issues around recording the sessions.  For example, the participants have not signed any legal documents agreeing to be recorded. 
>  
> Just out of curiosity, did anyone try to record the usability sessions?
>  
> Piet
>  
> From: Liz Blanchard [mailto:lsurette at redhat.com] 
> Sent: Wednesday, March 26, 2014 9:19 AM
> To: Jacki Bauer
> Cc: Jeffrey A Calcaterra; Ju Lim; Meingast, Melissa; Michelle Peterson;openstack-personas at lists.openstack.org; Gallagher, Phyllis; Kruithof, Piet; Thuy T Duong
> Subject: Re: [Openstack-personas] link to persona interview questions
>  
>  
> On Mar 26, 2014, at 11:13 AM, Jacki Bauer <jacki.bauer at rackspace.com> wrote:
> 
> 
> 
> 
> Thanks Jeff, I think this is totally manageable now and will make for informative pilot interviews.
>  
> Agreed! Thanks Jeff and Jacki for taking the time on this. Ju and I are doing our first interview on Friday with a developer so we will have feedback for the next Persona meeting for sure.
> 
> 
> 
> 
>  
> I think recording these is really important. Has anyone recorded a google hangout before? If I can’t figure out how to do it I might just use webex.
>  
> I’m not sure we are planning to record these, but one person will be vigorously taking notes :) As far as recording hangouts goes…you could just use Quicktime to do a screen recording. There is also Hangouts on Air [1], but this is really meant more for live broadcasting hangouts. Also, these videos are public as far as I know, so it would be hard to protect the participants identity I think.
>  
> Liz
>  
> [1] https://support.google.com/plus/answer/2553119?hl=en
> 
> 
> 
> 
>  
>  
>  
> On Mar 25, 2014, at 10:45 PM, Jeffrey A Calcaterra <jacalcat at us.ibm.com> wrote:
> 
> 
> 
> 
> All, 
> 
> I tried to pare down the survey in the way along the lines that Jackie had suggested. Here are the results:https://docs.google.com/document/d/1iVhjIQ1Rhd-i6HuAB9hvuERQF_x78giOiJsSRhbuCWk/edit
> 
> Changes: 
> 1. I pared the questions down to about 1 1/2 pages and added a small introduction. 
> 
> 2. I tried to combine questions as much as possible and ask them more indirectly. For example, I asked "" for both of these: 
>  -Cloud End Users  - How do you know how your applications/services are doing? How do you know if there is a problem? 
> -Cloud Operators - Where and how do you learn about new releases and feature improvements to OpenStack (or cloud tech overall) 
> Hopefully, the role of the user will make the right areas to probe obvious. 
> 
> 3. Newly added questions are blue. They are mostly trying to get at some of the more direct questions in a more open-ended way. 
> 
> It seems much more manageable. 
> 
> Also, I agree with Jackie's goals and added "Common scenarios for OpenStack", which I would also include things like self-service vs. admin provisioned and permissions for end users. 
> 
> Finally, I'm not sure if everyone was planning to record. We said that it is optional in our emails to participants and we will ask when participants join. I added that to the intro. 
> 
> Jeff 
> 
> Jeff Calcaterra
> IBM SmartCloud Entry User Experience Design and Research
> STG UI Patent Board Chair
> email: jacalcat at us.ibm.com
> Portfolio:http://pokgsa.ibm.com/gsa/pokgsa/home/j/a/jacalcat/public/ 
> 
> 
> 
> From:        Jacki Bauer <jacki.bauer at rackspace.com> 
> To:        Jeffrey A Calcaterra/Raleigh/IBM at IBMUS, 
> Cc:        Liz Blanchard <lsurette at redhat.com>, "Gallagher, Phyllis" <phyllis.gallagher at hp.com>, "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com>, Ju Lim <julim at redhat.com>, "Meingast, Melissa" <Melissa.Meingast at hp.com>, "openstack-personas at lists.openstack.org" <openstack-personas at lists.openstack.org>, Thuy T Duong/Austin/IBM at IBMUS, Michelle Peterson <michelle.peterson at rackspace.com> 
> Date:        03/25/2014 09:26 AM 
> Subject:        Re: [Openstack-personas] link to persona interview questions
> 
> 
> 
> Jeff, 
> Thanks for doing this! I agree with starting with the environment to provide context. And the flow is much better. But I think there are still too many questions for an interviewer to get through. 
> 
> My recommendation would be to have 4-6 very high level questions. For each of those questions, we have a cheat sheet in front of us with a variety of probing questions that will get us to what we want to learn. A lot of times the interviewee will answer those questions on their own, but if they are going in a direction that isn’t helpful, we can use the cheat sheet to keep them on topic. That way we leave opportunity for discovering things we didn’t think to ask and avoid accidentally leading the interviewee to the answers we are looking for. 
> 
> The first section of this article describes this method -  http://lorrainepaterson.wordpress.com/2010/07/30/user-research-and-persona-creation-part-1-data-gathering-methods/ 
> 
> Also, I still don’t have a good understanding of the goals of this study and what we want the resulting personas to do for us - I think this is making things more difficult for the group, as there is no priority on which topics to cover. I made a pretty lame attempt to write up a goal in the Google doc that Jeff shared. 
> 
> If people agree with this approach, I have some time today to work on it, or anyone else can jump in. 
> 
> -Jacki 
> 
> PS - Sorry everyone for opening the can of worms at the last minute. I meant to look at this last Wednesday and completely forgot. 
> 
> 
> 
> 
> On Mar 25, 2014, at 7:19 AM, Jeffrey A Calcaterra <jacalcat at us.ibm.com> wrote: 
> 
> All, 
> 
> Here is yet another version... 
> 
> I had started with my own arrangement of questions yesterday that I was going to send out and blended together what Jacki had done as well. I got the questions down by about a half a page. 
> 
> A few notes: 
> 1. I started the interview with the environment, which I think is very helpful because that provides much of the context for the subsequent discussion. 
> 2. I tried to combine and remove redundant questions when possible and I put those at the end with comments. Questions that I added are in blue. 
> 3. I added all the Role-specific questions in green. 
> 
> To me, this seems to flow better as I imagine interviewing a participant. Any feedback? 
> 
> Jeff 
> 
> Jeff Calcaterra
> IBM SmartCloud Entry User Experience Design and Research
> STG UI Patent Board Chair
> email: jacalcat at us.ibm.com 
> 
> 
> 
> 
> From:        Jacki Bauer <jacki.bauer at RACKSPACE.COM> 
> To:        "Kruithof, Piet" <pieter.c.kruithof-jr at hp.com>, 
> Cc:        "Gallagher, Phyllis" <phyllis.gallagher at hp.com>, "openstack-personas at lists.openstack.org" <openstack-personas at lists.openstack.org>, Liz Blanchard <lsurette at redhat.com> 
> Date:        03/24/2014 01:02 PM 
> Subject:        Re: [Openstack-personas] link to persona interview questions
> 
> 
> 
> In an attempt to consolidate questions, I went ahead and sorted all of the questions by theme. Almost all the questions are variations on the following:
> What do you do?
> How often do you do it?
> Who do you work with?
> How do you do it?
> What do you do it on / Where do you do it?
> What are your priorities?
> What are your problems?
> Here’s the document with the sorted questions -https://docs.google.com/document/d/1E4eujvFhtvBBAuADT9OymXNCkczDV_BpUlje-4Dm2-U/edit?usp=sharing 
> 
> Obviously we won’t ask people these vague questions, but do the categories represent what we want to learn? Can we eliminate any? Maybe we can come up with one or two main questions per category and leave the others as sub-questions/conversation helpers. 
> 
> Feel free to leave comments or vote on priorities in the Google doc. 
> 
> -J 
> 
> 
> 
> 
> 
> 
> On Mar 23, 2014, at 12:27 AM, Kruithof, Piet <pieter.c.kruithof-jr at hp.com> wrote: 
> 
> Here is a link to the interview questions for the OpenStack Personas. 
>  
> https://docs.google.com/forms/d/1bQFygy9RGCam_Nw9xyrXPSY0TxwIcGALTsuSeir-M5s/edit?usp=sharing 
>  
> One word of warning – there are a lot of questions!  It feels like we may need to reduce it a bit or consolidate some of the questions. 
>  
> Piet 
>  
> Pieter Kruithof, MS, CPE
> UX Design and Research Lead
> Cloud OS 
> 
> pieter.c.kruithof-jr at hp.com
> T +1 970 8981918
> M +1 512 5762844 
>  
> "If you think good design is expensive, you should look at the cost of bad design.” 
> Dr. Ralf Speth, CEO Jaguar 
> 
> Hewlett-Packard Company
> 3404 E Harmony Rd.
> FTC06
> Fort Collins, CO 80528-9544
> USA
> 
> 
>  
> _______________________________________________
> openstack-personas mailing list
> openstack-personas at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-personas 
> _______________________________________________
> openstack-personas mailing list
> openstack-personas at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-personas
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-personas/attachments/20140326/38e2dad2/attachment-0001.html>