<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>
<div>
<div>Hi Roland,</div>
<div><br>
</div>
<div>Are interested in correlating the NPS scores with the open-ended questions? </div>
<div><br>
</div>
<div>Piet</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(68, 114, 196);"><font face="Arial" size="2">Piet Kruithof<o:p></o:p></font></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(59, 56, 56);"><font face="Arial" size="2"> </font></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(59, 56, 56);"><font face="Arial" size="2">Sr User Experience Architect, <o:p></o:p></font></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(59, 56, 56);"><font face="Arial" size="2">Intel Open Source Technology Group<o:p></o:p></font></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(59, 56, 56);"><font face="Arial" size="2"> </font></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(59, 56, 56);"><font face="Arial" size="2">Project Technical Lead (PTL)</font></span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt;"><span style="color: rgb(59, 56, 56);"><font face="Arial" size="2">OpenStack UX project</font></span></p>
</div>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Heidi Joy Tretheway <<a href="mailto:heidijoy@openstack.org">heidijoy@openstack.org</a>><br>
<span style="font-weight:bold">Date: </span>Monday, May 16, 2016 at 12:56 PM<br>
<span style="font-weight:bold">To: </span>Roland Chan <<a href="mailto:roland@aptira.com">roland@aptira.com</a>><br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:user-committee@lists.openstack.org">user-committee@lists.openstack.org</a>" <<a href="mailto:user-committee@lists.openstack.org">user-committee@lists.openstack.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [User-committee] Analysis of User Survey<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi Roland,
<div class=""><br class="">
</div>
<div class="">I’d like to better understand which specific questions you’d like to correlate with NPS answers. Once we have the scope of the project nailed down, we will understand the cost associated and whether to spend the time/money on that effort. Another
key question is whether we are looking at raw NPS scores, or a change in NPS scores over time relative to a specific question. </div>
<div class=""><br class="">
</div>
<div class="">An example of what we’d need to proceed:</div>
<div class="">
<ul class="">
<li class="">App developer section (section 3)</li><li class="">Question: With which other clouds do app users interact? (Figure 3.2)</li><li class="">NPS scores from 2016-01 ONLY</li><li class="">Show an NPS score from the population that answered each response.</li></ul>
</div>
<div class="">Keep in mind that only sections one and two of the survey provide adequate volume of responses (1000+) to be able to break down answers to an NPS score and have statistical significance. The question above, for example, would only show ~100-200
NPS responses per answer, which is less than 8-15% of the total who answered the NPS question.</div>
<div class=""><br class="">
</div>
<div class="">I recommend forming a team with others who want to dig more deeply into NPS and deciding which questions are most important to further analyze. Additionally, I’d like your team to discuss how to act on the data, as a key discipline of NPS is having
a plan in place to address the findings. For example, if the questions reveal a challenge of complexity, would the recommendation be to create further documentation or content that addresses this user concern? </div>
<div class=""><br class="">
</div>
<div class="">The comment analysis committee has already identified key themes from the NPS comment data that each could generate some great action items. Rather than focusing on the quantitative side of deeper NPS metrics, may I suggest looking at the qualitative
input from the questions on NPS score reason and what areas of OpenStack have further room for improvement?</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
<div class="">
<div>
<blockquote type="cite" class="">
<div class="">On May 12, 2016, at 7:58 PM, Roland Chan <<a href="mailto:roland@aptira.com" class="">roland@aptira.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div dir="ltr" class="">
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">
I was looking for the NPS analysis we did: attempting to correlate the NPS scores (particularly detractors) to other responses.</div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">
<br class="">
</div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">
Roland</div>
<div class="gmail_extra"><br class="">
<div class="gmail_quote">On 13 May 2016 at 12:48, Lauren Sell <span dir="ltr" class="">
<<a href="mailto:lauren@openstack.org" target="_blank" class="">lauren@openstack.org</a>></span> wrote:<br class="">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word" class="">Good question. We recruited a user survey working group this cycle to help with comment analysis, and Piet was one of the volunteers.
<div class="">
<div class=""><br class="">
</div>
<div class="">The comments they reviewed were not associated with any user, but we still asked them to sign the User Committee confidentiality agreement.
<div class="">
<div class="h5">
<div class=""><br class="">
</div>
<div class=""><br class="">
<div class="">
<blockquote type="cite" class="">
<div class="">On May 12, 2016, at 8:25 PM, Roland Chan <<a href="mailto:roland@aptira.com" target="_blank" class="">roland@aptira.com</a>> wrote:</div>
<br class="">
<div class="">
<div dir="ltr" class="">
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class="">Thanks Piet. I think we need to get the Foundation to coordinate the activity because of the privacy concerns around looking at the raw survey data.</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class=""><br class="">
</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class="">Lauren, is that correct?</div>
<div class="gmail_extra"><br clear="all" class="">
<div class="">
<div class="">
<div dir="ltr" class="">
<div class="">
<div dir="ltr" class="">
<div class="">
<div dir="ltr" class="">
<div dir="ltr" class="">
<div dir="ltr" class="">
<div dir="ltr" class="">
<div style="font-family:arial,helvetica,sans-serif;font-size:small;display:inline" class="">
Roland</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br class="">
<div class="gmail_quote">On 12 May 2016 at 12:21, Kruithof Jr, Pieter <span dir="ltr" class="">
<<a href="mailto:pieter.kruithof.jr@intel.com" target="_blank" class="">pieter.kruithof.jr@intel.com</a>></span> wrote:<br class="">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word" class="">
<div class="">
<div style="font-family:Calibri,sans-serif" class=""><span style="font-size:12px" class="">Hi Roland,</span></div>
<div style="font-family:Calibri,sans-serif" class=""><span style="font-size:12px" class=""><br class="">
</span></div>
<div class=""><font face="Calibri,sans-serif" class=""><span style="font-size:12px" class="">I was one of the folks that helped with the analysis of the qualitative data this last survey. I don’t mind helping again if you’re looking for volunteers. </span></font></div>
<div style="font-family:Calibri,sans-serif" class=""><span style="font-size:12px" class=""><br class="">
</span></div>
<div style="font-family:Calibri,sans-serif" class=""><span style="font-size:12px" class="">Piet</span></div>
<div style="font-family:Calibri,sans-serif;font-size:14px" class=""><br class="">
</div>
<div style="font-family:Calibri,sans-serif;font-size:14px" class="">
<div style="margin:0in 0in 0.0001pt" class=""><span style="color:rgb(68,114,196)" class=""><font face="Arial" size="2" class="">Piet Kruithof<u class=""></u><u class=""></u></font></span></div>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt"><span style="color:rgb(59,56,56)" class=""><font face="Arial" size="2" class=""> </font></span></p>
<div style="margin:0in 0in 0.0001pt" class=""><span style="color:rgb(59,56,56)" class=""><font face="Arial" size="2" class="">Sr User Experience Architect, <u class=""></u><u class=""></u></font></span></div>
<div style="margin:0in 0in 0.0001pt" class=""><span style="color:rgb(59,56,56)" class=""><font face="Arial" size="2" class="">Intel Open Source Technology Group<u class=""></u><u class=""></u></font></span></div>
<p class="MsoNormal" style="margin:0in 0in 0.0001pt"><span style="color:rgb(59,56,56)" class=""><font face="Arial" size="2" class=""> </font></span></p>
<div style="margin:0in 0in 0.0001pt" class=""><span style="color:rgb(59,56,56)" class=""><font face="Arial" size="2" class="">Project Technical Lead (PTL)</font></span></div>
<div style="margin:0in 0in 0.0001pt" class=""><span style="color:rgb(59,56,56)" class=""><font face="Arial" size="2" class="">OpenStack UX project</font></span></div>
</div>
</div>
<div style="font-family:Calibri,sans-serif;font-size:14px" class=""><br class="">
</div>
<span style="font-family:Calibri,sans-serif;font-size:14px" class="">
<div style="font-family:Calibri;font-size:11pt;text-align:left;border-width:1pt medium medium;border-style:solid none none;padding:3pt 0in 0in;border-top-color:rgb(181,196,223)" class="">
<span style="font-weight:bold" class="">From: </span>Roland Chan <<a href="mailto:roland@aptira.com" target="_blank" class="">roland@aptira.com</a>><br class="">
<span style="font-weight:bold" class="">Date: </span>Wednesday, May 11, 2016 at 7:49 PM<br class="">
<span style="font-weight:bold" class="">To: </span>"<a href="mailto:user-committee@lists.openstack.org" target="_blank" class="">user-committee@lists.openstack.org</a>" <<a href="mailto:user-committee@lists.openstack.org" target="_blank" class="">user-committee@lists.openstack.org</a>><br class="">
<span style="font-weight:bold" class="">Subject: </span>[User-committee] Analysis of User Survey<br class="">
</div>
<div class="">
<div class="">
<div class=""><br class="">
</div>
<div class="">
<div class="">
<div dir="ltr" class="">
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class="">Hi All,</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class=""><br class="">
</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class="">We did a little bit of deeper analysis of the last user survey, particularly with respect to NPS scores. I'd certainly be interested in continuing that effort to see if there are trends
in the data now that we have another data point.</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class=""><br class="">
</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class="">Anyone else think so?<br class="">
</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class=""><br class="">
</div>
<div style="font-family:arial,helvetica,sans-serif;font-size:small" class="">Roland</div>
<div class="">
<div class="">
<div dir="ltr" class="">
<div class="">
<div dir="ltr" class="">
<div class="">
<div dir="ltr" class="">
<div dir="ltr" class="">
<div dir="ltr" class=""></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</span></div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
_______________________________________________<br class="">
User-committee mailing list<br class="">
<a href="mailto:User-committee@lists.openstack.org" class="">User-committee@lists.openstack.org</a><br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/user-committee">http://lists.openstack.org/cgi-bin/mailman/listinfo/user-committee</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
</span>
</body>
</html>