<html>
  <head>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    I agree with Roland. The numbers do say something - the question is
    exactly what.<br>
    <br>
    On the surface it seems that the responders are not as happy as one
    might think with OpenStack.<br>
    <br>
    I am not saying that is true, not saying that this is accurate - but
    I think it is worthwhile understanding why these numbers changed.
    Was it the audience size, something else, but something the
    foundation and the community would like understand.<br>
    <br>
    My 0.02 Shekels.<br>
    <br>
    <div class="moz-cite-prefix">On 11/17/15 02:04, Roland Chan wrote:<br>
    </div>
    <blockquote
cite="mid:CAJVMvBz68GZAHW_bfLEUxd_UcYEb6u-JG4cT9t-8jW9ZO28BJQ@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div class="gmail_default"
          style="font-family:arial,helvetica,sans-serif;font-size:small"><span
            style="font-family:arial,sans-serif">On 17 November 2015 at
            11:24, Stefano Maffulli </span><span dir="ltr"
            style="font-family:arial,sans-serif"><<a
              moz-do-not-send="true" href="mailto:stefano@openstack.org"
              target="_blank"><a class="moz-txt-link-abbreviated" href="mailto:stefano@openstack.org">stefano@openstack.org</a></a>></span><span
            style="font-family:arial,sans-serif"> wrote:</span><br>
        </div>
        <div class="gmail_extra">
          <div class="gmail_quote">
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span>On
                11/16/2015 03:50 PM, Roland Chan wrote:<br>
                > I'm requesting further analysis of the user survey
                data in order to<br>
                > determine what factors maybe contributing to the
                deterioriation of the<br>
                > NPS results over the last two surveys.<br>
                <br>
              </span>This is one of the cases where I'm not particularly
              concerned in the<br>
              change that score but in its absolute value: the latest
              NPS in the<br>
              latest edition could probably be considered a new base
              point instead of<br>
              a down trend because the sample size of the survey has
              changed so<br>
              dramatically.<br>
            </blockquote>
            <div><br>
            </div>
            <div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​
                ​Yes it could. The detractor numbers from the last
                survey alone still warrant investigation in my opinion. </div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small"><br>
              </div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​
                I'm not considering the change as a trend yet, but
                clearly something happened, and ignoring it would be
                foolhardy. We could be looking at anything from a
                significant change in user sentiment to an innocuous
                mistake in the execution of the survey process. Or
                anything in between.</div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small"><br>
              </div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">Whatever
                it is, finding out sooner rather than later would be
                beneficial, particularly if we are planning to take
                action based on the results at some point.</div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small"><span
                  style="font-family:arial,sans-serif"> </span></div>
            </div>
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Also,
              I'm not sure how exactly valuable the NPS score is for the
              thing<br>
              that is called 'openstack' in the context of the survey:
              is that the<br>
              upstream code? the packages from vendors? the old releases
              unmaintained?<br>
              neutron? devstack? How valuable is really that number?<br>
            </blockquote>
            <div><br>
            </div>
            <div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​
                ​It's the user experience. The detail comes from further
                investigation. I imagine that the survey data contains
                some of this information, hence the request for
                analysis.</div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​</div>
            </div>
            <div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​
                Investigation from other angles, such as the Diversity
                working group, has suggested that tools, people and
                process are all sources of dissatisfaction.</div>
            </div>
            <div> </div>
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span><br>
                > I don't know what form the data for the last two
                user surveys is, but if<br>
                > it's in surveymonkey,<br>
                <br>
              </span>it's not in surveymonkey, it's in a custom-built
              tool managed by the<br>
              Foundation. Access to the data is restricted to very few
              individuals<br>
              because of its super-sensitive content.<br>
              <span><br>
              </span></blockquote>
            <div><br>
            </div>
            <div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​
                OK. Then we need to determine whether the people with
                access are able to perform the analysis or whether the
                data can be anonymised and/or aggregated sufficiently to
                allow analysis outside of that group. </div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small"><br>
              </div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">That
                will tell us if analysis is feasible.</div>
            </div>
            <div> </div>
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span>>
                we had some good results using their built in<br>
                > toolset (credit to Lauren for that) with the
                Diversity survey results.<br>
                <br>
              </span>Speaking of which, I heard rumors that the results
              were published at the<br>
              Board meeting in Tokyo but I haven't seen that
              presentation made public<br>
              yet. Did I miss the public announcement?<br>
            </blockquote>
            <div><br>
            </div>
            <div>
              <div class="gmail_default"><font face="arial, helvetica,
                  sans-serif">​There wasn't an announcement per se. The
                  presentation is in the board agenda:</font><br>
                <br>
                <font face="arial, helvetica, sans-serif"><a
                    moz-do-not-send="true"
href="https://wiki.openstack.org/wiki/Governance/Foundation/26Oct2015BoardMeeting"><a class="moz-txt-link-freetext" href="https://wiki.openstack.org/wiki/Governance/Foundation/26Oct2015BoardMeeting">https://wiki.openstack.org/wiki/Governance/Foundation/26Oct2015BoardMeeting</a></a></font><br>
              </div>
            </div>
            <div class="gmail_default"><font face="arial, helvetica,
                sans-serif"><br>
              </font></div>
            <div class="gmail_default"><font face="arial, helvetica,
                sans-serif">Minutes of the meeting don't seem to be out
                yet, but it wasn't confidential, so it will be public.</font></div>
            <div><br>
            </div>
            <div>
              <div class="gmail_default"
                style="font-family:arial,helvetica,sans-serif;font-size:small">​
                Roland​<br>
              </div>
            </div>
            <div><br>
            </div>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
User-committee mailing list
<a class="moz-txt-link-abbreviated" href="mailto:User-committee@lists.openstack.org">User-committee@lists.openstack.org</a>
<a class="moz-txt-link-freetext" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/user-committee">http://lists.openstack.org/cgi-bin/mailman/listinfo/user-committee</a>
</pre>
    </blockquote>
    <br>
    <div class="moz-signature">-- <br>
      Best Regards,<br>
      Maish Saidel-Keesing</div>
  </body>
</html>