[openstack-dev] [all][tc] How to deal with confusion around "hosted projects"

Jimmy McArthur jimmy at openstack.org
Thu Jun 29 15:00:33 UTC 2017



> Thierry Carrez <mailto:thierry at openstack.org>
> June 29, 2017 at 9:54 AM
>
> Unfortunately, those pages just exist -- those hundreds of projects
> projects might be inactive, they still have git repositories and wiki
> pages. We could more actively clean them up (and then yes, adjusting the
> corresponding Google juice), but (1) we don't really have any right to
> do so unless we get permission (which is hard to get from dead
> projects), and (2) that's a giganormous amount of maintenance work.
It might be a giganormous amount of maintenance work, but it's the only 
way you're going to properly fix the Google problem. You can still keep 
the data archived, but I would change the link to something like 
/inactive-projects/meteos, again with the proper redirects. And again, 
updating the sitemap.

As far as github, if the project is legitimately dead, the repo should 
be set to private.

Just because something is a lot of work doesn't mean it's not worth doing :)
>
> Jimmy McArthur <mailto:jimmy at openstack.org>
> June 29, 2017 at 8:49 AM
>
>
>
> If there is specifically confusion around Google searches, I'd suggest 
> as a first step to spend some time working on redirects for dead 
> projects and very clearly updating documentation. For all of Google's 
> magic, there are some simple and easy rules to help correct bad search 
> data.
>
> Additionally, we just implemented SwifType on OpenStack.org and 
> docs.o.o b/c Google deprecated their Site Search product. We have a 
> ton of control over that search and can very easily modify search 
> results.
>
> Let me know if I can be of service on any of these fronts.
>
>
> __________________________________________________________________________ 
>
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: 
> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> Thierry Carrez <mailto:thierry at openstack.org>
> June 29, 2017 at 3:00 AM
> Monty Taylor wrote:
>> On 06/28/2017 09:50 AM, Thierry Carrez wrote:
>>> [...] Removing the root cause would be a more radical move: stop offering
>>> hosting to non-OpenStack projects on OpenStack infrastructure
>>> altogether. We originally did that for a reason, though. The benefits of
>>> offering that service are:
>> I disagree that this is removing the root cause.
>>
>> I believe this is reacting to a misunderstanding by hiding from it. I do
>> not believe that doing this provides any value to us as a community.
>>
>> Even though we do not actually use github for development, we have
>> implicitly accepted the false premise that github is a requirement. It
>> is suggested that the existence of git repos in the openstack/ github
>> org is confusing to people. And our reaction to that is to cut off
>> access to our Open Source tools that we set up to collaboratively
>> develop cloud software and tell people to go use the thing that people
>> suggest is one of the causes of people being confused?
>
> I don't think I agree. GitHub is just one area where confusion spreads.
> Going back to my example, searching for "openstack machine learning" on
> Google will give you links to GitHub, but also the OpenStack wiki, and
> our cgit farm. All of them corroborate that the two projects returned
> are, by all means, official (while they aren't).
>
> So the suggestion (to cut off access to openstack project infrastructure
> for things that are not openstack and will never be) is not in reaction
> to GitHub, it's in reaction to the confusion that having them on the
> very same project infrastructure creates (on all of our online
> presence), *and* how hard it is to address that confusion at the edge.
>
>> * People are not 'confused' by what OpenStack is.
>>
>> Being "confused" is a passive-aggressive way of expressing that they
>> DISAGREE with what OpenStack is. We still have _plenty_ of people who
>> express that they think we should only be IaaS - so they're still going
>> to be unhappy with cloudkitty, congress and karbor.
>>
>> Such people are under the misguided impression that kicking cloudkitty
>> out of OpenStack will somehow cause Nova features to land quicker. I
>> can't even begin to express all of the ways in which it's wrong. We
>> aren't a top-down corporate structure and we can't 'reassign' humans -
>> but even if we WERE - this flawed thinking runs afoul of the Mythical
>> Man Month.
>
> Sure, but you are missing my point. I totally agree that a lot of people
> involved in OpenStack pretend to be confused, despite us being very
> clear as to what's officially in OpenStack and what's not, and that's
> their own way of complaining about how things turned out.
>
> The confusion I'm talking about is not the passive-aggressive from
> people involved in openstack. It's from our prospective new users, who
> have no idea about our governance, making random searches on Google.
> It's from people getting hit by marketing message from projects claiming
> to be official OpenStack projects, while they are not. It's extremely
> difficult for those to see clearly, especially with all our online
> presence reinforcing the confusion.
>
>> * Kicking non-official things out will not help
>>
>> If I'm wrong about the above and it really is all just about not being
>> able to navigate a set of repositories that are prefixed with the string
>> 'openstack/', it STILL WON'T HELP.
>>
>> There are 1049 official repos. There are only 1676 repos in gerrit.
>>
>> Do we honestly think that people who are confused are going to be less
>> confused by the number of repos in the sacred 'openstack/' namespace
>> going from 1676 to 1049? Do we next tell projects they can only have
>> their primary service managed? Kick out chef, puppet, juju and ansible,
>> as well as the deb- repos? Because maybe the existence of
>> openstack/deb-python-oslo.privsep is confusing someone?
>
> Again, I agree, but I think you're missing my point. Kicking
> non-official things is not about cutting the number of repositories, or
> somehow making the git.openstack.org/cgit front page more navigable. We
> are indeed past that.
>
> Kicking non-official things is about stopping blurring the line between
> what's "in" openstack and what's "out". It's about someone googling for
> machine learning on openstack, finding Cognitive on git.openstack.org
> and wiki.openstack.org, assuming it's an official openstack project
> based on those domain names, trying to check it out, realizing it's only
> 4 commits and dead for two years, and assuming OpenStack has pretty low
> standards and is a bunch of dead crap. How do you propose we address
> *that* ?
>
>> [...]
>>> Thoughts on that ? Would you rather address the confusion at the edges,
>>> or remove the root cause ?
>> The only reasonable action is actually addressing the confusion.
>>
>> the confusion isn't just at the edges - the confusion is actually THE
>> ONLY PROBLEM. There is no other problem that needs to be solved _other_
>> than confusion in this area. The number of projects in gerrit is not a
>> technical problem. It's not overwhelming our governance. It's not a
>> problem for anyone who isn't confused (or saying they're confused when
>> they just disagree)
>>
>> If we create problems for any our developers because there are people
>> who are confused rather than addressing the confusion, we will have
>> abdicated our responsibilities wholesale.
>
> That would be the first option. We continue to communicate about how
> things really are, and find technical ways to drop markers on unofficial
> projects so that people don't assume too much from the project hosting.
> It's just a lot of maintenance work, and it's not been very successful
> so far. With less and less resources on the infra team to implement
> technical workarounds, I'm just not convinced that's a sustainable solution.
>
> Monty Taylor <mailto:mordred at inaugust.com>
> June 28, 2017 at 4:50 PM
> On 06/28/2017 09:50 AM, Thierry Carrez wrote:
>> Hi everyone,
>>
>> Two weeks ago, as a result of a discussion at the Board+TC+UC workgroup
>> working on "better communicating what is openstack", I started a
>> thread[1] about moving away from big tent terminology. The thread went
>> in a lot of directions, including discussing GitHub mirroring strategy,
>> what makes projects want to be official, the need for returning to a
>> past when everything was (supposedly) simpler, and naming fun.
>>
>> [1] 
>> http://lists.openstack.org/pipermail/openstack-dev/2017-June/118368.html
>>
>> Many agreed that the "Big Tent" name (as a synonym to "official
>> openstack projects") is hurting more than it helps, and we should stop
>> using it. The issue is, merely stopping using it won't be enough. We
>> have tried, and the name sticks. You need to replace the name by
>> something that sticks more, or address the root cause directly.
>>
>> The central issue being discussed here is an issue of external
>> perception. It's hard for newcomers to the OpenStack world to see what
>> is a part of OpenStack and what's not. If you google "openstack machine
>> learning", the first hits are Cognitive and Meteos, and it's impossible
>> to tell that those are actually not OpenStack projects. One of those has
>> been dead for 2 years -- having people think that those are official
>> projects hurts all the OpenStack projects, by lowering expectations
>> around what that means, in terms of quality, maintenance, or community.
>>
>> The confusion mainly stems from the fact that OpenStack project
>> infrastructure is open to any open source project (and it's nobody's job
>> to clean up dead things). So you can find (on our wiki, on our
>> mailing-list, on our cgit farm, on our gerrit, on our GitHub
>> organization...) things that are actually not OpenStack, even with the
>> expansive "are you one of us" definition. Arguably the most confusing
>> aspect is the "openstack/" prefix in the git repository name, which
>> indicates some kind of brand association.
>>
>> I'd say we have two options. We can address the perception issue on the
>> edges, or you can treat the root cause. Neither of those options is
>> really an OpenStack  governance change (or "big tent" change) -- they
>> are more about what to do with things that are actually *not* in our
>> governance.
>>
>> Addressing the perception on the edges means making it clearer when
>> things are not official. The thread above discussed a lot of potential
>> solutions. We could give unofficial things a catchy group name
>> (Stackforge, Opium, Electrons...), and hope it sticks. We could find a
>> way to tag all projects on GitHub that are not official, or mirror them
>> to another organization, or stop mirroring them altogether. We could
>> remove the openstack/ prefix from all the projects we host. We could
>> actively mark all wiki pages that are not about an official project. We
>> could set up a separate Gerrit or separate ML for hosted projects
>> development discussions. The main issue with that approach is that it's
>> a *lot* of work, and it never completely eliminates the confusion.
>>
>> Removing the root cause would be a more radical move: stop offering
>> hosting to non-OpenStack projects on OpenStack infrastructure
>> altogether. We originally did that for a reason, though. The benefits of
>> offering that service are:
>
> I disagree that this is removing the root cause.
>
> I believe this is reacting to a misunderstanding by hiding from it. I 
> do not believe that doing this provides any value to us as a community.
>
> Even though we do not actually use github for development, we have 
> implicitly accepted the false premise that github is a requirement. It 
> is suggested that the existence of git repos in the openstack/ github 
> org is confusing to people. And our reaction to that is to cut off 
> access to our Open Source tools that we set up to collaboratively 
> develop cloud software and tell people to go use the thing that people 
> suggest is one of the causes of people being confused?
>
> * People are not 'confused' by what OpenStack is.
>
> Being "confused" is a passive-aggressive way of expressing that they 
> DISAGREE with what OpenStack is. We still have _plenty_ of people who 
> express that they think we should only be IaaS - so they're still 
> going to be unhappy with cloudkitty, congress and karbor.
>
> Such people are under the misguided impression that kicking cloudkitty 
> out of OpenStack will somehow cause Nova features to land quicker. I 
> can't even begin to express all of the ways in which it's wrong. We 
> aren't a top-down corporate structure and we can't 'reassign' humans - 
> but even if we WERE - this flawed thinking runs afoul of the Mythical 
> Man Month.
>
> * Kicking non-official things out will not help
>
> If I'm wrong about the above and it really is all just about not being 
> able to navigate a set of repositories that are prefixed with the 
> string 'openstack/', it STILL WON'T HELP.
>
> There are 1049 official repos. There are only 1676 repos in gerrit.
>
> Do we honestly think that people who are confused are going to be less 
> confused by the number of repos in the sacred 'openstack/' namespace 
> going from 1676 to 1049? Do we next tell projects they can only have 
> their primary service managed? Kick out chef, puppet, juju and 
> ansible, as well as the deb- repos? Because maybe the existence of
> openstack/deb-python-oslo.privsep is confusing someone?
>
> Guess what? We're big. Software is hard. Life doesn't fit into neat 
> packages people want it to fit in to.
>
>
>> 1- it lets us set up code repositories and testing infrastructure before
>> a project applies to be an official OpenStack project.
>>
>> 2- it lets us host things that are not openstack but which we work on
>> (like abandoned Python libraries or GPL-licensed things) in a familiar
>> environment
>>
>> 3- it spreads "the openstack way" (Gerrit, Zuul) beyond openstack itself
>>
>> I would argue that we could handle (1) and (2) within our current
>> governance.
>>
>> For (1) we could have an "onboarding" project team that would help
>> incoming projects through the initial steps of becoming an openstack
>> project. The team would act as an umbrella team, an experimental area
>> for projects that have some potential to become an OpenStack project one
>> day. There would be a time limit -- if after one year(?) it looks like
>> you won't become an openstack project after all, the onboarding team
>> would clean you up. I actually think a bit more project mentoring would
>> serve us better than our current hands-free approach.
>>
>> For (2) we could also have some other official project team as an
>> umbrella for those deps we depend on and have to continue maintaining.
>> Or we could expand Oslo's team scope to cover it. It's just a couple of
>> repositories anyway.
>>
>> That leaves (3). I would argue that was a nice thing to have, but its
>> impact was very limited (not so many successful/alive projects in that
>> category). I guess if the need is still there and people really want to
>> work on this, it could be (and actually has been) set up as a parallel
>> infrastructure. The confusion that stems from running it on top of the
>> very same infrastructure is just too costly for us at this point.
>>
>> This radical solution still means work, but it's one-time governance
>> work, rather than infra changes / continuous curation work. It *is*
>> radical though, especially for the affected git repositories (for which
>> we often don't have any contact email). It will also make removing
>> projects a lot more difficult (as there will be consequences in terms of
>> project hosting).
>
> The work to do this provides absolutely no benefit.
>
>> Thoughts on that ? Would you rather address the confusion at the edges,
>> or remove the root cause ?
>
> The only reasonable action is actually addressing the confusion.
>
> the confusion isn't just at the edges - the confusion is actually THE 
> ONLY PROBLEM. There is no other problem that needs to be solved 
> _other_ than confusion in this area. The number of projects in gerrit 
> is not a technical problem. It's not overwhelming our governance. It's 
> not a problem for anyone who isn't confused (or saying they're 
> confused when they just disagree)
>
> If we create problems for any our developers because there are people 
> who are confused rather than addressing the confusion, we will have 
> abdicated our responsibilities wholesale.
>
> Monty
>
> __________________________________________________________________________ 
>
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: 
> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> Thierry Carrez <mailto:thierry at openstack.org>
> June 28, 2017 at 9:50 AM
> Hi everyone,
>
> Two weeks ago, as a result of a discussion at the Board+TC+UC workgroup
> working on "better communicating what is openstack", I started a
> thread[1] about moving away from big tent terminology. The thread went
> in a lot of directions, including discussing GitHub mirroring strategy,
> what makes projects want to be official, the need for returning to a
> past when everything was (supposedly) simpler, and naming fun.
>
> [1] 
> http://lists.openstack.org/pipermail/openstack-dev/2017-June/118368.html
>
> Many agreed that the "Big Tent" name (as a synonym to "official
> openstack projects") is hurting more than it helps, and we should stop
> using it. The issue is, merely stopping using it won't be enough. We
> have tried, and the name sticks. You need to replace the name by
> something that sticks more, or address the root cause directly.
>
> The central issue being discussed here is an issue of external
> perception. It's hard for newcomers to the OpenStack world to see what
> is a part of OpenStack and what's not. If you google "openstack machine
> learning", the first hits are Cognitive and Meteos, and it's impossible
> to tell that those are actually not OpenStack projects. One of those has
> been dead for 2 years -- having people think that those are official
> projects hurts all the OpenStack projects, by lowering expectations
> around what that means, in terms of quality, maintenance, or community.
>
> The confusion mainly stems from the fact that OpenStack project
> infrastructure is open to any open source project (and it's nobody's job
> to clean up dead things). So you can find (on our wiki, on our
> mailing-list, on our cgit farm, on our gerrit, on our GitHub
> organization...) things that are actually not OpenStack, even with the
> expansive "are you one of us" definition. Arguably the most confusing
> aspect is the "openstack/" prefix in the git repository name, which
> indicates some kind of brand association.
>
> I'd say we have two options. We can address the perception issue on the
> edges, or you can treat the root cause. Neither of those options is
> really an OpenStack governance change (or "big tent" change) -- they
> are more about what to do with things that are actually *not* in our
> governance.
>
> Addressing the perception on the edges means making it clearer when
> things are not official. The thread above discussed a lot of potential
> solutions. We could give unofficial things a catchy group name
> (Stackforge, Opium, Electrons...), and hope it sticks. We could find a
> way to tag all projects on GitHub that are not official, or mirror them
> to another organization, or stop mirroring them altogether. We could
> remove the openstack/ prefix from all the projects we host. We could
> actively mark all wiki pages that are not about an official project. We
> could set up a separate Gerrit or separate ML for hosted projects
> development discussions. The main issue with that approach is that it's
> a *lot* of work, and it never completely eliminates the confusion.
>
> Removing the root cause would be a more radical move: stop offering
> hosting to non-OpenStack projects on OpenStack infrastructure
> altogether. We originally did that for a reason, though. The benefits of
> offering that service are:
>
> 1- it lets us set up code repositories and testing infrastructure before
> a project applies to be an official OpenStack project.
>
> 2- it lets us host things that are not openstack but which we work on
> (like abandoned Python libraries or GPL-licensed things) in a familiar
> environment
>
> 3- it spreads "the openstack way" (Gerrit, Zuul) beyond openstack itself
>
> I would argue that we could handle (1) and (2) within our current
> governance.
>
> For (1) we could have an "onboarding" project team that would help
> incoming projects through the initial steps of becoming an openstack
> project. The team would act as an umbrella team, an experimental area
> for projects that have some potential to become an OpenStack project one
> day. There would be a time limit -- if after one year(?) it looks like
> you won't become an openstack project after all, the onboarding team
> would clean you up. I actually think a bit more project mentoring would
> serve us better than our current hands-free approach.
>
> For (2) we could also have some other official project team as an
> umbrella for those deps we depend on and have to continue maintaining.
> Or we could expand Oslo's team scope to cover it. It's just a couple of
> repositories anyway.
>
> That leaves (3). I would argue that was a nice thing to have, but its
> impact was very limited (not so many successful/alive projects in that
> category). I guess if the need is still there and people really want to
> work on this, it could be (and actually has been) set up as a parallel
> infrastructure. The confusion that stems from running it on top of the
> very same infrastructure is just too costly for us at this point.
>
> This radical solution still means work, but it's one-time governance
> work, rather than infra changes / continuous curation work. It *is*
> radical though, especially for the affected git repositories (for which
> we often don't have any contact email). It will also make removing
> projects a lot more difficult (as there will be consequences in terms of
> project hosting).
>
> Thoughts on that ? Would you rather address the confusion at the edges,
> or remove the root cause ?
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20170629/a2efd30a/attachment.html>


More information about the OpenStack-dev mailing list