Open Stack

As a consumer of ‘osops’, I’d really appreciate this.

As a contributor to ‘osops’, I’d like to understand the community expectations for that contribution.

From an OpenStack perspective, I personally do not feel a ‘project’ is the right vehicle for this currently. Let’s build the community and show the convergence opportunity.

Tim

From: Erik McCormick [mailto:emccormick at cirrusseven.com]
Sent: 10 November 2014 21:16
To: Tim Bell
Cc: matt; openstack-operators
Subject: Re: [Openstack-operators] Proposal for an 'Operations' project

On Mon, Nov 10, 2014 at 2:52 PM, Tim Bell <Tim.Bell at cern.ch<mailto:Tim.Bell at cern.ch>> wrote:
So, how about maintaining a set of pointers to the github repos where we are all working ?

I think this is more unsustainable than the osops repo itself. Rather than having the relevant things in one place, there's now a set of pointers to github repos that may have relevant nuggets of goodness in it surrounded by 10 times more irrelevant things. I think the point here was to create a coherent set of tools and configs that can be easily consumed and that you can count on to be reasonably current. We're trying to make things easier to find, not more difficult.

We publish and maintain http://github.com/cernops in the open. This is for anything that is CERN specific or has a sustainability level such that we would not automatically recommend it to others. If it is of interest to everyone, we submit it back to the community.

You guys do fantastic work and it's wonderful that you do all of your work in the open. However, this one project of goodness is surrounded by forked puppet modules and things that are really only relevant to your specific environment or haven't been updated in 9+ months. It is difficult to figure out which things might be relevant to my use case. Your repo represents 50+ items to look through, and what you're talking about is having a list of 10, 100, 1000 such things to look through. It seems to me to lack the focus we're seeking.

As an example, https://github.com/cernops/openstack-image-tools shows the patches we’re doing for building images. Anyone can use this to build their tools but we are not proposing these as the ‘only’ solution as a project would imply.

I don't think anyone is proposing to have one thing be the defacto standard that everyone must follow. Imagine yours being a part of a well-described library of potential templates. You might be the maintainer of this one template that fits a particular use case. Now imagine that I could simply go into github.com/osops/disk-image-builder-templates<http://github.com/osops/disk-image-builder-templates> and there would be your stuff beside a number of other nice samples with good documentation that people could choose to consume or modify for their own purposes without having to have dug through 1000 other projects to find.


For me, there is a need for code publication without commitment to support. Asking operators to commit to support outside of their ‘day-jobs’ where the return on investment (i.e. high quality contributions and enhancements back) has not been proven is a lot to ask.

I think the number of folks that showed up to an impromptu session at 9am on a Friday morning after the Ops summit was already over expressing a willingness to contribute pretty much said that we have enough willingness among operators to contribute. I honestly don't think it would take that much time from our day jobs so long as the parts are broken down into manageable chunks and are assigned to people who already are writing these configs to begin with. The initial setup will be somewhat time-consuming, but the ongoing maintenance will be less so.

Tim

From: matt [mailto:matt at nycresistor.com<mailto:matt at nycresistor.com>]
Sent: 10 November 2014 19:25
To: Tim Bell
Cc: Craig Tracey; Michael Chapman; openstack-operators

Subject: Re: [Openstack-operators] Proposal for an 'Operations' project

My fear with the github is that people will just donate code in a fire and forget fashion... this will generate a poorly maintained repo in which finding useful actively maintained contributions may become difficult.
So my concerns lie in ensuring that anyone who contributes to this effort is committing to supporting their code for some length of time, and that there are maintainers committing to cleaning out the repos and being good code janitors.

On Mon, Nov 10, 2014 at 1:03 PM, Tim Bell <Tim.Bell at cern.ch<mailto:Tim.Bell at cern.ch>> wrote:

My impression of the operations teams is that there is not yet consensus on the toolchains. This would make it difficult to establish a single project since the selection has many criteria outside of OpenStack (e.g. in-house skills, current deployments).

I think the github repo (https://github.com/osops) is a great move to allow easy access to how others are doing it but it would be unrealistic to expect everyone to adopt a single toolchain given the investment in other areas.

Unless everyone adopts Puppet, ElasticSearch, Hadoop and Flume like CERN ☺

The deployment program is very different and it is not clear to me that TripleO is the universal solution either but that is another question…

Tim

From: Craig Tracey [mailto:craig at craigtracey.com<mailto:craig at craigtracey.com>]
Sent: 10 November 2014 18:41
To: Michael Chapman
Cc: openstack-operators
Subject: Re: [Openstack-operators] Proposal for an 'Operations' project


Agree with Mike 1000%.

This is something we should have done ages ago, and being agnostic is the correct way to get traction on this stuff. We'll be happy to help.

Thanks for championing this!
On Nov 10, 2014 11:37 AM, "Michael Chapman" <woppin at gmail.com<mailto:woppin at gmail.com>> wrote:
Here's the etherpad from Friday: https://etherpad.openstack.org/p/kilo-summit-ops-opsprogram

Jonothan: Your example of including log filters in oslo is extremely confusing. I am talking about something like this: https://github.com/OpenStratus/openstack-logstash/blob/master/agent.conf

Which really doesn't belong in oslo. There's similar configuration for equivalents such as splunk or fluentd, all doing roughly the same thing depending on the operator's tool of choice.

Same idea for nagios/sensu/zabbix/$other_tool

Jeremy: OpenStack is so large that setting up packaging, monitoring and log aggregation for it isn't something that can be done easily, yet without configuring any monitoring or log aggregation it is extremely difficult to diagnose and fix issues in a running cloud, and without a packaging pipeline fixes can't be deployed easily.

As to whether to include these things in the deployment program, I would say that I think the Deployment program is covering a 'delivery mechanism', whereas the things I am talking about are 'things to be delivered'. Clint and I had a quick chat on Friday during the TripleO session and I think we are thinking along very similar lines.

I want to have a bunch of repos with things that deployment tools (including Fuel and TripleO and anything else that gets cooked up) can easily consume to improve the operator experience.
I want a standard packaging system so that sites doing CI/CD today can all build packages from their own repos and collaborate on the specs/process in an upstream location, and I want it to be easily clone-able locally.
I want it all under a single program so that in the future we can potentially reward and acknowledge people doing the work as contributors to OpenStack.


_______________________________________________
OpenStack-operators mailing list
OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

_______________________________________________
OpenStack-operators mailing list
OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


_______________________________________________
OpenStack-operators mailing list
OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

-Erik
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20141110/38e2ece8/attachment.html>