[Openstack-operators] Proposal for an 'Operations' project

Erik McCormick emccormick at cirrusseven.com
Mon Nov 10 20:15:56 UTC 2014


On Mon, Nov 10, 2014 at 2:52 PM, Tim Bell <Tim.Bell at cern.ch> wrote:

>  So, how about maintaining a set of pointers to the github repos where we
> are all working ?
>
>
I think this is more unsustainable than the osops repo itself. Rather than
having the relevant things in one place, there's now a set of pointers to
github repos that may have relevant nuggets of goodness in it surrounded by
10 times more irrelevant things. I think the point here was to create a
coherent set of tools and configs that can be easily consumed and that you
can count on to be reasonably current. We're trying to make things easier
to find, not more difficult.

>
>
> We publish and maintain http://github.com/cernops in the open. This is
> for anything that is CERN specific or has a sustainability level such that
> we would not automatically recommend it to others. If it is of interest to
> everyone, we submit it back to the community.
>
>
>
You guys do fantastic work and it's wonderful that you do all of your work
in the open. However, this one project of goodness is surrounded by forked
puppet modules and things that are really only relevant to your specific
environment or haven't been updated in 9+ months. It is difficult to figure
out which things might be relevant to my use case. Your repo represents 50+
items to look through, and what you're talking about is having a list of
10, 100, 1000 such things to look through. It seems to me to lack the focus
we're seeking.


>  As an example, https://github.com/cernops/openstack-image-tools shows
> the patches we’re doing for building images. Anyone can use this to build
> their tools but we are not proposing these as the ‘only’ solution as a
> project would imply.
>
>
I don't think anyone is proposing to have one thing be the defacto standard
that everyone must follow. Imagine yours being a part of a well-described
library of potential templates. You might be the maintainer of this one
template that fits a particular use case. Now imagine that I could simply
go into github.com/osops/disk-image-builder-templates and there would be
your stuff beside a number of other nice samples with good documentation
that people could choose to consume or modify for their own purposes
without having to have dug through 1000 other projects to find.


>
>
> For me, there is a need for code publication without commitment to
> support. Asking operators to commit to support outside of their ‘day-jobs’
> where the return on investment (i.e. high quality contributions and
> enhancements back) has not been proven is a lot to ask.
>
>
I think the number of folks that showed up to an impromptu session at 9am
on a Friday morning after the Ops summit was already over expressing a
willingness to contribute pretty much said that we have enough willingness
among operators to contribute. I honestly don't think it would take that
much time from our day jobs so long as the parts are broken down into
manageable chunks and are assigned to people who already are writing these
configs to begin with. The initial setup will be somewhat time-consuming,
but the ongoing maintenance will be less so.

>
>
> Tim
>
>
>
> *From:* matt [mailto:matt at nycresistor.com]
> *Sent:* 10 November 2014 19:25
> *To:* Tim Bell
> *Cc:* Craig Tracey; Michael Chapman; openstack-operators
>
> *Subject:* Re: [Openstack-operators] Proposal for an 'Operations' project
>
>
>
> My fear with the github is that people will just donate code in a fire and
> forget fashion... this will generate a poorly maintained repo in which
> finding useful actively maintained contributions may become difficult.
>
> So my concerns lie in ensuring that anyone who contributes to this effort
> is committing to supporting their code for some length of time, and that
> there are maintainers committing to cleaning out the repos and being good
> code janitors.
>
>
>
> On Mon, Nov 10, 2014 at 1:03 PM, Tim Bell <Tim.Bell at cern.ch> wrote:
>
>
>
> My impression of the operations teams is that there is not yet consensus
> on the toolchains. This would make it difficult to establish a single
> project since the selection has many criteria outside of OpenStack (e.g.
> in-house skills, current deployments).
>
>
>
> I think the github repo (https://github.com/osops) is a great move to
> allow easy access to how others are doing it but it would be unrealistic to
> expect everyone to adopt a single toolchain given the investment in other
> areas.
>
>
>
> Unless everyone adopts Puppet, ElasticSearch, Hadoop and Flume like CERN J
>
>
>
> The deployment program is very different and it is not clear to me that
> TripleO is the universal solution either but that is another question…
>
>
>
> Tim
>
>
>
> *From:* Craig Tracey [mailto:craig at craigtracey.com]
> *Sent:* 10 November 2014 18:41
> *To:* Michael Chapman
> *Cc:* openstack-operators
> *Subject:* Re: [Openstack-operators] Proposal for an 'Operations' project
>
>
>
> Agree with Mike 1000%.
>
> This is something we should have done ages ago, and being agnostic is the
> correct way to get traction on this stuff. We'll be happy to help.
>
> Thanks for championing this!
>
> On Nov 10, 2014 11:37 AM, "Michael Chapman" <woppin at gmail.com> wrote:
>
>  Here's the etherpad from Friday:
> https://etherpad.openstack.org/p/kilo-summit-ops-opsprogram
>
>
>
> Jonothan: Your example of including log filters in oslo is extremely
> confusing. I am talking about something like this:
> https://github.com/OpenStratus/openstack-logstash/blob/master/agent.conf
>
>
>
> Which really doesn't belong in oslo. There's similar configuration for
> equivalents such as splunk or fluentd, all doing roughly the same thing
> depending on the operator's tool of choice.
>
>
>
> Same idea for nagios/sensu/zabbix/$other_tool
>
>
>
> Jeremy: OpenStack is so large that setting up packaging, monitoring and
> log aggregation for it isn't something that can be done easily, yet without
> configuring any monitoring or log aggregation it is extremely difficult to
> diagnose and fix issues in a running cloud, and without a packaging
> pipeline fixes can't be deployed easily.
>
>
>
> As to whether to include these things in the deployment program, I would
> say that I think the Deployment program is covering a 'delivery mechanism',
> whereas the things I am talking about are 'things to be delivered'. Clint
> and I had a quick chat on Friday during the TripleO session and I think we
> are thinking along very similar lines.
>
>
>
> I want to have a bunch of repos with things that deployment tools
> (including Fuel and TripleO and anything else that gets cooked up) can
> easily consume to improve the operator experience.
>
> I want a standard packaging system so that sites doing CI/CD today can all
> build packages from their own repos and collaborate on the specs/process in
> an upstream location, and I want it to be easily clone-able locally.
>
> I want it all under a single program so that in the future we can
> potentially reward and acknowledge people doing the work as contributors to
> OpenStack.
>
>
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
-Erik
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20141110/55d46b0a/attachment.html>


More information about the OpenStack-operators mailing list