Open Stack

Hi all,

we (sahara developers) are working on splitting the content of sahara.git, 
moving the code of each plugin to its own respository. Each plugin is used for 
a different Hadoop/Big Data provider. The change is better described in the 
following spec, which didn't happen in Rocky:

http://specs.openstack.org/openstack/sahara-specs/specs/rocky/plugins-outside-sahara-core.html

The change is going to impact other projects, but hopefully not the users. I 
will try to summarize the impact on the various consumers of sahara.

== Deployment tools

- the devstack plugin in the test repository (see below) was modified to 
support the installation of all the available plugins previously available in-
tree, so devstack users should not notice any change.
- puppet-sahara will require changes to install the additional repositories, 
and we would require and welcome any help;
- I hope that the puppet-sahara changes would be enough to make TripleO work, 
but we would need some help on this.
- openstack-ansibe-os_sahara will require changes as well, but we have a bit 
more expertise on Ansible and we can help with the changes.
- kolla will require some changes too, depending on te 
(apologize if I forgot some project)

== Packaging

It would be nice if users could get all the plugins packages by installing the 
same packages as before the split, but I understand that it may be tricky, 
because each plugin depends on the core of sahara. This means that a binary 
subpackage like openstack-sahara (RDO) or sahara (Debian) can't depend on the 
binary packages of the plugins, or that would introduce a circular dependency.

I raised the issue on the RDO list to get some initial feedback and the 
solution that we are going to implement in RDO requires flipping the value of 
a variable to handle the bootstrap case and the normal case, please check:
https://lists.rdoproject.org/pipermail/dev/2018-November/008972.html
and the rest of the thread, like:
 https://lists.rdoproject.org/pipermail/dev/2018-December/008977.html
 
Any additional idea from other packagers would be really appreciated, also 
because it has a direct impact on at least the puppet modules.

== Preview

The work-in-progress repositories are available here:

Sahara: https://github.com/tellesnobrega/sahara/tree/split-plugins

Plugins:
* Ambari: https://github.com/tellesnobrega/sahara-plugin-ambari
* CDH: https://github.com/tellesnobrega/sahara-plugin-cdh
* MapR: https://github.com/tellesnobrega/sahara-plugin-mapr
* Spark: https://github.com/tellesnobrega/sahara-plugin-spark
* Storm: https://github.com/tellesnobrega/sahara-plugin-storm
* Vanilla: https://github.com/tellesnobrega/sahara-plugin-vanilla

Any comment is more than welcome!

Ciao
-- 
Luigi