[openstack-dev] [savanna] plugin version or hadoop version?

Sergey Lukjanov slukjanov at mirantis.com
Tue Feb 18 12:56:52 UTC 2014


Matt,

thanks, I'm agree with hadoop_version to version transition in v2 api.


On Tue, Feb 18, 2014 at 5:02 AM, Matthew Farrellee <matt at redhat.com> wrote:

> ok, i spent a little time looking at what the change impacts and it looks
> like all the template validations we have currently require hadoop_version.
> additionally, the client uses the name and documentation references it.
>
> due to the large number of changes and the difficulty in providing
> backward compatibility, i propose that we leave it as is for the v1 api &
> client and we change it for the v2 api & client.
>
> to that end, i've added 'verifying hadoop_version -> version' as a work
> item for both the v2-api-impl and v2-client.
>
> https://blueprints.launchpad.net/savanna/+spec/v2-api-impl
>
> and
>
> https://blueprints.launchpad.net/python-savannaclient/+spec/v2-client
>
> best,
>
>
> matt
>
>
> On 02/17/2014 04:23 PM, Alexander Ignatov wrote:
>
>> Agree to rename this legacy field to 'version'. Adding to John's words
>> about HDP, Vanilla plugin is able to run different hadoop versions by
>> doing some manipulations with DIB scripts :-) So the right name of this
>> field should be 'version' as version of engine of concrete plugin.
>>
>> Regards,
>> Alexander Ignatov
>>
>>
>>
>> On 18 Feb 2014, at 01:01, John Speidel <jspeidel at hortonworks.com
>> <mailto:jspeidel at hortonworks.com>> wrote:
>>
>>  Andrew +1
>>>
>>> The HDP plugin also returns the HDP distro version.  The version needs
>>> to make sense in the context of the plugin.
>>> Also, many plugins including the HDP plugin will support deployment of
>>> several hadoop versions.
>>>
>>> -John
>>>
>>>
>>> On Mon, Feb 17, 2014 at 2:36 PM, Andrew Lazarev <alazarev at mirantis.com
>>> <mailto:alazarev at mirantis.com>> wrote:
>>>
>>>     IDH uses version of IDH distro and there is no direct mapping
>>>     between distro version and hadoop version. E.g. IDH 2.5.1 works
>>>     with apache hadoop 1.0.3.
>>>
>>>     I suggest to call the field as just 'version' everywhere and
>>>     assume this version as plugin specific property.
>>>
>>>     Andrew.
>>>
>>>
>>>     On Mon, Feb 17, 2014 at 5:06 AM, Matthew Farrellee
>>>     <matt at redhat.com <mailto:matt at redhat.com>> wrote:
>>>
>>>         $ savanna plugins-list
>>>         +---------+----------+--------__-------------------+
>>>         | name    | versions | title                     |
>>>         +---------+----------+--------__-------------------+
>>>
>>>         | vanilla | 1.2.1    | Vanilla Apache Hadoop     |
>>>         | hdp     | 1.3.2    | Hortonworks Data Platform |
>>>         +---------+----------+--------__-------------------+
>>>
>>>
>>>         above is output from the /plugins endpoint -
>>>         http://docs.openstack.org/__developer/savanna/userdoc/__
>>> rest_api_v1.0.html#plugins
>>>
>>>         <http://docs.openstack.org/developer/savanna/userdoc/
>>> rest_api_v1.0.html#plugins>
>>>
>>>         the question is, should the version be the version of the
>>>         plugin or the version of hadoop the plugin installs?
>>>
>>>         i ask because it seems like we have version == plugin version
>>>         for hdp and version == hadoop version for vanilla.
>>>
>>>         the documentation is somewhat vague on the subject, mostly
>>>         stating "version" without qualification. however, the json
>>>         passed to the service references "hadoop_version" and the
>>>         arguments in the client are called "hadoop_version"
>>>
>>>         fyi, this could be complicated by the idh and spark plugins.
>>>
>>>         best,
>>>
>>>
>>>         matt
>>>
>>>         _________________________________________________
>>>         OpenStack-dev mailing list
>>>         OpenStack-dev at lists.openstack.__org
>>>         <mailto:OpenStack-dev at lists.openstack.org>
>>>         http://lists.openstack.org/__cgi-bin/mailman/listinfo/__
>>> openstack-dev
>>>
>>>         <http://lists.openstack.org/cgi-bin/mailman/listinfo/
>>> openstack-dev>
>>>
>>>
>>>
>>>     _______________________________________________
>>>     OpenStack-dev mailing list
>>>     OpenStack-dev at lists.openstack.org
>>>     <mailto:OpenStack-dev at lists.openstack.org>
>>>
>>>     http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or
>>> entity to which it is addressed and may contain information that is
>>> confidential, privileged and exempt from disclosure under applicable
>>> law. If the reader of this message is not the intended recipient, you
>>> are hereby notified that any printing, copying, dissemination,
>>> distribution, disclosure or forwarding of this communication is
>>> strictly prohibited. If you have received this communication in error,
>>> please contact the sender immediately and delete it from your system.
>>> Thank You._______________________________________________
>>> OpenStack-dev mailing list
>>> OpenStack-dev at lists.openstack.org
>>> <mailto:OpenStack-dev at lists.openstack.org>
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>>
>>
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>



-- 
Sincerely yours,
Sergey Lukjanov
Savanna Technical Lead
Mirantis Inc.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140218/20b5f02b/attachment.html>


More information about the OpenStack-dev mailing list