[openstack-dev] [savanna] plugin version or hadoop version?
Matthew Farrellee
matt at redhat.com
Tue Feb 18 01:02:04 UTC 2014
ok, i spent a little time looking at what the change impacts and it
looks like all the template validations we have currently require
hadoop_version. additionally, the client uses the name and documentation
references it.
due to the large number of changes and the difficulty in providing
backward compatibility, i propose that we leave it as is for the v1 api
& client and we change it for the v2 api & client.
to that end, i've added 'verifying hadoop_version -> version' as a work
item for both the v2-api-impl and v2-client.
https://blueprints.launchpad.net/savanna/+spec/v2-api-impl
and
https://blueprints.launchpad.net/python-savannaclient/+spec/v2-client
best,
matt
On 02/17/2014 04:23 PM, Alexander Ignatov wrote:
> Agree to rename this legacy field to ‘version’. Adding to John's words
> about HDP, Vanilla plugin is able to run different hadoop versions by
> doing some manipulations with DIB scripts :-) So the right name of this
> field should be ‘version’ as version of engine of concrete plugin.
>
> Regards,
> Alexander Ignatov
>
>
>
> On 18 Feb 2014, at 01:01, John Speidel <jspeidel at hortonworks.com
> <mailto:jspeidel at hortonworks.com>> wrote:
>
>> Andrew +1
>>
>> The HDP plugin also returns the HDP distro version. The version needs
>> to make sense in the context of the plugin.
>> Also, many plugins including the HDP plugin will support deployment of
>> several hadoop versions.
>>
>> -John
>>
>>
>> On Mon, Feb 17, 2014 at 2:36 PM, Andrew Lazarev <alazarev at mirantis.com
>> <mailto:alazarev at mirantis.com>> wrote:
>>
>> IDH uses version of IDH distro and there is no direct mapping
>> between distro version and hadoop version. E.g. IDH 2.5.1 works
>> with apache hadoop 1.0.3.
>>
>> I suggest to call the field as just 'version' everywhere and
>> assume this version as plugin specific property.
>>
>> Andrew.
>>
>>
>> On Mon, Feb 17, 2014 at 5:06 AM, Matthew Farrellee
>> <matt at redhat.com <mailto:matt at redhat.com>> wrote:
>>
>> $ savanna plugins-list
>> +---------+----------+--------__-------------------+
>> | name | versions | title |
>> +---------+----------+--------__-------------------+
>> | vanilla | 1.2.1 | Vanilla Apache Hadoop |
>> | hdp | 1.3.2 | Hortonworks Data Platform |
>> +---------+----------+--------__-------------------+
>>
>> above is output from the /plugins endpoint -
>> http://docs.openstack.org/__developer/savanna/userdoc/__rest_api_v1.0.html#plugins
>> <http://docs.openstack.org/developer/savanna/userdoc/rest_api_v1.0.html#plugins>
>>
>> the question is, should the version be the version of the
>> plugin or the version of hadoop the plugin installs?
>>
>> i ask because it seems like we have version == plugin version
>> for hdp and version == hadoop version for vanilla.
>>
>> the documentation is somewhat vague on the subject, mostly
>> stating "version" without qualification. however, the json
>> passed to the service references "hadoop_version" and the
>> arguments in the client are called "hadoop_version"
>>
>> fyi, this could be complicated by the idh and spark plugins.
>>
>> best,
>>
>>
>> matt
>>
>> _________________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.__org
>> <mailto:OpenStack-dev at lists.openstack.org>
>> http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev
>> <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>>
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or
>> entity to which it is addressed and may contain information that is
>> confidential, privileged and exempt from disclosure under applicable
>> law. If the reader of this message is not the intended recipient, you
>> are hereby notified that any printing, copying, dissemination,
>> distribution, disclosure or forwarding of this communication is
>> strictly prohibited. If you have received this communication in error,
>> please contact the sender immediately and delete it from your system.
>> Thank You._______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
More information about the OpenStack-dev
mailing list