[openstack-dev] [savanna] savanna-extra and hadoop-patch

Sergey Lukjanov slukjanov at mirantis.com
Tue Aug 27 05:45:58 UTC 2013


Hi Erik,

First of all, savanna-extra has been created exactly for such needs - to store all stuff that we need but couldn't be placed to another repos. Initially it contains elements and pre-builded jar with Swift HCFS. Now the last one has been moved to the CDN and it's a good idea to make separated project for elements.

As for Swift HCFS the core attached to the HADOOP-8545 is targeted to the Hadoop 2 version and should be patched to work with Hadoop 1.X correctly. So, that's why we add it to the extra repo. It looks like that it's ok to add one more repo for Swift HCFS near the savanna at stackforge like HCFS for Gluster[0].

So, let's discuss both of the migrations at the next IRC team meeting.

[0] https://github.com/gluster/hadoop-glusterfs

Sincerely yours,
Sergey Lukjanov
Savanna Technical Lead
Mirantis Inc.

On Aug 27, 2013, at 5:18, Matthew Farrellee <matt at redhat.com> wrote:

> https://review.openstack.org/#/c/42926/
> 
> I didn't get back to this on Friday and it got merged this morning, so here's my feedback.
> 
> The savanna-extra repository now appears to hold (a) DIB image elements as well as (b) the source for the Swift backed HCFS (Hadoop Compatible File System) implementation.
> 
> If I understand this correctly, (b) is actually the patch set that is being proposed to the Apache Hadoop community. That patch set has not been accepted and is being tracked in HADOOP-8545[0], which appears stalled since July 2013.
> 
> Let's break Savanna's DIB elements out of savanna-extra and into savanna-image-elements. It has a clear path forward and a good definition of scope.
> 
> Let's also leave savanna-extra as a grab bag, whose only occupant is currently the Swift code. Eventually that code will need a proper home, either contributed to Apache Hadoop or broken out as its own project.
> 
> Best,
> 
> 
> matt
> 
> [0] https://issues.apache.org/jira/browse/HADOOP-8545
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




More information about the OpenStack-dev mailing list