[openstack-dev] [savanna] savanna-extra and hadoop-patch

Matthew Farrellee matt at redhat.com
Tue Aug 27 10:41:59 UTC 2013


Howdy Ivan,

FYI, https://issues.apache.org/jira/browse/HADOOP-8545 is currently 
targeting 1.2.0 and 2.0.3-alpha. And the code (HADOOP-8545-034.patch) 
appears to provide support to Hadoop 1.x HDFS, though I may be missing 
something.

I'd suggest only adding a Swift HCFS repo only if the code is not 
destined to go to Apache Hadoop.

+1 discuss at meeting

Best,


s/matt/erik/

On 08/27/2013 01:45 AM, Sergey Lukjanov wrote:
> Hi Erik,
>
> First of all, savanna-extra has been created exactly for such needs -
> to store all stuff that we need but couldn't be placed to another
> repos. Initially it contains elements and pre-builded jar with Swift
> HCFS. Now the last one has been moved to the CDN and it's a good idea
> to make separated project for elements.
>
> As for Swift HCFS the core attached to the HADOOP-8545 is targeted to
> the Hadoop 2 version and should be patched to work with Hadoop 1.X
> correctly. So, that's why we add it to the extra repo. It looks like
> that it's ok to add one more repo for Swift HCFS near the savanna at
> stackforge like HCFS for Gluster[0].
>
> So, let's discuss both of the migrations at the next IRC team meeting.
>
> [0] https://github.com/gluster/hadoop-glusterfs
>
> Sincerely yours,
> Sergey Lukjanov
> Savanna Technical Lead
> Mirantis Inc.
>
> On Aug 27, 2013, at 5:18, Matthew Farrellee <matt at redhat.com> wrote:
>
>> https://review.openstack.org/#/c/42926/
>>
>> I didn't get back to this on Friday and it got merged this morning, so here's my feedback.
>>
>> The savanna-extra repository now appears to hold (a) DIB image elements as well as (b) the source for the Swift backed HCFS (Hadoop Compatible File System) implementation.
>>
>> If I understand this correctly, (b) is actually the patch set that is being proposed to the Apache Hadoop community. That patch set has not been accepted and is being tracked in HADOOP-8545[0], which appears stalled since July 2013.
>>
>> Let's break Savanna's DIB elements out of savanna-extra and into savanna-image-elements. It has a clear path forward and a good definition of scope.
>>
>> Let's also leave savanna-extra as a grab bag, whose only occupant is currently the Swift code. Eventually that code will need a proper home, either contributed to Apache Hadoop or broken out as its own project.
>>
>> Best,
>>
>>
>> matt
>>
>> [0] https://issues.apache.org/jira/browse/HADOOP-8545
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>




More information about the OpenStack-dev mailing list