[openstack-dev] [savanna] why swift-internal:// ?
Sergey Lukjanov
slukjanov at mirantis.com
Tue Jan 28 11:32:19 UTC 2014
Matt, thanks for catching this.
BTW That's an interesting idea of supporting different tenants.
On Fri, Jan 24, 2014 at 11:04 PM, Matthew Farrellee <matt at redhat.com> wrote:
> thanks for all the feedback folks.. i've registered a bp for this...
>
> https://blueprints.launchpad.net/savanna/+spec/swift-url-proto-cleanup
>
>
> On 01/24/2014 11:30 AM, Sergey Lukjanov wrote:
>
>> Looks like we need to review prefixes and cleanup them. After the first
>> look I'd like the idea of using common prefix for swift data.
>>
>>
>> On Fri, Jan 24, 2014 at 7:05 PM, Trevor McKay <tmckay at redhat.com
>> <mailto:tmckay at redhat.com>> wrote:
>>
>> Matt et al,
>>
>> Yes, "swift-internal" was meant as a marker to distinguish it from
>> "swift-external" someday. I agree, this could be indicated by setting
>> other fields.
>>
>> Little bit of implementation detail for scope:
>>
>> In the current EDP implementation, SWIFT_INTERNAL_PREFIX shows up
>> in
>> essentially two places. One is validation (pretty easy to change).
>>
>> The other is in Savanna's binary_retrievers module where, as others
>> suggested, the auth url (proto, host, port, api) and admin tenant from
>> the savanna configuration are used with the user/passw to make a
>> connection through the swift client.
>>
>> Handling of different types of job binaries is done in
>> binary_retrievers/dispatch.py, where the URL determines the treatment.
>> This could easily be extended to look at other indicators.
>>
>> Best,
>>
>> Trev
>>
>> On Fri, 2014-01-24 at 07:50 -0500, Matthew Farrellee wrote:
>> > andrew,
>> >
>> > what about having swift:// which defaults to the configured
>> tenant and
>> > auth url for what we now call swift-internal, and we allow for user
>> > input to change tenant and auth url for what would be
>> swift-external?
>> >
>> > in fact, we may need to add the tenant selection in icehouse. it's
>> a
>> > pretty big limitation to only allow a single tenant.
>> >
>> > best,
>> >
>> >
>> > matt
>> >
>> > On 01/23/2014 11:15 PM, Andrew Lazarev wrote:
>> > > Matt,
>> > >
>> > > For swift-internal we are using the same keystone (and identity
>> protocol
>> > > version) as for savanna. Also savanna admin tenant is used.
>> > >
>> > > Thanks,
>> > > Andrew.
>> > >
>> > >
>> > > On Thu, Jan 23, 2014 at 6:17 PM, Matthew Farrellee
>> <matt at redhat.com <mailto:matt at redhat.com>
>> > > <mailto:matt at redhat.com <mailto:matt at redhat.com>>> wrote:
>> > >
>> > > what makes it internal vs external?
>> > >
>> > > swift-internal needs user & pass
>> > >
>> > > swift-external needs user & pass & ?auth url?
>> > >
>> > > best,
>> > >
>> > >
>> > > matt
>> > >
>> > > On 01/23/2014 08:43 PM, Andrew Lazarev wrote:
>> > >
>> > > Matt,
>> > >
>> > > I can easily imagine situation when job binaries are
>> stored in
>> > > external
>> > > HDFS or external SWIFT (like data sources). Internal and
>> > > external swifts
>> > > are different since we need additional credentials.
>> > >
>> > > Thanks,
>> > > Andrew.
>> > >
>> > >
>> > > On Thu, Jan 23, 2014 at 5:30 PM, Matthew Farrellee
>> > > <matt at redhat.com <mailto:matt at redhat.com>
>> <mailto:matt at redhat.com <mailto:matt at redhat.com>>
>> > > <mailto:matt at redhat.com <mailto:matt at redhat.com>
>> <mailto:matt at redhat.com <mailto:matt at redhat.com>>>> wrote:
>> > >
>> > > trevor,
>> > >
>> > > job binaries are stored in swift or an internal
>> savanna db,
>> > > represented by swift-internal:// and savanna-db://
>> > > respectively.
>> > >
>> > > why swift-internal:// and not just swift://?
>> > >
>> > > fyi, i see mention of a potential future version
>> of savanna w/
>> > > swift-external://
>> > >
>> > > best,
>> > >
>> > >
>> > > matt
>> > >
>> > > ___________________________________________________
>> > > OpenStack-dev mailing list
>> > > OpenStack-dev at lists.openstack.____org
>> > > <mailto:OpenStack-dev at lists.
>> <mailto:OpenStack-dev at lists.>__openstack.org <http://openstack.org>
>> > > <mailto:OpenStack-dev at lists.openstack.org
>>
>> <mailto:OpenStack-dev at lists.openstack.org>>>
>> > >
>> http://lists.openstack.org/____cgi-bin/mailman/listinfo/____
>> openstack-dev
>> > >
>> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__
>> openstack-dev>
>> > >
>> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__
>> openstack-dev
>> > >
>> <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>>
>> > >
>> > >
>> > >
>> > >
>> > > _________________________________________________
>> > > OpenStack-dev mailing list
>> > > OpenStack-dev at lists.openstack.__org
>> > > <mailto:OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>>
>> > >
>> http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev
>> > >
>> <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>> > >
>> > >
>> > >
>> > > _________________________________________________
>> > > OpenStack-dev mailing list
>> > > OpenStack-dev at lists.openstack.__org
>> > > <mailto:OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>>
>> > >
>> http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev<
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>> > >
>> > >
>> > >
>> > >
>> > > _______________________________________________
>> > > OpenStack-dev mailing list
>> > > OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>
>>
>> > > http://lists.openstack.org/cgi-bin/mailman/listinfo/
>> openstack-dev
>> > >
>> >
>> >
>> > _______________________________________________
>> > OpenStack-dev mailing list
>> > OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>
>>
>> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> <mailto:OpenStack-dev at lists.openstack.org>
>>
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>>
>> --
>> Sincerely yours,
>> Sergey Lukjanov
>> Savanna Technical Lead
>> Mirantis Inc.
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
--
Sincerely yours,
Sergey Lukjanov
Savanna Technical Lead
Mirantis Inc.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140128/55605268/attachment.html>
More information about the OpenStack-dev
mailing list