[openstack-dev] [savanna] why swift-internal:// ?

Matthew Farrellee matt at redhat.com
Fri Jan 24 19:04:26 UTC 2014


thanks for all the feedback folks.. i've registered a bp for this...

https://blueprints.launchpad.net/savanna/+spec/swift-url-proto-cleanup

On 01/24/2014 11:30 AM, Sergey Lukjanov wrote:
> Looks like we need to review prefixes and cleanup them. After the first
> look I'd like the idea of using common prefix for swift data.
>
>
> On Fri, Jan 24, 2014 at 7:05 PM, Trevor McKay <tmckay at redhat.com
> <mailto:tmckay at redhat.com>> wrote:
>
>     Matt et al,
>
>        Yes, "swift-internal" was meant as a marker to distinguish it from
>     "swift-external" someday. I agree, this could be indicated by setting
>     other fields.
>
>     Little bit of implementation detail for scope:
>
>        In the current EDP implementation, SWIFT_INTERNAL_PREFIX shows up in
>     essentially two places.  One is validation (pretty easy to change).
>
>        The other is in Savanna's binary_retrievers module where, as others
>     suggested, the auth url (proto, host, port, api) and admin tenant from
>     the savanna configuration are used with the user/passw to make a
>     connection through the swift client.
>
>        Handling of different types of job binaries is done in
>     binary_retrievers/dispatch.py, where the URL determines the treatment.
>     This could easily be extended to look at other indicators.
>
>     Best,
>
>     Trev
>
>     On Fri, 2014-01-24 at 07:50 -0500, Matthew Farrellee wrote:
>      > andrew,
>      >
>      > what about having swift:// which defaults to the configured
>     tenant and
>      > auth url for what we now call swift-internal, and we allow for user
>      > input to change tenant and auth url for what would be swift-external?
>      >
>      > in fact, we may need to add the tenant selection in icehouse. it's a
>      > pretty big limitation to only allow a single tenant.
>      >
>      > best,
>      >
>      >
>      > matt
>      >
>      > On 01/23/2014 11:15 PM, Andrew Lazarev wrote:
>      > > Matt,
>      > >
>      > > For swift-internal we are using the same keystone (and identity
>     protocol
>      > > version) as for savanna. Also savanna admin tenant is used.
>      > >
>      > > Thanks,
>      > > Andrew.
>      > >
>      > >
>      > > On Thu, Jan 23, 2014 at 6:17 PM, Matthew Farrellee
>     <matt at redhat.com <mailto:matt at redhat.com>
>      > > <mailto:matt at redhat.com <mailto:matt at redhat.com>>> wrote:
>      > >
>      > >     what makes it internal vs external?
>      > >
>      > >     swift-internal needs user & pass
>      > >
>      > >     swift-external needs user & pass & ?auth url?
>      > >
>      > >     best,
>      > >
>      > >
>      > >     matt
>      > >
>      > >     On 01/23/2014 08:43 PM, Andrew Lazarev wrote:
>      > >
>      > >         Matt,
>      > >
>      > >         I can easily imagine situation when job binaries are
>     stored in
>      > >         external
>      > >         HDFS or external SWIFT (like data sources). Internal and
>      > >         external swifts
>      > >         are different since we need additional credentials.
>      > >
>      > >         Thanks,
>      > >         Andrew.
>      > >
>      > >
>      > >         On Thu, Jan 23, 2014 at 5:30 PM, Matthew Farrellee
>      > >         <matt at redhat.com <mailto:matt at redhat.com>
>     <mailto:matt at redhat.com <mailto:matt at redhat.com>>
>      > >         <mailto:matt at redhat.com <mailto:matt at redhat.com>
>     <mailto:matt at redhat.com <mailto:matt at redhat.com>>>> wrote:
>      > >
>      > >              trevor,
>      > >
>      > >              job binaries are stored in swift or an internal
>     savanna db,
>      > >              represented by swift-internal:// and savanna-db://
>      > >         respectively.
>      > >
>      > >              why swift-internal:// and not just swift://?
>      > >
>      > >              fyi, i see mention of a potential future version
>     of savanna w/
>      > >              swift-external://
>      > >
>      > >              best,
>      > >
>      > >
>      > >              matt
>      > >
>      > >              ___________________________________________________
>      > >              OpenStack-dev mailing list
>      > >              OpenStack-dev at lists.openstack.____org
>      > >              <mailto:OpenStack-dev at lists.
>     <mailto:OpenStack-dev at lists.>__openstack.org <http://openstack.org>
>      > >         <mailto:OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>>>
>      > >
>     http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-dev
>      > >
>     <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev>
>      > >
>     <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev
>      > >
>     <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>>
>      > >
>      > >
>      > >
>      > >
>      > >         _________________________________________________
>      > >         OpenStack-dev mailing list
>      > >         OpenStack-dev at lists.openstack.__org
>      > >         <mailto:OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>>
>      > >
>     http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev
>      > >
>     <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>      > >
>      > >
>      > >
>      > >     _________________________________________________
>      > >     OpenStack-dev mailing list
>      > >     OpenStack-dev at lists.openstack.__org
>      > >     <mailto:OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>>
>      > >
>     http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-dev <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>      > >
>      > >
>      > >
>      > >
>      > > _______________________________________________
>      > > OpenStack-dev mailing list
>      > > OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>
>      > > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>      > >
>      >
>      >
>      > _______________________________________________
>      > OpenStack-dev mailing list
>      > OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>
>      > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
>     _______________________________________________
>     OpenStack-dev mailing list
>     OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>
>     http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
>
> --
> Sincerely yours,
> Sergey Lukjanov
> Savanna Technical Lead
> Mirantis Inc.
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>




More information about the OpenStack-dev mailing list