[Openstack-operators] OpenStack mitaka using swift as backend for glance

Michael Stang michael.stang at dhbw-mannheim.de
Wed Jul 20 17:04:23 UTC 2016


Hi Lucas,
 
glad it worked for you :-)
 
The problem with the images which I couldn't delete is solved now, i had this
line hardcoded before in the configuration file because I got the error before
that it did not find the swift endpoint:
 
swift_store_endpoint = http://controller:8080/v1/
 
but this was related to that he could not authenticate becaus of the missing
IDs. The configuration with this option was working for storing images but I
think for the delete it needs another endpoint (maybe this one?
 http://controller:8080/v1/AUTH_%(tenant_id)s ). but after I removed the line
everything works fine now and the line is not needed anymore because it gets the
rigth endpoint itself now after it can authenticate itself ;-)
 
Thanks and kind regards,
Michael
 

> Lucas Di Paola <ldipaola.despegar at gmail.com> hat am 20. Juli 2016 um 16:46
> geschrieben:
> 
>  Hi Michael, 
>   
>  Adjusting some config options solved the problem. Thank you, I really
> appreciated it. 
>   
>  What roles do the users have? The ones you are trying to delete the images
> from glance? 
>   
>  Regards, 
>   
>  Lucas.-
> 
>  2016-07-20 3:01 GMT-03:00 Michael Stang <michael.stang at dhbw-mannheim.de
> mailto:michael.stang at dhbw-mannheim.de >:
>    > >    Hi Lucas,
> >     
> >    yes I used thisID from the command for both, also have the proxy at 8080
> > on the controller. Here is my final configuration I made maybe this helps
> > you?
> >     
> >    In the glance-api.conf:
> >     
> > 
> >    [glance_store]
> >    stores = file,http,swift
> >    default_store = swift
> >    filesystem_store_datadir = /var/lib/glance/images/
> >    swift_store_create_container_on_put = True
> >    swift_store_container = glance
> >    swift_store_large_object_size = 20480
> >    swift_store_large_object_chunk_size = 200
> >    swift_enable_snet = False
> >    default_swift_reference = ref1
> >    swift_store_config_file = /etc/glance/glance-swift-store.conf
> > 
> >     
> >    and in the glance-swift-store.conf:
> >     
> > 
> >    [ref1]
> >    user_domain_id = <DOMAIN_ID>
> >    project_domain_id = <DOMAIN_ID>
> >    auth_version = 3
> >    auth_address = http://controller:5000/v3
> >    user = service:glance
> >    key = <GLANCE_PASS>
> > 
> > 
> > 
> >     > > > 
> > >    > > 
> >    Kind regards,
> > 
> >    Michael
> > 
> >     
> > 
> >     
> > 
> >     > > > Lucas Di Paola <ldipaola.despegar at gmail.com
> >     > > > mailto:ldipaola.despegar at gmail.com > hat am 19. Juli 2016 um 22:49
> >     > > > geschrieben:
> > >     Hi Michael, 
> > >      
> > >     I am having exactly the same issue, getting the error that you
> > > mentioned in your first email. I tried replacing project_domain_id´s and
> > > user_domain´s value using the <DOMAIN_ID>, but I had no luck, still
> > > getting the same error. 
> > >     Did you add the ID obtained from running the following openstack
> > > command? "openstack domain list". In that case, for both parameters, did
> > > you use the same ID? 
> > >      
> > > 
> > >    +----------------------------------+---------+---------+----------------+
> > >     | ID                               | Name    | Enabled | Description
> > >    |
> > > 
> > >    +----------------------------------+---------+---------+----------------+
> > >     | <ID> | default | True    | Default Domain |
> > > 
> > >    +----------------------------------+---------+---------+----------------+
> > >      
> > >     Regarding your issue, do you have the Proxy Server listenting on the
> > > 8080 port on the controller node?
> > >      
> > > 
> > >     2016-07-19 11:21 GMT-03:00 Michael Stang
> > > <michael.stang at dhbw-mannheim.de mailto:michael.stang at dhbw-mannheim.de >:
> > >       > > > >       Hi Sam, Hi all,
> > > >        
> > > >       fixed the problem.  I had used
> > > >        
> > > >       project_domain_id = default
> > > >       user_domain_id = default
> > > >        
> > > >       instead I had to use
> > > >        
> > > >       project_domain_id = <DOMIAN_ID>
> > > >       user_domain_id = <DOMIAN_ID>
> > > >        
> > > >       to make it work. Now I can store images over glance in swift, the
> > > > only problem I now have is that every user can upload images but only
> > > > "glance" can delete the images, when I try this with another user in the
> > > > project then in the glance-api.log I get
> > > >        
> > > >        ClientException: Object HEAD failed:
> > > > http://controller:8080/v1/glance/<Image_ID>  403 Forbidden
> > > >        
> > > >        
> > > >       don't know if something is still wrong or ift this might be a bug?
> > > >        
> > > >        
> > > >       Kind regards,
> > > >       Michael
> > > >        
> > > >        
> > > >        
> > > >        
> > > > 
> > > >        > > > > > Michael Stang <michael.stang at dhbw-mannheim.de
> > > >        > > > > > mailto:michael.stang at dhbw-mannheim.de > hat am 18. Juli
> > > >        > > > > > 2016 um 08:44 geschrieben:
> > > > > 
> > > > > 
> > > > >        Hi Sam,
> > > > >         
> > > > >        thank you for your answer.
> > > > >         
> > > > >        I had a look, the swift store endpoint ist listet 3 times  in
> > > > > the keystone, publicurl admin and internal endpoint. To try, I also
> > > > > set it in the glance-api.conf:
> > > > >         
> > > > >        swift_store_endpoint = http://controller:8080/v1/
> > > > >         
> > > > >        I also tried
> > > > >         
> > > > >        swift_store_endpoint =
> > > > > http://controller:8080/v1/AUTH_%(tenant_id)s
> > > > >         
> > > > >        but both gave me the same result as bevor. Is this the right
> > > > > endpoint url for swift? In which config file and with what option do I
> > > > > have to enter it in the glance configuration?
> > > > >         
> > > > >         
> > > > >        Thank you and kind regards,
> > > > >        Michael
> > > > >         
> > > > >         
> > > > > 
> > > > >         > > > > > > Sam Morrison <sorrison at gmail.com
> > > > >         > > > > > > mailto:sorrison at gmail.com > hat am 18. Juli 2016
> > > > >         > > > > > > um 01:41 geschrieben:
> > > > > > 
> > > > > >         Hi Michael,
> > > > > >          
> > > > > >         This would indicate that glance can’t find the swift
> > > > > > endpoint in the keystone catalog.
> > > > > >          
> > > > > >         You can either add it to the catalog or specify the swift
> > > > > > url in the config.
> > > > > >          
> > > > > >         Cheers,
> > > > > >         Sam
> > > > > >          
> > > > > > 
> > > > > > 
> > > > > >             > > > > > > >             On 15 Jul 2016, at 9:07 PM,
> > > > > >             > > > > > > > Michael Stang
> > > > > >             > > > > > > > <michael.stang at dhbw-mannheim.de
> > > > > >             > > > > > > > mailto:michael.stang at dhbw-mannheim.de >
> > > > > >             > > > > > > > wrote:
> > > > > > > 
> > > > > > >             Hi everyone,
> > > > > > >              
> > > > > > >             I tried to setup swift as backend for glance in our
> > > > > > > new mitaka installation. I used this in the glance-api.conf
> > > > > > >              
> > > > > > > 
> > > > > > >             [glance_store]
> > > > > > >             stores = swift
> > > > > > >             default_store = swift
> > > > > > >             swift_store_create_container_on_put = True
> > > > > > >             swift_store_region = RegionOne
> > > > > > >             default_swift_reference = ref1
> > > > > > >             swift_store_config_file =
> > > > > > > /etc/glance/glance-swift-store.conf
> > > > > > > 
> > > > > > >              
> > > > > > > 
> > > > > > >             and in the glance-swift-store.conf this
> > > > > > > 
> > > > > > >             [ref1]
> > > > > > >             auth_version = 3
> > > > > > >             project_domain_id = default
> > > > > > >             user_domain_id = default
> > > > > > >             auth_address = http://controller:35357/
> > > > > > >             user = services:swift
> > > > > > >             key = xxxxx
> > > > > > > 
> > > > > > >             When I trie now to upload an image it gets the status
> > > > > > > "killed" and this is in the glance-api.log
> > > > > > > 
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils
> > > > > > > [req-0ec16fa5-a605-47f3-99e9-9ab231116f04
> > > > > > > de9463239010412d948df4020e9be277 669e037b13874b6c871
> > > > > > >             2b1fd10c219f0 - - -] Failed to upload image
> > > > > > > 6de45d08-b420-477b-a665-791faa232379
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils Traceback (most recent call last):
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance/api/v1/upload_utils.py",
> > > > > > > line 110, in upload_d
> > > > > > >             ata_to_store
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils context=req.context)
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance_store/backend.py", line
> > > > > > > 344, in store_add_to_b
> > > > > > >             ackend
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils verifier=verifier)
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance_store/capabilities.py",
> > > > > > > line 226, in op_checke
> > > > > > >             r
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils return store_op_fun(store, *args,
> > > > > > > **kwargs)
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance_store/_drivers/swift/store.py",
> > > > > > > line 532, in a
> > > > > > >             dd
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils allow_reauth=need_chunks) as manager:
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance_store/_drivers/swift/store.py",
> > > > > > > line 1170, in
> > > > > > >             get_manager_for_store
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils store, store_location, context,
> > > > > > > allow_reauth)
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance_store/_drivers/swift/connection_manager.py",
> > > > > > > l
> > > > > > >             ine 64, in __init__
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils self.storage_url =
> > > > > > > self._get_storage_url()
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils File
> > > > > > > "/usr/lib/python2.7/dist-packages/glance_store/_drivers/swift/connection_manager.py",
> > > > > > > l
> > > > > > >             ine 160, in _get_storage_url
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils raise exceptions.BackendException(msg)
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils BackendException: Cannot find swift
> > > > > > > service endpoint : The resource could not be found. (HTTP
> > > > > > >             404)
> > > > > > >             2016-07-15 12:21:44.379 14230 ERROR
> > > > > > > glance.api.v1.upload_utils
> > > > > > > 
> > > > > > >              
> > > > > > > 
> > > > > > >             anyone an idea what i'm missing in the config file
> > > > > > > oder what might be the problem?
> > > > > > > 
> > > > > > >             Thanks and kind regards,
> > > > > > >             Michael
> > > > > > > 
> > > > > > >             _______________________________________________
> > > > > > >             OpenStack-operators mailing list
> > > > > > >             OpenStack-operators at lists.openstack.org
> > > > > > > mailto:OpenStack-operators at lists.openstack.org
> > > > > > > 
> > > > > > >            http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> > > > > > > 
> > > > > > >         > > > > > > 
> > > > > >        > > > > > 
> > > > >         
> > > > > 
> > > > >       > > > > 
> > > >        
> > > > 
> > > >        > > > > > _______________________________________________
> > > > >        OpenStack-operators mailing list
> > > > >        OpenStack-operators at lists.openstack.org
> > > > > mailto:OpenStack-operators at lists.openstack.org
> > > > > 
> > > > >       http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> > > > > 
> > > > >       > > > > 
> > > >        
> > > >       Viele Grüße
> > > > 
> > > >       Michael Stang
> > > >       Laboringenieur, Dipl. Inf. (FH)
> > > > 
> > > >       Duale Hochschule Baden-Württemberg Mannheim
> > > >       Baden-Wuerttemberg Cooperative State University Mannheim
> > > >       ZeMath Zentrum für mathematisch-naturwissenschaftliches
> > > > Basiswissen
> > > >       Fachbereich Informatik, Fakultät Technik
> > > >       Coblitzallee 1-9
> > > >       68163 Mannheim
> > > > 
> > > >       Tel.: +49 (0)621 4105 - 1367
> > > >       michael.stang at dhbw-mannheim.de
> > > > mailto:michael.stang at dhbw-mannheim.de
> > > >       http://www.dhbw-mannheim.de
> > > > 
> > > > 
> > > > 
> > > > 
> > > > 
> > > > 
> > > >       _______________________________________________
> > > >       OpenStack-operators mailing list
> > > >       OpenStack-operators at lists.openstack.org
> > > > mailto:OpenStack-operators at lists.openstack.org
> > > > 
> > > >      http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> > > >     > > > 
> > >    > > 
> >     
> >    Viele Grüße
> > 
> >    Michael Stang
> >    Laboringenieur, Dipl. Inf. (FH)
> > 
> >    Duale Hochschule Baden-Württemberg Mannheim
> >    Baden-Wuerttemberg Cooperative State University Mannheim
> >    ZeMath Zentrum für mathematisch-naturwissenschaftliches Basiswissen
> >    Fachbereich Informatik, Fakultät Technik
> >    Coblitzallee 1-9
> >    68163 Mannheim
> > 
> >    Tel.: +49 (0)621 4105 - 1367
> >    michael.stang at dhbw-mannheim.de mailto:michael.stang at dhbw-mannheim.de
> >    http://www.dhbw-mannheim.de
> > 
> > 
> > 
> > 
> > 
> >  > 

 
Viele Grüße

Michael Stang
Laboringenieur, Dipl. Inf. (FH)

Duale Hochschule Baden-Württemberg Mannheim
Baden-Wuerttemberg Cooperative State University Mannheim
ZeMath Zentrum für mathematisch-naturwissenschaftliches Basiswissen
Fachbereich Informatik, Fakultät Technik
Coblitzallee 1-9
68163 Mannheim

Tel.: +49 (0)621 4105 - 1367
michael.stang at dhbw-mannheim.de
http://www.dhbw-mannheim.de
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20160720/c2536f7a/attachment.html>


More information about the OpenStack-operators mailing list