Open Stack

Hi Wodel,

A few things, can you share the specific version you are using for Ceph?
You mentioned Ceph Octopus and Ceph Pacific, we need to make sure that the
microversions are as follows

Ceph Octopus minimum version 15.2.11
Ceph Pacific minimum version 16.2.1

Also, can you make sure that the updates on the caps were applied?

Do this by doing "ceph auth ls" and checking the values you have for
client.manila

The output should be similar to what you see in [0]

If those are ok, you would need to restart manila-share service and the
issue should be resolved.

Regards,

Victoria

[0]
https://docs.ceph.com/en/latest/rados/operations/user-management/#list-users

On Thu, Oct 28, 2021 at 9:19 AM Buddhika Godakuru <bsanjeewa at kln.ac.lk>
wrote:

> Hi Wodel,
> So the issue is beyond my current understanding.
> I am interested in this because I am planning to deploy one next month.
> Unfortunately, currently I do not have hardware to deploy one and see.
> Sorry couldn't be more helpful.
>
> On Thu, 28 Oct 2021 at 03:24, wodel youchi <wodel.youchi at gmail.com> wrote:
>
>> Hi,
>>
>> To *Buddhika Godakuru*
>> I took a look into the manila-share docker deployed on my platforme and
>> it contains the patch you mentioned in [1].
>> The Manila code does integrate the ceph test for version.
>>
>> [1] https://review.opendev.org/c/openstack/manila/+/797955
>>
>>
>> Regards.
>>
>> Le mar. 26 oct. 2021 à 09:06, wodel youchi <wodel.youchi at gmail.com> a
>> écrit :
>>
>>> Hi,
>>> My deployment is from source, and I have little experience on how to
>>> rebuild docker images, I can perhaps pull new images (built recently I
>>> mean).
>>> I took a look into docker hub and there are new manila images pushed 2
>>> days ago.
>>>
>>> Regards.
>>>
>>> Le lun. 25 oct. 2021 à 19:23, Buddhika Godakuru <bsanjeewa at kln.ac.lk> a
>>> écrit :
>>>
>>>> Is your deployment type is source or binary?
>>>> If it is binay, I wonder if this patch [1] is built into the repos.
>>>> If source, could you try rebuilding the manila docker images?
>>>>
>>>> [1] https://review.opendev.org/c/openstack/manila/+/797955
>>>>
>>>> On Mon, 25 Oct 2021 at 20:21, wodel youchi <wodel.youchi at gmail.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I tried with pacific then with octopus, the same problem.
>>>>> The patch was applied to kolla-ansible.
>>>>>
>>>>> Regards.
>>>>>
>>>>> Le ven. 22 oct. 2021 00:34, Goutham Pacha Ravi <gouthampravi at gmail.com>
>>>>> a écrit :
>>>>>
>>>>>>
>>>>>>
>>>>>> On Thu, Oct 21, 2021 at 1:56 AM wodel youchi <wodel.youchi at gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I did that already, I changed the keyring to "*ceph auth
>>>>>>> get-or-create client.manila -o manila.keyring mgr 'allow rw' mon 'allow r'*
>>>>>>> " it didn't work, then I tried with ceph octopus, same error.
>>>>>>> I applied the patch, then I recreated the keyring for manila as
>>>>>>> wallaby documentation, I get the error "*Bad target type 'mon-mgr'*"
>>>>>>>
>>>>>>
>>>>>> Thanks, the error seems similar to this issue:
>>>>>> https://tracker.ceph.com/issues/51039
>>>>>>
>>>>>> Can you confirm the ceph version installed? On the ceph side, some
>>>>>> changes land after GA and get back ported;
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Regards.
>>>>>>>
>>>>>>> Le jeu. 21 oct. 2021 à 05:29, Buddhika Godakuru <bsanjeewa at kln.ac.lk>
>>>>>>> a écrit :
>>>>>>>
>>>>>>>> Dear Wodel,
>>>>>>>> I think this is because manila has changed the way how to
>>>>>>>> set/create auth ID in Wallaby for native CephFS driver.
>>>>>>>> For the patch to work, you should change the command
>>>>>>>> *ceph auth get-or-create client.manila mon 'allow r' mds 'allow r,
>>>>>>>> allow rw path=/' osd 'allow rw pool=cephfs_data' mgr 'allow rw'*
>>>>>>>> to something like,
>>>>>>>> ceph auth get-or-create client.manila -o manila.keyring mgr 'allow
>>>>>>>> rw' mon 'allow r'
>>>>>>>>
>>>>>>>> Please see Manila Wallaby CephFS Driver document [1]
>>>>>>>>
>>>>>>>> Hope this helps.
>>>>>>>>
>>>>>>>> Thank you
>>>>>>>>  [1]
>>>>>>>> https://docs.openstack.org/manila/wallaby/admin/cephfs_driver.html#authorizing-the-driver-to-communicate-with-ceph
>>>>>>>>
>>>>>>>> On Wed, 20 Oct 2021 at 23:19, wodel youchi <wodel.youchi at gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi, and thanks
>>>>>>>>>
>>>>>>>>> I tried to apply the patch, but it didn't work, this is the
>>>>>>>>> manila-share.log.
>>>>>>>>> By the way, I did change to caps for the manila client to what is
>>>>>>>>> said in wallaby documentation, that is :
>>>>>>>>> [client.manila]
>>>>>>>>>        key = keyyyyyyyy.....
>>>>>>>>>
>>>>>>>>> *       caps mgr = "allow rw"        caps mon = "allow r"*
>>>>>>>>>
>>>>>>>>> [root at ControllerA manila]# cat manila-share.log
>>>>>>>>> 2021-10-20 10:03:22.286 7 INFO oslo_service.periodic_task [-]
>>>>>>>>> Skipping periodic task update_share_usage_size because it is disabled
>>>>>>>>> ......
>>>>>>>>> 2021-10-20 10:11:50.596 30 ERROR manila.share.manager     raise
>>>>>>>>> exception.ShareBackendException(msg)
>>>>>>>>> 2021-10-20 10:11:50.596 30 ERROR manila.share.manager
>>>>>>>>> manila.exception.ShareBackendException: json_command failed - prefix=fs
>>>>>>>>> volume
>>>>>>>>> ls, argdict={'format': 'json'} - exception message: Bad target
>>>>>>>>> type 'mon-mgr'.
>>>>>>>>> 2021-10-20 10:11:50.596 30 ERROR manila.share.manager
>>>>>>>>>
>>>>>>>>> Regards
>>>>>>>>>
>>>>>>>>> Le mer. 20 oct. 2021 à 00:14, Goutham Pacha Ravi <
>>>>>>>>> gouthampravi at gmail.com> a écrit :
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Tue, Oct 19, 2021 at 2:35 PM wodel youchi <
>>>>>>>>>> wodel.youchi at gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>> Has anyone been successful in deploying Manila wallaby using
>>>>>>>>>>> kolla-ansible with ceph pacific as a backend?
>>>>>>>>>>>
>>>>>>>>>>> I have created the manila client in ceph pacific like this :
>>>>>>>>>>>
>>>>>>>>>>> *ceph auth get-or-create client.manila mon 'allow r' mds 'allow
>>>>>>>>>>> r, allow rw path=/' osd 'allow rw pool=cephfs_data' mgr 'allow rw'*
>>>>>>>>>>>
>>>>>>>>>>> When I deploy, I get this error in manila's log file :
>>>>>>>>>>> Bad target type 'mon-mgr'
>>>>>>>>>>> Any ideas?
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Could you share the full log from the manila-share service?
>>>>>>>>>> There's an open bug related to manila/cephfs deployment:
>>>>>>>>>> https://bugs.launchpad.net/kolla-ansible/+bug/1935784
>>>>>>>>>> Proposed fix:
>>>>>>>>>> https://review.opendev.org/c/openstack/kolla-ansible/+/802743
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Regards.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> බුද්ධික සංජීව ගොඩාකුරු
>>>>>>>> Buddhika Sanjeewa Godakuru
>>>>>>>>
>>>>>>>> Systems Analyst/Programmer
>>>>>>>> Deputy Webmaster / University of Kelaniya
>>>>>>>>
>>>>>>>> Information and Communication Technology Centre (ICTC)
>>>>>>>> University of Kelaniya, Sri Lanka,
>>>>>>>> Kelaniya,
>>>>>>>> Sri Lanka.
>>>>>>>>
>>>>>>>> Mobile : (+94) 071 5696981
>>>>>>>> Office : (+94) 011 2903420 / 2903424
>>>>>>>>
>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>> University of Kelaniya Sri Lanka, accepts no liability for the
>>>>>>>> content of this email, or for the consequences of any actions taken on the
>>>>>>>> basis of the information provided, unless that information is subsequently
>>>>>>>> confirmed in writing. If you are not the intended recipient, this email
>>>>>>>> and/or any information it contains should not be copied, disclosed,
>>>>>>>> retained or used by you or any other party and the email and all its
>>>>>>>> contents should be promptly deleted fully from our system and the sender
>>>>>>>> informed.
>>>>>>>>
>>>>>>>> E-mail transmission cannot be guaranteed to be secure or error-free
>>>>>>>> as information could be intercepted, corrupted, lost, destroyed, arrive
>>>>>>>> late or incomplete.
>>>>>>>>
>>>>>>>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>
>>>>>>>
>>>>
>>>> --
>>>>
>>>> බුද්ධික සංජීව ගොඩාකුරු
>>>> Buddhika Sanjeewa Godakuru
>>>>
>>>> Systems Analyst/Programmer
>>>> Deputy Webmaster / University of Kelaniya
>>>>
>>>> Information and Communication Technology Centre (ICTC)
>>>> University of Kelaniya, Sri Lanka,
>>>> Kelaniya,
>>>> Sri Lanka.
>>>>
>>>> Mobile : (+94) 071 5696981
>>>> Office : (+94) 011 2903420 / 2903424
>>>>
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> University of Kelaniya Sri Lanka, accepts no liability for the content
>>>> of this email, or for the consequences of any actions taken on the basis of
>>>> the information provided, unless that information is subsequently confirmed
>>>> in writing. If you are not the intended recipient, this email and/or any
>>>> information it contains should not be copied, disclosed, retained or used
>>>> by you or any other party and the email and all its contents should be
>>>> promptly deleted fully from our system and the sender informed.
>>>>
>>>> E-mail transmission cannot be guaranteed to be secure or error-free as
>>>> information could be intercepted, corrupted, lost, destroyed, arrive late
>>>> or incomplete.
>>>>
>>>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>
>
> --
>
> බුද්ධික සංජීව ගොඩාකුරු
> Buddhika Sanjeewa Godakuru
>
> Systems Analyst/Programmer
> Deputy Webmaster / University of Kelaniya
>
> Information and Communication Technology Centre (ICTC)
> University of Kelaniya, Sri Lanka,
> Kelaniya,
> Sri Lanka.
>
> Mobile : (+94) 071 5696981
> Office : (+94) 011 2903420 / 2903424
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> University of Kelaniya Sri Lanka, accepts no liability for the content of
> this email, or for the consequences of any actions taken on the basis of
> the information provided, unless that information is subsequently confirmed
> in writing. If you are not the intended recipient, this email and/or any
> information it contains should not be copied, disclosed, retained or used
> by you or any other party and the email and all its contents should be
> promptly deleted fully from our system and the sender informed.
>
> E-mail transmission cannot be guaranteed to be secure or error-free as
> information could be intercepted, corrupted, lost, destroyed, arrive late
> or incomplete.
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20211028/5d4aad23/attachment-0001.htm>