Open Stack

Hi,

Here is the version of ceph :
# docker exec -it ceph-mon-controllera ceph -v
*ceph version 16.2.5* (0883bdea7337b95e4b611c768c0279868462204a) pacific
(stable)

And here is the output of the "ceph auth ls" for client.manila :

client.manila
       key: AQCgR3lhcAZ8JxAFtr5dK+eWtXcgtPd1WUbPjw==

*       caps: [mgr] allow rw        caps: [mon] allow r*





Regards.

Le jeu. 28 oct. 2021 à 17:10, Victoria Martínez de la Cruz <
victoria at vmartinezdelacruz.com> a écrit :

> Hi Wodel,
>
> A few things, can you share the specific version you are using for Ceph?
> You mentioned Ceph Octopus and Ceph Pacific, we need to make sure that the
> microversions are as follows
>
> Ceph Octopus minimum version 15.2.11
> Ceph Pacific minimum version 16.2.1
>
> Also, can you make sure that the updates on the caps were applied?
>
> Do this by doing "ceph auth ls" and checking the values you have for
> client.manila
>
> The output should be similar to what you see in [0]
>
> If those are ok, you would need to restart manila-share service and the
> issue should be resolved.
>
> Regards,
>
> Victoria
>
> [0]
> https://docs.ceph.com/en/latest/rados/operations/user-management/#list-users
>
> On Thu, Oct 28, 2021 at 9:19 AM Buddhika Godakuru <bsanjeewa at kln.ac.lk>
> wrote:
>
>> Hi Wodel,
>> So the issue is beyond my current understanding.
>> I am interested in this because I am planning to deploy one next month.
>> Unfortunately, currently I do not have hardware to deploy one and see.
>> Sorry couldn't be more helpful.
>>
>> On Thu, 28 Oct 2021 at 03:24, wodel youchi <wodel.youchi at gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> To *Buddhika Godakuru*
>>> I took a look into the manila-share docker deployed on my platforme and
>>> it contains the patch you mentioned in [1].
>>> The Manila code does integrate the ceph test for version.
>>>
>>> [1] https://review.opendev.org/c/openstack/manila/+/797955
>>>
>>>
>>> Regards.
>>>
>>> Le mar. 26 oct. 2021 à 09:06, wodel youchi <wodel.youchi at gmail.com> a
>>> écrit :
>>>
>>>> Hi,
>>>> My deployment is from source, and I have little experience on how to
>>>> rebuild docker images, I can perhaps pull new images (built recently I
>>>> mean).
>>>> I took a look into docker hub and there are new manila images pushed 2
>>>> days ago.
>>>>
>>>> Regards.
>>>>
>>>> Le lun. 25 oct. 2021 à 19:23, Buddhika Godakuru <bsanjeewa at kln.ac.lk>
>>>> a écrit :
>>>>
>>>>> Is your deployment type is source or binary?
>>>>> If it is binay, I wonder if this patch [1] is built into the repos.
>>>>> If source, could you try rebuilding the manila docker images?
>>>>>
>>>>> [1] https://review.opendev.org/c/openstack/manila/+/797955
>>>>>
>>>>> On Mon, 25 Oct 2021 at 20:21, wodel youchi <wodel.youchi at gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I tried with pacific then with octopus, the same problem.
>>>>>> The patch was applied to kolla-ansible.
>>>>>>
>>>>>> Regards.
>>>>>>
>>>>>> Le ven. 22 oct. 2021 00:34, Goutham Pacha Ravi <
>>>>>> gouthampravi at gmail.com> a écrit :
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Oct 21, 2021 at 1:56 AM wodel youchi <wodel.youchi at gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I did that already, I changed the keyring to "*ceph auth
>>>>>>>> get-or-create client.manila -o manila.keyring mgr 'allow rw' mon 'allow r'*
>>>>>>>> " it didn't work, then I tried with ceph octopus, same error.
>>>>>>>> I applied the patch, then I recreated the keyring for manila as
>>>>>>>> wallaby documentation, I get the error "*Bad target type 'mon-mgr'*
>>>>>>>> "
>>>>>>>>
>>>>>>>
>>>>>>> Thanks, the error seems similar to this issue:
>>>>>>> https://tracker.ceph.com/issues/51039
>>>>>>>
>>>>>>> Can you confirm the ceph version installed? On the ceph side, some
>>>>>>> changes land after GA and get back ported;
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>> Le jeu. 21 oct. 2021 à 05:29, Buddhika Godakuru <
>>>>>>>> bsanjeewa at kln.ac.lk> a écrit :
>>>>>>>>
>>>>>>>>> Dear Wodel,
>>>>>>>>> I think this is because manila has changed the way how to
>>>>>>>>> set/create auth ID in Wallaby for native CephFS driver.
>>>>>>>>> For the patch to work, you should change the command
>>>>>>>>> *ceph auth get-or-create client.manila mon 'allow r' mds 'allow r,
>>>>>>>>> allow rw path=/' osd 'allow rw pool=cephfs_data' mgr 'allow rw'*
>>>>>>>>> to something like,
>>>>>>>>> ceph auth get-or-create client.manila -o manila.keyring mgr 'allow
>>>>>>>>> rw' mon 'allow r'
>>>>>>>>>
>>>>>>>>> Please see Manila Wallaby CephFS Driver document [1]
>>>>>>>>>
>>>>>>>>> Hope this helps.
>>>>>>>>>
>>>>>>>>> Thank you
>>>>>>>>>  [1]
>>>>>>>>> https://docs.openstack.org/manila/wallaby/admin/cephfs_driver.html#authorizing-the-driver-to-communicate-with-ceph
>>>>>>>>>
>>>>>>>>> On Wed, 20 Oct 2021 at 23:19, wodel youchi <wodel.youchi at gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi, and thanks
>>>>>>>>>>
>>>>>>>>>> I tried to apply the patch, but it didn't work, this is the
>>>>>>>>>> manila-share.log.
>>>>>>>>>> By the way, I did change to caps for the manila client to what is
>>>>>>>>>> said in wallaby documentation, that is :
>>>>>>>>>> [client.manila]
>>>>>>>>>>        key = keyyyyyyyy.....
>>>>>>>>>>
>>>>>>>>>> *       caps mgr = "allow rw"        caps mon = "allow r"*
>>>>>>>>>>
>>>>>>>>>> [root at ControllerA manila]# cat manila-share.log
>>>>>>>>>> 2021-10-20 10:03:22.286 7 INFO oslo_service.periodic_task [-]
>>>>>>>>>> Skipping periodic task update_share_usage_size because it is disabled
>>>>>>>>>> ......
>>>>>>>>>> 2021-10-20 10:11:50.596 30 ERROR manila.share.manager     raise
>>>>>>>>>> exception.ShareBackendException(msg)
>>>>>>>>>> 2021-10-20 10:11:50.596 30 ERROR manila.share.manager
>>>>>>>>>> manila.exception.ShareBackendException: json_command failed - prefix=fs
>>>>>>>>>> volume
>>>>>>>>>> ls, argdict={'format': 'json'} - exception message: Bad target
>>>>>>>>>> type 'mon-mgr'.
>>>>>>>>>> 2021-10-20 10:11:50.596 30 ERROR manila.share.manager
>>>>>>>>>>
>>>>>>>>>> Regards
>>>>>>>>>>
>>>>>>>>>> Le mer. 20 oct. 2021 à 00:14, Goutham Pacha Ravi <
>>>>>>>>>> gouthampravi at gmail.com> a écrit :
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Oct 19, 2021 at 2:35 PM wodel youchi <
>>>>>>>>>>> wodel.youchi at gmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> Has anyone been successful in deploying Manila wallaby using
>>>>>>>>>>>> kolla-ansible with ceph pacific as a backend?
>>>>>>>>>>>>
>>>>>>>>>>>> I have created the manila client in ceph pacific like this :
>>>>>>>>>>>>
>>>>>>>>>>>> *ceph auth get-or-create client.manila mon 'allow r' mds 'allow
>>>>>>>>>>>> r, allow rw path=/' osd 'allow rw pool=cephfs_data' mgr 'allow rw'*
>>>>>>>>>>>>
>>>>>>>>>>>> When I deploy, I get this error in manila's log file :
>>>>>>>>>>>> Bad target type 'mon-mgr'
>>>>>>>>>>>> Any ideas?
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Could you share the full log from the manila-share service?
>>>>>>>>>>> There's an open bug related to manila/cephfs deployment:
>>>>>>>>>>> https://bugs.launchpad.net/kolla-ansible/+bug/1935784
>>>>>>>>>>> Proposed fix:
>>>>>>>>>>> https://review.opendev.org/c/openstack/kolla-ansible/+/802743
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Regards.
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> බුද්ධික සංජීව ගොඩාකුරු
>>>>>>>>> Buddhika Sanjeewa Godakuru
>>>>>>>>>
>>>>>>>>> Systems Analyst/Programmer
>>>>>>>>> Deputy Webmaster / University of Kelaniya
>>>>>>>>>
>>>>>>>>> Information and Communication Technology Centre (ICTC)
>>>>>>>>> University of Kelaniya, Sri Lanka,
>>>>>>>>> Kelaniya,
>>>>>>>>> Sri Lanka.
>>>>>>>>>
>>>>>>>>> Mobile : (+94) 071 5696981
>>>>>>>>> Office : (+94) 011 2903420 / 2903424
>>>>>>>>>
>>>>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>> University of Kelaniya Sri Lanka, accepts no liability for the
>>>>>>>>> content of this email, or for the consequences of any actions taken on the
>>>>>>>>> basis of the information provided, unless that information is subsequently
>>>>>>>>> confirmed in writing. If you are not the intended recipient, this email
>>>>>>>>> and/or any information it contains should not be copied, disclosed,
>>>>>>>>> retained or used by you or any other party and the email and all its
>>>>>>>>> contents should be promptly deleted fully from our system and the sender
>>>>>>>>> informed.
>>>>>>>>>
>>>>>>>>> E-mail transmission cannot be guaranteed to be secure or
>>>>>>>>> error-free as information could be intercepted, corrupted, lost, destroyed,
>>>>>>>>> arrive late or incomplete.
>>>>>>>>>
>>>>>>>>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>>>>>
>>>>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> බුද්ධික සංජීව ගොඩාකුරු
>>>>> Buddhika Sanjeewa Godakuru
>>>>>
>>>>> Systems Analyst/Programmer
>>>>> Deputy Webmaster / University of Kelaniya
>>>>>
>>>>> Information and Communication Technology Centre (ICTC)
>>>>> University of Kelaniya, Sri Lanka,
>>>>> Kelaniya,
>>>>> Sri Lanka.
>>>>>
>>>>> Mobile : (+94) 071 5696981
>>>>> Office : (+94) 011 2903420 / 2903424
>>>>>
>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>> University of Kelaniya Sri Lanka, accepts no liability for the content
>>>>> of this email, or for the consequences of any actions taken on the basis of
>>>>> the information provided, unless that information is subsequently confirmed
>>>>> in writing. If you are not the intended recipient, this email and/or any
>>>>> information it contains should not be copied, disclosed, retained or used
>>>>> by you or any other party and the email and all its contents should be
>>>>> promptly deleted fully from our system and the sender informed.
>>>>>
>>>>> E-mail transmission cannot be guaranteed to be secure or error-free as
>>>>> information could be intercepted, corrupted, lost, destroyed, arrive late
>>>>> or incomplete.
>>>>>
>>>>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>
>>>>
>>
>> --
>>
>> බුද්ධික සංජීව ගොඩාකුරු
>> Buddhika Sanjeewa Godakuru
>>
>> Systems Analyst/Programmer
>> Deputy Webmaster / University of Kelaniya
>>
>> Information and Communication Technology Centre (ICTC)
>> University of Kelaniya, Sri Lanka,
>> Kelaniya,
>> Sri Lanka.
>>
>> Mobile : (+94) 071 5696981
>> Office : (+94) 011 2903420 / 2903424
>>
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> University of Kelaniya Sri Lanka, accepts no liability for the content of
>> this email, or for the consequences of any actions taken on the basis of
>> the information provided, unless that information is subsequently confirmed
>> in writing. If you are not the intended recipient, this email and/or any
>> information it contains should not be copied, disclosed, retained or used
>> by you or any other party and the email and all its contents should be
>> promptly deleted fully from our system and the sender informed.
>>
>> E-mail transmission cannot be guaranteed to be secure or error-free as
>> information could be intercepted, corrupted, lost, destroyed, arrive late
>> or incomplete.
>>
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20211030/5eb8bea3/attachment-0001.htm>