<div dir="ltr">Hi Wodel,<div><br></div><div>A few things, can you share the specific version you are using for Ceph? You mentioned Ceph Octopus and Ceph Pacific, we need to make sure that the microversions are as follows</div><div><br></div><div>Ceph Octopus minimum version 15.2.11</div><div>Ceph Pacific minimum version 16.2.1</div><div><br></div><div>Also, can you make sure that the updates on the caps were applied?<div><br></div><div>Do this by doing "ceph auth ls" and checking the values you have for client.manila</div><div><br></div><div>The output should be similar to what you see in [0]</div><div><br></div><div>If those are ok, you would need to restart manila-share service and the issue should be resolved.</div><div><br></div><div>Regards,</div><div><br></div><div>Victoria</div><div><br></div><div>[0] <a href="https://docs.ceph.com/en/latest/rados/operations/user-management/#list-users">https://docs.ceph.com/en/latest/rados/operations/user-management/#list-users</a></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Oct 28, 2021 at 9:19 AM Buddhika Godakuru <<a href="mailto:bsanjeewa@kln.ac.lk" target="_blank">bsanjeewa@kln.ac.lk</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div>Hi Wodel,</div><div>So the issue is beyond my current understanding. <br></div><div>I am interested in this because I am planning to deploy one next month.
Unfortunately, currently I do not have hardware to deploy one and see.</div><div>Sorry couldn't be more helpful.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 28 Oct 2021 at 03:24, wodel youchi <<a href="mailto:wodel.youchi@gmail.com" target="_blank">wodel.youchi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi,</div><div><br></div><div>To <b><span role="gridcell"><span name="Buddhika Godakuru"><span>Buddhika Godakuru</span></span></span></b></div><div>I took a look into the manila-share docker deployed on my platforme and it contains the patch you mentioned in [1].</div><div>The Manila code does integrate the ceph test for version.</div><div><br></div><div>[1] <a href="https://review.opendev.org/c/openstack/manila/+/797955" target="_blank">https://review.opendev.org/c/openstack/manila/+/797955</a></div><div><br></div><div><br></div><div>Regards.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le mar. 26 oct. 2021 à 09:06, wodel youchi <<a href="mailto:wodel.youchi@gmail.com" target="_blank">wodel.youchi@gmail.com</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi,</div><div>My deployment is from source, and I have little experience on how to rebuild docker images, I can perhaps pull new images (built recently I mean).</div><div>I took a look into docker hub and there are new manila images pushed 2 days ago.<br></div><div><br></div><div></div><div>Regards.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le lun. 25 oct. 2021 à 19:23, Buddhika Godakuru <<a href="mailto:bsanjeewa@kln.ac.lk" target="_blank">bsanjeewa@kln.ac.lk</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Is your deployment type is source or binary?<div>If it is binay, I wonder if this patch [1] is built into the repos.</div><div>If source, could you try rebuilding the manila docker images?</div><div><br></div><div>[1] <a href="https://review.opendev.org/c/openstack/manila/+/797955" target="_blank">https://review.opendev.org/c/openstack/manila/+/797955</a></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, 25 Oct 2021 at 20:21, wodel youchi <<a href="mailto:wodel.youchi@gmail.com" target="_blank">wodel.youchi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="auto">Hi,</div><div dir="auto"><br><div dir="auto">I tried with pacific then with octopus, the same problem.</div><div>The patch was applied to kolla-ansible.<br></div><div dir="auto"><div dir="auto"><br></div><div dir="auto"></div><div dir="auto">Regards. </div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le ven. 22 oct. 2021 00:34, Goutham Pacha Ravi <<a href="mailto:gouthampravi@gmail.com" target="_blank">gouthampravi@gmail.com</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><br></div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Oct 21, 2021 at 1:56 AM wodel youchi <<a href="mailto:wodel.youchi@gmail.com" rel="noreferrer" target="_blank">wodel.youchi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi,</div><div><br></div><div>I did that already, I changed the keyring to "<b>ceph auth get-or-create client.manila -o manila.keyring mgr 'allow rw' mon 'allow r'</b>"<b> </b>it didn't work, then I tried with ceph octopus, same error.</div><div>I applied the patch, then I recreated the keyring for manila as wallaby documentation, I get the error "<span style="font-family:monospace"><b>Bad target type 'mon-mgr'</b></span>"</div></div></blockquote><div dir="auto"><br></div><div dir="auto">Thanks, the error seems similar to this issue: <div><a href="https://tracker.ceph.com/issues/51039" rel="noreferrer" target="_blank">https://tracker.ceph.com/issues/51039</a></div><div dir="auto"><br></div><div dir="auto">Can you confirm the ceph version installed? On the ceph side, some changes land after GA and get back ported; </div></div><div dir="auto"><br></div><div dir="auto"><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="auto"><br></div><div><b></b></div><div><br></div><div></div><div>Regards.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le jeu. 21 oct. 2021 à 05:29, Buddhika Godakuru <<a href="mailto:bsanjeewa@kln.ac.lk" rel="noreferrer" target="_blank">bsanjeewa@kln.ac.lk</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Dear Wodel,<div>I think this is because manila has changed the way how to set/create auth ID in Wallaby for native CephFS driver. </div><div>For the patch to work, you should change the command </div><div><b>ceph auth get-or-create client.manila mon 'allow r' mds 'allow r, allow rw path=/' osd 'allow rw pool=cephfs_data' mgr 'allow rw'</b></div><div>to something like,<br></div><div>ceph auth get-or-create client.manila -o manila.keyring mgr 'allow rw' mon 'allow r'<b><br></b></div><div><b><br></b>Please see Manila Wallaby CephFS Driver document [1]</div><div><br></div><div>Hope this helps.</div><div><br></div><div>Thank you<br></div> [1] <a href="https://docs.openstack.org/manila/wallaby/admin/cephfs_driver.html#authorizing-the-driver-to-communicate-with-ceph" rel="noreferrer" target="_blank">https://docs.openstack.org/manila/wallaby/admin/cephfs_driver.html#authorizing-the-driver-to-communicate-with-ceph</a></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 20 Oct 2021 at 23:19, wodel youchi <<a href="mailto:wodel.youchi@gmail.com" rel="noreferrer" target="_blank">wodel.youchi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi, and thanks <br></div><div><br></div><div>I tried to apply the patch, but it didn't work, this is the manila-share.log.</div><div>By the way, I did change to caps for the manila client to what is said in wallaby documentation, that is :</div><div><span style="font-family:monospace"><span style="color:rgb(0,0,0);background-color:rgb(255,255,255)">[client.manila]
</span><br> key = keyyyyyyyy.....
<br> <b> caps mgr = "allow rw"
<br> caps mon = "allow r"</b><br></span></div><div><br></div><div><span style="font-family:monospace"><span style="color:rgb(0,0,0);background-color:rgb(255,255,255)">[root@ControllerA manila]# cat manila-share.log </span><br>2021-10-20 10:03:22.286 7 INFO oslo_service.periodic_task [-] Skipping periodic task update_share_usage_size because it is disabled
<br>......<br>2021-10-20 10:11:50.596 30 ERROR manila.share.manager raise exception.ShareBackendException(msg)
<br>2021-10-20 10:11:50.596 30 ERROR manila.share.manager manila.exception.ShareBackendException: json_command failed - prefix=fs volume <br>ls, argdict={'format': 'json'} - exception message: Bad target type 'mon-mgr'.
<br>2021-10-20 10:11:50.596 30 ERROR manila.share.manager<br></span></div><div><br></div><div>Regards<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le mer. 20 oct. 2021 à 00:14, Goutham Pacha Ravi <<a href="mailto:gouthampravi@gmail.com" rel="noreferrer" target="_blank">gouthampravi@gmail.com</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Oct 19, 2021 at 2:35 PM wodel youchi <<a href="mailto:wodel.youchi@gmail.com" rel="noreferrer" target="_blank">wodel.youchi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi,</div><div>Has anyone been successful in deploying Manila wallaby using kolla-ansible with ceph pacific as a backend?<br></div><div><br></div><div>I have created the manila client in ceph pacific like this :</div><div><br></div><div><b>ceph auth get-or-create client.manila mon 'allow r' mds 'allow r, allow rw path=/' osd 'allow rw pool=cephfs_data' mgr 'allow rw'</b></div><div><br></div><div>When I deploy, I get this error in manila's log file :</div><div><h3><font size="2">Bad target type 'mon-mgr'</font></h3></div><div>Any ideas?</div></div></blockquote><div><br></div><div>Could you share the full log from the manila-share service? </div><div>There's an open bug related to manila/cephfs deployment: <a href="https://bugs.launchpad.net/kolla-ansible/+bug/1935784" rel="noreferrer" target="_blank">https://bugs.launchpad.net/kolla-ansible/+bug/1935784</a> </div><div>Proposed fix: <a href="https://review.opendev.org/c/openstack/kolla-ansible/+/802743" rel="noreferrer" target="_blank">https://review.opendev.org/c/openstack/kolla-ansible/+/802743</a></div><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>Regards.<br></div></div>
</blockquote></div></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><br></div><div>බුද්ධික සංජීව ගොඩාකුරු </div><div>Buddhika Sanjeewa Godakuru </div><div><br></div><div>Systems Analyst/Programmer </div><div>Deputy Webmaster / University of Kelaniya</div><div><br></div><div>Information and Communication Technology Centre (ICTC) </div><div>University of Kelaniya, Sri Lanka, </div><div>Kelaniya, </div><div>Sri Lanka. </div><div><br></div><div>Mobile : (+94) 071 5696981 </div><div>Office : (+94) 011 2903420 / 2903424 </div></div></div></div></div>
<br>
<div><font size="2">++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ </font></div><span style="font-size:1.3em">University of Kelaniya Sri Lanka, accepts no liability for the
content of this email, or for the consequences of any actions taken on
the basis of the information provided, unless that information is
subsequently confirmed in writing. If you are not the intended
recipient, this email and/or any information it contains should not be
copied, disclosed, retained or used by you or any other party and the
email and all its contents should be promptly deleted fully from our
system and the sender informed.
</span><br>
<br><span style="font-size:1.3em">E-mail transmission cannot be guaranteed to be secure or error-free
as information could be intercepted, corrupted, lost, destroyed, arrive
late or incomplete.
</span><br>
<br><span style="font-size:1.3em">++++++++++++++++++++++++++++++</span><span style="font-size:1.3em">++++++++++++++++++++++++++++++</span><span style="font-size:1.3em">+
</span><br>
</blockquote></div>
</blockquote></div></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><br></div><div>බුද්ධික සංජීව ගොඩාකුරු </div><div>Buddhika Sanjeewa Godakuru </div><div><br></div><div>Systems Analyst/Programmer </div><div>Deputy Webmaster / University of Kelaniya</div><div><br></div><div>Information and Communication Technology Centre (ICTC) </div><div>University of Kelaniya, Sri Lanka, </div><div>Kelaniya, </div><div>Sri Lanka. </div><div><br></div><div>Mobile : (+94) 071 5696981 </div><div>Office : (+94) 011 2903420 / 2903424 </div></div></div></div></div>
<br>
<div><font size="2">++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ </font></div><span style="font-size:1.3em">University of Kelaniya Sri Lanka, accepts no liability for the
content of this email, or for the consequences of any actions taken on
the basis of the information provided, unless that information is
subsequently confirmed in writing. If you are not the intended
recipient, this email and/or any information it contains should not be
copied, disclosed, retained or used by you or any other party and the
email and all its contents should be promptly deleted fully from our
system and the sender informed.
</span><br>
<br><span style="font-size:1.3em">E-mail transmission cannot be guaranteed to be secure or error-free
as information could be intercepted, corrupted, lost, destroyed, arrive
late or incomplete.
</span><br>
<br><span style="font-size:1.3em">++++++++++++++++++++++++++++++</span><span style="font-size:1.3em">++++++++++++++++++++++++++++++</span><span style="font-size:1.3em">+
</span><br>
</blockquote></div>
</blockquote></div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><br></div><div>බුද්ධික සංජීව ගොඩාකුරු </div><div>Buddhika Sanjeewa Godakuru </div><div><br></div><div>Systems Analyst/Programmer </div><div>Deputy Webmaster / University of Kelaniya</div><div><br></div><div>Information and Communication Technology Centre (ICTC) </div><div>University of Kelaniya, Sri Lanka, </div><div>Kelaniya, </div><div>Sri Lanka. </div><div><br></div><div>Mobile : (+94) 071 5696981 </div><div>Office : (+94) 011 2903420 / 2903424 </div></div></div></div></div></div>
<br>
<div><font size="2">++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ </font></div><span style="font-size:1.3em">University of Kelaniya Sri Lanka, accepts no liability for the
content of this email, or for the consequences of any actions taken on
the basis of the information provided, unless that information is
subsequently confirmed in writing. If you are not the intended
recipient, this email and/or any information it contains should not be
copied, disclosed, retained or used by you or any other party and the
email and all its contents should be promptly deleted fully from our
system and the sender informed.
</span><br>
<br><span style="font-size:1.3em">E-mail transmission cannot be guaranteed to be secure or error-free
as information could be intercepted, corrupted, lost, destroyed, arrive
late or incomplete.
</span><br>
<br><span style="font-size:1.3em">++++++++++++++++++++++++++++++</span><span style="font-size:1.3em">++++++++++++++++++++++++++++++</span><span style="font-size:1.3em">+
</span><br>
</blockquote></div>