<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hi Tony,</p>
<p>Firstly, please reminder me what's your Magnum version. I would
suggest use stable/victoria or at least stable/train. As for the
output you posted:</p>
<pre style="margin: 0px; padding: 5px 0px; font-family: "Bitstream Vera Sans Mono", monospace; font-size: 13px; color: rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;">| eaccb23e-226b-4a36-a2a5-5b9d9bbb4fea | delta-23-cluster-p4khbhat4sgp-node-2 | ACTIVE | private=10.0.0.250, 192.168.20.71 | Fedora-Atomic-27 | kube_node_10gb |
| c7d42436-7c27-4a11-897e-d09eb716e9b9 | delta-23-cluster-p4khbhat4sgp-node-0 | ACTIVE | private=10.0.0.88, 192.168.20.52 | Fedora-Atomic-27 | kube_node_10gb |</pre>
<p>Given you can still see the image name from the OpenStack
instance list command, that means the config "boot_volume_size =
10" is not being used for some reasons. In other words, I think
I'm confident that the config should resolve your local disk
consuming issue. But there is another issue which is preventing it
works.<br>
</p>
<p><br>
</p>
<div class="moz-cite-prefix">On 16/09/20 12:58 am, Tony Pearce
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAK1+d=7HowEfP-TzU_aLrQ678o0aQkUXNpE0V3mFVxxaK-vsAw@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="auto">Hi Ionut, thank you for your reply. Do you know if
this configuration prevents consuming of local disk on the
compute node for instance storage eg OS or swap etc?
<div dir="auto"><br>
</div>
<div dir="auto">Kind regards</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Tue, 15 Sep 2020, 20:53
Ionut Biru, <<a href="mailto:ionut@fleio.com"
moz-do-not-send="true">ionut@fleio.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi,
<div><br>
</div>
<div>To boot minions or master from volume, I use the
following labels:</div>
<div><br>
</div>
<div>boot_volume_size = 20 </div>
<div>boot_volume_type = ssd </div>
<div>availability_zone = nova <br>
</div>
<div><br>
</div>
<div>volume type and zone might differ on your setup.</div>
<div><br>
</div>
<div> <br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Tue, Sep 15, 2020 at
11:23 AM Tony Pearce <<a
href="mailto:tonyppe@gmail.com" target="_blank"
rel="noreferrer" moz-do-not-send="true">tonyppe@gmail.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Hi
Feilong, I hope you are keeping well. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Thank
you for sticking with me on this issue to
try and help me here. I really appreciate
it! <br>
<br>
I tried creating a new flavour like you
suggested and using 10GB for root volume
[1]. The cluster does start to be created
(no error about 0mb disk) but while being
created, I can check the compute node and
see that the instance disk is being
provisioned on the compute node [2]. I
assume that this is the 10GB root volume
that is specified in the flavour. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">When
I list the volumes which have been created,
I do not see the 10GB disk allocated on the
compute node, but I do see the iSCSI network
volume that has been created and attached to
the instance (eg master) [3]. This is 15GB
volume and this 15GB is coming from the
kubernetes cluster template, under "Docker
Volume Size (GB)" in the "node spec"
section. There is very little data written
to this volume at the time of master
instance booted. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Eventually,
kube cluster failed to create with error
"Status</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Create_Failed:
Resource CREATE failed: Error:
resources.kube_minions.resources[0].resources.node_config_deployment:
Deployment to server failed:
deploy_status_code: Deployment exited with
non-zero status code: 1". I'll try and find
the root cause of this later. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">What
are your thoughts on this outcome? Is it
possible to avoid consuming compute node
disk? I require it because it cannot scale.</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">[1] <a
href="http://paste.openstack.org/show/797862/"
style="font-family:Arial,Helvetica,sans-serif"
target="_blank" rel="noreferrer"
moz-do-not-send="true">http://paste.openstack.org/show/797862/</a></div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">[2] <a
href="http://paste.openstack.org/show/797865/"
style="font-family:Arial,Helvetica,sans-serif"
target="_blank" rel="noreferrer"
moz-do-not-send="true">http://paste.openstack.org/show/797865/</a></div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">[3] <a
href="http://paste.openstack.org/show/797863/"
style="font-family:Arial,Helvetica,sans-serif"
target="_blank" rel="noreferrer"
moz-do-not-send="true">http://paste.openstack.org/show/797863/</a></div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Kind
regards,</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Tony</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div>
<div dir="ltr">
<div dir="ltr">Tony Pearce<br>
<br>
</div>
</div>
</div>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Mon, 14 Sep 2020 at
17:44, feilong <<a
href="mailto:feilong@catalyst.net.nz"
target="_blank" rel="noreferrer"
moz-do-not-send="true">feilong@catalyst.net.nz</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px
0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div>
<p>Hi Tony,</p>
<p>Does your Magnum support this config <a
href="https://github.com/openstack/magnum/blob/master/magnum/conf/cinder.py#L47"
target="_blank" rel="noreferrer"
moz-do-not-send="true">https://github.com/openstack/magnum/blob/master/magnum/conf/cinder.py#L47</a>
can you try to change it from 0 to 10? 10 means
the root disk volume size for the k8s node. By
default the 0 means the node will be based on
image instead of volume. <br>
</p>
<p><br>
</p>
<div>On 14/09/20 9:37 pm, Tony Pearce wrote:<br>
</div>
<blockquote type="cite">
<div dir="auto">Hi Feilong, sure. The flavour I
used has 2 CPU and 2GB memory. All other values
either unset or 0mb.
<div dir="auto">I also used the same fedora 27
image that is being used for the kubernetes
cluster. </div>
<div dir="auto"><br>
</div>
<div dir="auto">Thank you</div>
<div dir="auto">Tony</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Mon, 14 Sep
2020, 17:20 feilong, <<a
href="mailto:feilong@catalyst.net.nz"
target="_blank" rel="noreferrer"
moz-do-not-send="true">feilong@catalyst.net.nz</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div>
<p>Hi Tony,</p>
<p>Could you please let me know your flavor
details? I would like to test it in my
devstack environment (based on LVM).
Thanks.</p>
<p><br>
</p>
<div>On 14/09/20 8:27 pm, Tony Pearce wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Hi feilong,
hope you are keeping well. Thank you
for the info! </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">For
issue 1. Maybe this should be with
the kayobe/kolla-ansible team.
Thanks for the insight :) </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">For
the 2nd one, I was able to run the
HOT template in your link. There's
no issues at all running that
multiple times concurrently while
using the 0MB disk flavour. I tried
four times with the last three
executing one after the other so
that they ran parallelly. All were
successful and completed and did not
complain about the 0MB disk issue. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Does
this conclude that the error and
create-failed issue relates to
Magnum or could you suggest other
steps to test on my side? </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Best
regards,</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><span
style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif">Tony
Pearce</span><br>
</div>
<div>
<div dir="ltr">
<div dir="ltr"><br>
<br>
</div>
</div>
</div>
<br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On
Thu, 10 Sep 2020 at 16:01, feilong
<<a
href="mailto:feilong@catalyst.net.nz"
rel="noreferrer noreferrer"
target="_blank"
moz-do-not-send="true">feilong@catalyst.net.nz</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div>
<p>Hi Tony,</p>
<p>Sorry for the late response for
your thread. <br>
</p>
<p>For you HTTPS issue, we (Catalyst
Cloud) are using Magnum with HTTPS
and it works.<br>
</p>
<p>For the 2nd issue, I think we
were misunderstanding the nodes
disk capacity. I was assuming
you're talking about the k8s
nodes, but seems you're talking
about the physical compute host. I
still don't think it's a Magnum
issue because a k8s master/worker
nodes are just normal Nova
instances and managed by Heat. So
I would suggest you use a simple
HOT to test it, you can use this <a
href="https://gist.github.com/openstacker/26e31c9715d52cc502397b65d3cebab6"
rel="noreferrer noreferrer"
target="_blank"
moz-do-not-send="true">https://gist.github.com/openstacker/26e31c9715d52cc502397b65d3cebab6</a></p>
<p>Most of the cloud providers or
organizations who have adopted
Magnum are using Ceph as far as I
know, just FYI.</p>
<p><br>
</p>
<div>On 10/09/20 4:35 pm, Tony
Pearce wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Hi
all, hope you are all keeping
safe and well. I am looking
for information on the
following two issues that I
have which surrounds Magnum
project:</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">1.
Magnum does not support
Openstack API with HTTPS</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">2.
Magnum forces compute nodes to
consume disk capacity for
instance data<br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">My
environment: Openstack Train
deployed using Kayobe
(Kolla-ansible). </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">With
regards to the HTTPS issue,
Magnum stops working after
enabling HTTPS because the
certificate / CA certificate
is not trusted by Magnum. The
certificate which I am using
is one that was purchased from
GoDaddy and is trusted in web
browsers (and is valid), just
not trusted by the Magnum
component. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Regarding
compute node disk consumption
issue - I'm at a loss with
regards to this and so I'm
looking for more information
about why this is being done
and is there any way that I
could avoid it? I have
storage provided by a Cinder
integration and so the
consumption of compute node
disk for instance data I need
to avoid. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Any
information the community
could provide to me with
regards to the above would be
much appreciated. I would very
much like to use the Magnum
project in this deployment for
Kubernetes deployment within
projects. </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Thanks
in advance, </div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Regards,</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)"><br>
</div>
<div class="gmail_default"
style="font-family:verdana,sans-serif;color:rgb(102,102,102)">Tony</div>
</div>
</blockquote>
<pre cols="72">--
Cheers & Best regards,
Feilong Wang (王飞龙)
------------------------------------------------------
Senior Cloud Software Engineer
Tel: +64-48032246
Email: <a href="mailto:flwang@catalyst.net.nz" rel="noreferrer noreferrer" target="_blank" moz-do-not-send="true">flwang@catalyst.net.nz</a>
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
------------------------------------------------------ </pre>
</div>
</blockquote>
</div>
</blockquote>
<pre cols="72">--
Cheers & Best regards,
Feilong Wang (王飞龙)
------------------------------------------------------
Senior Cloud Software Engineer
Tel: +64-48032246
Email: <a href="mailto:flwang@catalyst.net.nz" rel="noreferrer noreferrer" target="_blank" moz-do-not-send="true">flwang@catalyst.net.nz</a>
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
------------------------------------------------------ </pre>
</div>
</blockquote>
</div>
</blockquote>
<pre cols="72">--
Cheers & Best regards,
Feilong Wang (王飞龙)
------------------------------------------------------
Senior Cloud Software Engineer
Tel: +64-48032246
Email: <a href="mailto:flwang@catalyst.net.nz" target="_blank" rel="noreferrer" moz-do-not-send="true">flwang@catalyst.net.nz</a>
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
------------------------------------------------------ </pre>
</div>
</blockquote>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr">
<div dir="ltr">Ionut Biru - <a href="https://fleio.com"
target="_blank" rel="noreferrer" moz-do-not-send="true">https://fleio.com</a><br>
</div>
</div>
</blockquote>
</div>
</blockquote>
<pre class="moz-signature" cols="72">--
Cheers & Best regards,
Feilong Wang (王飞龙)
------------------------------------------------------
Senior Cloud Software Engineer
Tel: +64-48032246
Email: <a class="moz-txt-link-abbreviated" href="mailto:flwang@catalyst.net.nz">flwang@catalyst.net.nz</a>
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
------------------------------------------------------ </pre>
</body>
</html>