[magnum]: K8s cluster creation times out. OpenStack Train : [ERROR]: Unable to render networking. Network config is likely broken

feilong feilong at catalyst.net.nz
Wed Jan 15 20:45:36 UTC 2020


Hi Bhupathi,

Please read https://docs.openstack.org/magnum/latest/user/#use-podman
When you're using Fedora CoreOS driver, you have to use the
use_podman=True, because in Magnum Fedora CoreOS driver, podman is the
only option. Please take my devstack cluster template as a reference.

feilong at feilong-pc:~$ occt show c5ed303d-d255-45e8-8efb-bffac97f852c
+-----------------------+-------------------------------------------------------------------------------------------------------------------------+
| Field                 |
Value                                                                                                                  
|
+-----------------------+-------------------------------------------------------------------------------------------------------------------------+
| insecure_registry     |
-                                                                                                                      
|
| labels                | {u'use_podman': u'true', u'kube_tag':
u'v1.16.4', u'etcd_tag': u'3.2.26', u'heat_container_agent_tag':
u'train-stable'} |
| updated_at            |
2020-01-06T23:14:12+00:00                                                                                              
|
| floating_ip_enabled   |
True                                                                                                                   
|
| fixed_subnet          |
-                                                                                                                      
|
| master_flavor_id      |
ds2G                                                                                                                   
|
| uuid                  |
c5ed303d-d255-45e8-8efb-bffac97f852c                                                                                   
|
| no_proxy              |
-                                                                                                                      
|
| https_proxy           |
-                                                                                                                      
|
| tls_disabled          |
False                                                                                                                  
|
| keypair_id            |
feilong                                                                                                                
|
| public                |
False                                                                                                                  
|
| http_proxy            |
-                                                                                                                      
|
| docker_volume_size    |
-                                                                                                                      
|
| server_type           |
vm                                                                                                                     
|
| external_network_id   |
public                                                                                                                 
|
| cluster_distro        |
fedora-coreos                                                                                                          
|
| image_id              |
c089d627-0265-4cbc-8c96-957eb529b024                                                                                   
|
| volume_driver         |
-                                                                                                                      
|
| registry_enabled      |
False                                                                                                                  
|
| docker_storage_driver |
overlay2                                                                                                               
|
| apiserver_port        |
-                                                                                                                      
|
| name                  |
k8s-fc31-v1.16.4                                                                                                       
|
| created_at            |
2020-01-05T22:26:41+00:00                                                                                              
|
| network_driver        |
calico                                                                                                                 
|
| fixed_network         |
-                                                                                                                      
|
| coe                   |
kubernetes                                                                                                             
|
| flavor_id             |
ds1G                                                                                                                   
|
| master_lb_enabled     |
False                                                                                                                  
|
| dns_nameserver        |
8.8.8.8                                                                                                                
|
| hidden                |
False                                                                                                                  
|
+-----------------------+-------------------------------------------------------------------------------------------------------------------------+


On 16/01/20 8:09 AM, Bhupathi, Ramakrishna wrote:
>
> Donny,
>
> Yes. Here it is. Cluster-template info as well as the Image info.
>
>  
>
>  
>
> magnum cluster-template-show kt-coreOS
>
> +-----------------------+--------------------------------------+
>
> | Property              | Value                                |
>
> +-----------------------+--------------------------------------+
>
> | insecure_registry     | -                                    |
>
> | http_proxy            | -                                    |
>
> | updated_at            | 2020-01-15T19:05:56+00:00            |
>
> | floating_ip_enabled   | True                                 |
>
> | fixed_subnet          | -                                    |
>
> | master_flavor_id      | -                                    |
>
> | user_id               | 8d22ae284924432ba026e8a6236bc52e     |
>
> | uuid                  | 6aea495e-6d8d-420b-8ca3-6e7fed73f3c7 |
>
> | no_proxy              | -                                    |
>
> | https_proxy           | -                                    |
>
> | tls_disabled          | True                                 |
>
> | keypair_id            | ramak-test                           |
>
> | hidden                | False                                |
>
> | project_id            | 0c1abff4e920448ba86638bd0d78f7ca     |
>
> | public                | False                                |
>
> | labels                | {'use_podman': 'false', '            |
>
> |                       | kube_tag': 'v1.16.2'}                |
>
> | docker_volume_size    | 5                                    |
>
> | server_type           | vm                                   |
>
> | external_network_id   | thunder-public-vlan280         |
>
> | cluster_distro        | coreos                               |
>
> | image_id              | b1354e4e-8281-4330-a4b2-b5fdb022f805 |
>
> | volume_driver         | -                                    |
>
> | registry_enabled      | False                                |
>
> | docker_storage_driver | devicemapper                         |
>
> | apiserver_port        | -                                    |
>
> | name                  | kt-coreOS                            |
>
> | created_at            | 2020-01-14T20:32:04+00:00            |
>
> | network_driver        | flannel                              |
>
> | fixed_network         | -                                    |
>
> | coe                   | kubernetes                           |
>
> | flavor_id             | kuber-node                           |
>
> | master_lb_enabled     | False                                |
>
> | dns_nameserver        | 8.8.8.8                              |
>
> +-----------------------+--------------------------------------+
>
>  
>
> ubuntu at kolla-ubuntu:~$ glance image-show 
> 2fa8b3d8-c2e5-4568-9340-a18dd3d3120a
>
> +------------------+----------------------------------------------------------------------------------+
>
> | Property         |
> Value                                                                           
> |
>
> +------------------+----------------------------------------------------------------------------------+
>
> | checksum         |
> cfbdc70bde5cd7df73a05a0fdc8e806c                                                
> |
>
> | container_format |
> bare                                                                            
> |
>
> | created_at       |
> 2020-01-14T14:53:01Z                                                            
> |
>
> | disk_format      |
> qcow2                                                                           
> |
>
> | id               |
> 2fa8b3d8-c2e5-4568-9340-a18dd3d3120a                         
>                    |
>
> | locations        | [{"url":
> "rbd://8c7d79a9-1275-4487-8ed0-6ea1fedccbef/images/2fa8b3d8-c2e5-4568-9 |
>
> |                  | 340-a18dd3d3120a/snap", "metadata":
> {}}]                                         |
>
> | min_disk         | 0    
>                                                                            |
>
> | min_ram          |
> 0                                                                               
> |
>
> | name             |
> coreOS-latest                                        
>                            |
>
> | os_distro        |
> coreos                                                                          
> |
>
> | os_hash_algo     |
> sha512                                                                          
> |
>
> | os_hash_value    |
> e6c4ce2e3e9dac4606f0edf689erf8782f99e249cc07887f620db69c9b91631301b480086c0e
> |
>
> |                  |
> 8ef5f42f4909b3fc3ef110e0erwff2922c0ca6a665dd11c57a                                
> |
>
> | os_hidden        | False                                        
>                                    |
>
> | owner            |
> 0c1abff4e920448ba86638bd0d78f7ca                                                
> |
>
> | protected        |
> False                                                                           
> |
>
> | size             |
> 1068171264                                                                      
> |
>
> | status           |
> active                                                                          
> |
>
> | tags             |
> []                                                                              
> |
>
> | updated_at       |
> 2020-01-14T14:53:39Z                                                            
> |
>
> | virtual_size     | None                      
>                                                       |
>
> | visibility       |
> public                                                                          
> |
>
> +------------------+----------------------------------------------------------------------------------+
>
>  
>
> --RamaK
>
>  
>
> *From:*Donny Davis [mailto:donny at fortnebula.com]
> *Sent:* Tuesday, January 14, 2020 4:05 PM
> *To:* Bhupathi, Ramakrishna <C-Ramakrishna.Bhupathi at charter.com>
> *Cc:* OpenStack Discuss <openstack-discuss at lists.openstack.org>
> *Subject:* Re: [magnum]: K8s cluster creation times out. OpenStack
> Train : [ERROR]: Unable to render networking. Network config is likely
> broken
>
>  
>
> Did you update your cluster distro? Can you share your current cluster
> template?
>
> Donny Davis
> c: 805 814 6800
>
>  
>
> On Tue, Jan 14, 2020, 3:56 PM Bhupathi, Ramakrishna
> <C-Ramakrishna.Bhupathi at charter.com
> <mailto:C-Ramakrishna.Bhupathi at charter.com>> wrote:
>
>     I just moved to Fedora core OS image (fedora-coreos-31)  to build
>     my K8s Magnum cluster and  cluster creation fails with 
>
>     ERROR: The Parameter (octavia_ingress_controller_tag) was not
>     defined in template.
>
>      
>
>     I wonder why I need that tag. Any help please?
>
>      
>
>     --RamaK
>
>      
>
>     *From:*Feilong Wang [mailto:feilong at catalyst.net.nz
>     <mailto:feilong at catalyst.net.nz>]
>     *Sent:* Monday, January 13, 2020 4:25 PM
>     *To:* Donny Davis <donny at fortnebula.com <mailto:donny at fortnebula.com>>
>     *Cc:* OpenStack Discuss <openstack-discuss at lists.openstack.org
>     <mailto:openstack-discuss at lists.openstack.org>>
>     *Subject:* Re: [magnum]: K8s cluster creation times out. OpenStack
>     Train : [ERROR]: Unable to render networking. Network config is
>     likely broken
>
>      
>
>     OK, if you're happy to stay on CoreOS, all good. If you're
>     interested in migrating to Fedora CoreOS and have questions, then
>     you're welcome to popup in #openstack-containers. Cheers.
>
>      
>
>     On 14/01/20 10:21 AM, Donny Davis wrote:
>
>         Just Coreos - I tried them all and it was the only one that
>         worked oob. 
>
>          
>
>         On Mon, Jan 13, 2020 at 4:10 PM Feilong Wang
>         <feilong at catalyst.net.nz <mailto:feilong at catalyst.net.nz>> wrote:
>
>             Hi Donny,
>
>             Do you mean Fedore CoreOS or just CoreOS? The current
>             CoreOS driver is not actively maintained, I would suggest
>             migrating to Fedora CoreOS and I'm happy to help if you
>             have any question. Thanks.
>
>              
>
>             On 14/01/20 9:57 AM, Donny Davis wrote:
>
>                 FWIW I was only able to get the coreos image working
>                 with magnum oob.. the rest just didn't work. 
>
>                  
>
>                 On Mon, Jan 13, 2020 at 2:31 PM feilong
>                 <feilong at catalyst.net.nz
>                 <mailto:feilong at catalyst.net.nz>> wrote:
>
>                     Hi Bhupathi,
>
>                     Firstly, I would suggest setting the
>                     use_podman=False when using fedora atomic image.
>                     And it would be nice to set the "kube_tag", e.g.
>                     v1.15.6 explicitly. Then please trigger a new
>                     cluster creation. Then if you still run into
>                     error. Here is the debug steps:
>
>                     1. ssh into the master node, check log
>                     /var/log/cloud-init-output.log
>
>                     2. If there is no error in above log file, then
>                     run journalctl -u heat-container-agent to check
>                     the heat-container-agent log. If above step is
>                     correct, then you must be able to see something
>                     useful here.
>
>                      
>
>                     On 11/01/20 12:15 AM, Bhupathi, Ramakrishna wrote:
>
>                         Wang,
>
>                         Here it is  . I added the labels subsequently.
>                         My nova and neutron are working all right as I
>                         installed various systems there working with
>                         no issues..
>
>                          
>
>                          
>
>                         *From:* Feilong Wang
>                         [mailto:feilong at catalyst.net.nz]
>                         *Sent:* Thursday, January 9, 2020 6:12 PM
>                         *To:* openstack-discuss at lists.openstack.org
>                         <mailto:openstack-discuss at lists.openstack.org>
>                         *Subject:* Re: [magnum]: K8s cluster creation
>                         times out. OpenStack Train : [ERROR]: Unable
>                         to render networking. Network config is likely
>                         broken
>
>                          
>
>                         Hi Bhupathi,
>
>                         Could you please share your cluster template?
>                         And please make sure your Nova/Neutron works.
>
>                          
>
>                         On 10/01/20 2:45 AM, Bhupathi, Ramakrishna wrote:
>
>                             Folks,
>
>                             I am building a Kubernetes Cluster(
>                             Openstack Train) and using fedora
>                             atomic-29 image . The nodes come up  fine
>                             ( I have a simple 1 master and 1 node) ,
>                             but the cluster creation times out,  and
>                             when I access the cloud-init logs I see
>                             this error .  Wondering what I am missing
>                             as this used to work before.  I wonder if
>                             this is image related .
>
>                              
>
>                             [ERROR]: Unable to render networking.
>                             Network config is likely broken: No
>                             available network renderers found.
>                             Searched through list: ['eni',
>                             'sysconfig', 'netplan']
>
>                              
>
>                             Essentially the stack creation fails in
>                             “kube_cluster_deploy”
>
>                              
>
>                             Can somebody help me debug this ? Any help
>                             is appreciated.
>
>                              
>
>                             --RamaK
>
>                             The contents of this e-mail message and
>                             any attachments are intended solely for the
>                             addressee(s) and may contain confidential
>                             and/or legally privileged information. If you
>                             are not the intended recipient of this message
>                             or if this message has been addressed to you
>                             in error, please immediately alert the sender
>                             by reply e-mail and then delete this message
>                             and any attachments. If you are not the
>                             intended recipient, you are notified that
>                             any use, dissemination, distribution, copying,
>                             or storage of this message or any attachment
>                             is strictly prohibited.
>
>                         -- 
>
>                         Cheers & Best regards,
>
>                         Feilong Wang (王飞龙)
>
>                         Head of R&D
>
>                         Catalyst Cloud - Cloud Native New Zealand
>
>                         --------------------------------------------------------------------------
>
>                         Tel: +64-48032246
>
>                         Email: flwang at catalyst.net.nz <mailto:flwang at catalyst.net.nz>
>
>                         Level 6, Catalyst House, 150 Willis Street, Wellington
>
>                         -------------------------------------------------------------------------- 
>
>                         The contents of this e-mail message and
>                         any attachments are intended solely for the
>                         addressee(s) and may contain confidential
>                         and/or legally privileged information. If you
>                         are not the intended recipient of this message
>                         or if this message has been addressed to you
>                         in error, please immediately alert the sender
>                         by reply e-mail and then delete this message
>                         and any attachments. If you are not the
>                         intended recipient, you are notified that
>                         any use, dissemination, distribution, copying,
>                         or storage of this message or any attachment
>                         is strictly prohibited.
>
>                     -- 
>
>                     Cheers & Best regards,
>
>                     Feilong Wang (王飞龙)
>
>                     ------------------------------------------------------
>
>                     Senior Cloud Software Engineer
>
>                     Tel: +64-48032246
>
>                     Email: flwang at catalyst.net.nz <mailto:flwang at catalyst.net.nz>
>
>                     Catalyst IT Limited
>
>                     Level 6, Catalyst House, 150 Willis Street, Wellington
>
>                     ------------------------------------------------------ 
>
>
>                  
>
>                 -- 
>
>                 ~/DonnyD
>
>                 C: 805 814 6800
>
>                 "No mission too difficult. No sacrifice too great.
>                 Duty First"
>
>             -- 
>
>             Cheers & Best regards,
>
>             Feilong Wang (王飞龙)
>
>             Head of R&D
>
>             Catalyst Cloud - Cloud Native New Zealand
>
>             --------------------------------------------------------------------------
>
>             Tel: +64-48032246
>
>             Email: flwang at catalyst.net.nz <mailto:flwang at catalyst.net.nz>
>
>             Level 6, Catalyst House, 150 Willis Street, Wellington
>
>             -------------------------------------------------------------------------- 
>
>
>          
>
>         -- 
>
>         ~/DonnyD
>
>         C: 805 814 6800
>
>         "No mission too difficult. No sacrifice too great. Duty First"
>
>     -- 
>
>     Cheers & Best regards,
>
>     Feilong Wang (王飞龙)
>
>     Head of R&D
>
>     Catalyst Cloud - Cloud Native New Zealand
>
>     --------------------------------------------------------------------------
>
>     Tel: +64-48032246
>
>     Email: flwang at catalyst.net.nz <mailto:flwang at catalyst.net.nz>
>
>     Level 6, Catalyst House, 150 Willis Street, Wellington
>
>     -------------------------------------------------------------------------- 
>
>     The contents of this e-mail message and
>     any attachments are intended solely for the
>     addressee(s) and may contain confidential
>     and/or legally privileged information. If you
>     are not the intended recipient of this message
>     or if this message has been addressed to you
>     in error, please immediately alert the sender
>     by reply e-mail and then delete this message
>     and any attachments. If you are not the
>     intended recipient, you are notified that
>     any use, dissemination, distribution, copying,
>     or storage of this message or any attachment
>     is strictly prohibited.
>
> The contents of this e-mail message and
> any attachments are intended solely for the
> addressee(s) and may contain confidential
> and/or legally privileged information. If you
> are not the intended recipient of this message
> or if this message has been addressed to you
> in error, please immediately alert the sender
> by reply e-mail and then delete this message
> and any attachments. If you are not the
> intended recipient, you are notified that
> any use, dissemination, distribution, copying,
> or storage of this message or any attachment
> is strictly prohibited. 

-- 
Cheers & Best regards,
Feilong Wang (王飞龙)
------------------------------------------------------
Senior Cloud Software Engineer
Tel: +64-48032246
Email: flwang at catalyst.net.nz
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
------------------------------------------------------ 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20200116/b0103d84/attachment-0001.html>


More information about the openstack-discuss mailing list