[Openstack-operators] [kolla][nova] Upgrade leaves nova_compute at earlier version]
Dave Williams
dave at opensourcesolutions.co.uk
Fri Jun 15 20:46:50 UTC 2018
Sure:
Apologies for a longer post than I would like.
globals.yml with all commented out (default) values removed:
kolla_base_distro: "ubuntu"
kolla_install_type: "source"
openstack_release: "master"
kolla_internal_vip_address: "10.10.66.138"
kolla_internal_fqdn: "openstackint.uklab.local"
kolla_external_vip_address: "10.10.66.134"
kolla_external_fqdn: "openstackext.uklab.local"
kolla_enable_tls_external: "yes"
kolla_external_fqdn_cert: "{{ node_config_directory }}/certificates/haproxy.pem"
enable_central_logging: "yes"
enable_ceph: "yes"
enable_cinder: "yes"
enable_cinder_backend_netapp_iscsi: "no"
enable_neutron_provider_networks: "yes"
ceph_pool_type: "replicated"
ceph_pool_pg_num: 128
ceph_pool_pgp_num: 128
cinder_backup_driver: "ceph"
tempest_image_id:
tempest_flavor_ref_id:
tempest_public_network_id:
tempest_floating_network_name:
inventory file again only section with changes (rest default):
[control]
mclaren ansible_connection=local network_interface=enp5s0 neutron_external_interface=enp3s0 api_interface=enp5s0
[network]
mclaren ansible_connection=local network_interface=enp5s0 neutron_external_interface=enp3s0 api_interface=enp5s0
[inner-compute]
[external-compute]
mclaren ansible_connection=local network_interface=enp5s0 neutron_external_interface=enp3s0 api_interface=enp5s0
aston network_interface=enp3s0 neutron_external_interface=enp5s0
corvette2 network_interface=enp3s0 neutron_external_interface=enp5s0
lambo2 network_interface=enp3s0 neutron_external_interface=enp5s0
porsche network_interface=enp3s0 neutron_external_interface=enp5s0
ferrari network_interface=enp3s0 neutron_external_interface=enp5s0
lotus network_interface=enp3s0 neutron_external_interface=enp5s0
maserati network_interface=eth0 neutron_external_interface=eth1
chevi2 network_interface=enp4s0f1 neutron_external_interface=enp4s0f0
audi network_interface=em1 neutron_external_interface=em2
saab network_interface=em1 neutron_external_interface=em2
radical network_interface=eth0 neutron_external_interface=eth1
[compute:children]
inner-compute
external-compute
[storage]
mclaren ansible_connection=local network_interface=enp5s0 neutron_external_interface=enp3s0 api_interface=enp5s0
lambo2 network_interface=enp3s0 neutron_external_interface=enp5s0
porsche network_interface=enp3s0 neutron_external_interface=enp5s0
ferrari network_interface=enp3s0 neutron_external_interface=enp5s0
lotus network_interface=enp3s0 neutron_external_interface=enp5s0
maserati network_interface=eth0 neutron_external_interface=eth1
chevi2 network_interface=enp4s0f1 neutron_external_interface=enp4s0f0
audi network_interface=em1 neutron_external_interface=em2
saab network_interface=em1 neutron_external_interface=em2
radical network_interface=eth0 neutron_external_interface=eth1
[monitoring]
mclaren ansible_connection=local network_interface=enp5s0 neutron_external_interface=enp3s0 api_interface=enp5s0
radical network_interface=eth0 neutron_external_interface=eth1
aston network_interface=enp3s0 neutron_external_interface=enp5s0
[deployment]
mclaren ansible_connection=local network_interface=enp5s0 neutron_external_interface=enp3s0 api_interface=enp5s0
docker ps -a (sorry for lack of line wrap)
SERVER aston
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
24e87677d14c 0a1d3587ae5c "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
22e7e820eb96 760e48f2527b "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
e6cb63995d02 c07ab7bd1910 "kolla_start" 9 days ago Up 9 days openvswitch_db
71ffd7f32eaa c9af2493c9e1 "kolla_start" 9 days ago Up 9 days nova_libvirt
8870b6ebaf61 e9d2082aa62f "kolla_start" 9 days ago Up 9 days nova_ssh
042510be7389 72e8b021c493 "kolla_start" 9 days ago Up 9 days cron
83e50da14764 ac0c8b1aeef2 "kolla_start" 9 days ago Up 9 days kolla_toolbox
5e8efb880a44 afa0d8636841 "kolla_start" 9 days ago Up 9 days fluentd
76a7b24d339f 7dc2d4695962 "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER chevi2
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
98c58e80ed71 kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_14
1d94ef829a90 kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
af6023a2e642 kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
1d5c05737740 kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
e9bfa550a752 af91cf6fca37 "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
56e598f5c245 75bfdbba3121 "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
2dfb4a5c35c4 4a45aebbe6db "kolla_start" 9 days ago Up 9 days openvswitch_db
2ae36973b03d b78203d88001 "kolla_start" 9 days ago Up 9 days nova_libvirt
3e563c57b923 5e7b9c7218e4 "kolla_start" 9 days ago Up 9 days nova_ssh
55212992abe8 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
b40a438fc967 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
8a3d52181f3e e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
ea8173dce027 1327db800fb5 "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER corvette2
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
354861c2f74d 0a1d3587ae5c "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
405a83c73095 760e48f2527b "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
afa5dc83b65c c07ab7bd1910 "kolla_start" 9 days ago Up 9 days openvswitch_db
727bd00a3b4b c9af2493c9e1 "kolla_start" 9 days ago Up 9 days nova_libvirt
54958199183d e9d2082aa62f "kolla_start" 9 days ago Up 9 days nova_ssh
64dde7c9e54d 72e8b021c493 "kolla_start" 9 days ago Up 9 days cron
32b82bc71b64 ac0c8b1aeef2 "kolla_start" 9 days ago Up 9 days kolla_toolbox
08bd92b84784 afa0d8636841 "kolla_start" 9 days ago Up 9 days fluentd
87b358a2a203 7dc2d4695962 "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER ferrari
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
646d8fb9a744 kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_21
24f5837553e6 kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_20
20fe3af4d8ea kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
a31a42e1fff1 kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
e42348f61baf kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
6bea5724925a 0a1d3587ae5c "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
f7a0fbf9fa9c 760e48f2527b "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
f0ecec45e6c1 c07ab7bd1910 "kolla_start" 9 days ago Up 9 days openvswitch_db
798d1afb8152 c9af2493c9e1 "kolla_start" 9 days ago Up 9 days nova_libvirt
cd10ad9ab165 e9d2082aa62f "kolla_start" 9 days ago Up 9 days nova_ssh
229d12b12b37 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
587ad9422bae 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
e70eafcb4e0d e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_1
513eea410e7e e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
1e7276bc8e8e 7dc2d4695962 "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER lambo2
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b4e61110c83e kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_23
bff1cac171ce kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_24
b1d7048a09a3 kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
ce0b01b2bb8f kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
0e9852fb3df7 kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
92edd06b97f2 0a1d3587ae5c "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
a859a5c03ec2 760e48f2527b "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
c57a565acfb8 c07ab7bd1910 "kolla_start" 9 days ago Up 9 days openvswitch_db
218c6f0475b3 c9af2493c9e1 "kolla_start" 9 days ago Up 9 days nova_libvirt
92a046c72fc5 e9d2082aa62f "kolla_start" 9 days ago Up 9 days nova_ssh
cf19a92fa746 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
84e4a01476a0 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
e56862ea2485 e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_1
440a7b5dff76 e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
42b7e96c20d4 7dc2d4695962 "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER lotus
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
9b20fe802f5c kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_25
f3c5cfa65f05 kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_26
e091b7075b9e kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
24c18619c360 kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
be83c0455758 kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
78619cba1bbf 0a1d3587ae5c "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
c363d620525a 760e48f2527b "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
e10eebf667d2 c07ab7bd1910 "kolla_start" 9 days ago Up 9 days openvswitch_db
9afe512e474a c9af2493c9e1 "kolla_start" 9 days ago Up 9 days nova_libvirt
7742334d9854 e9d2082aa62f "kolla_start" 9 days ago Up 9 days nova_ssh
bc49ce4ec413 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
82ce2ee5f951 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
48a88eef1323 e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_1
49c7c759f007 e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
944f620a445c 7dc2d4695962 "kolla_start" 6 weeks ago Up 8 days nova_compute
SERVER maserati
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
22421a9ab59d kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_15
be37172c2d29 kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
6d36d1aa301c kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
e4878b5ccc62 kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
919a1630fbc4 af91cf6fca37 "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
9f120c14f742 75bfdbba3121 "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
9aeb74d824a0 4a45aebbe6db "kolla_start" 9 days ago Up 9 days openvswitch_db
a49d120be4e7 b78203d88001 "kolla_start" 9 days ago Up 9 days nova_libvirt
71342a9de120 5e7b9c7218e4 "kolla_start" 9 days ago Up 9 days nova_ssh
c92b64ead946 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
e2c4c99cfa94 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
bbc1a10e0720 e2ef2ac054f0 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
40fbab40f6af 1327db800fb5 "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER mclaren
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
2030bbc9cff2 kolla/ubuntu-source-cinder-api:queens "kolla_start" 8 days ago Exited (1) 8 days ago bootstrap_cinder
6e276a11497b kolla/ubuntu-source-cinder-api:queens "bash" 8 days ago Exited (0) 8 days ago stupefied_agnesi
2ac0ee19add0 kolla/ubuntu-source-cinder-api:queens "bash" 8 days ago Exited (0) 8 days ago backstabbing_ride
9fcb9681a490 kolla/ubuntu-source-glance-registry:queens "kolla_start" 8 days ago Up 8 days glance_registry
1cd803c9702b kolla/ubuntu-source-glance-api:queens "kolla_start" 8 days ago Up 8 days glance_api
4e5674eecd6b kolla/ubuntu-source-ceph-mgr:queens "kolla_start" 8 days ago Up 8 days ceph_mgr
4b20de375731 kolla/ubuntu-source-ceph-mon:queens "kolla_start" 8 days ago Up 8 days ceph_mon
a5f87a81f742 kolla/ubuntu-source-keystone:queens "kolla_start" 8 days ago Up 8 days keystone
973400381ca9 kolla/ubuntu-source-rabbitmq:queens "kolla_start" 8 days ago Up 8 days rabbitmq
8b67f06d16fd kolla/ubuntu-source-mariadb:queens "kolla_start" 8 days ago Up 8 days mariadb
6b75d38f8c75 kolla/ubuntu-source-memcached:queens "kolla_start" 8 days ago Up 8 days memcached
dd7988346ba3 kolla/ubuntu-source-kibana:queens "kolla_start" 8 days ago Up 8 days kibana
1de09ab2d131 kolla/ubuntu-source-keepalived:queens "kolla_start" 8 days ago Up 8 days keepalived
d114b971eaa7 kolla/ubuntu-source-haproxy:queens "kolla_start" 8 days ago Up 8 days haproxy
1ddd175d825b kolla/ubuntu-source-elasticsearch:queens "kolla_start" 8 days ago Up 8 days elasticsearch
593760dfdffd kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
250cf2571aad kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
5d6c88226710 kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
308c8719b804 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
f111db9b57fd 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
afb246359b0e bef10157d50e "kolla_start" 9 days ago Up 9 days cinder_scheduler
37390f582dd7 598a51396443 "kolla_start" 9 days ago Up 9 days cinder_api
564c44963116 6b55bb6a68cc "kolla_start" 5 weeks ago Up 9 days horizon
819b9f1a2a15 6e277850ea95 "kolla_start" 5 weeks ago Up 9 days heat_engine
386e62406ada 21ad7a0470a2 "kolla_start" 5 weeks ago Up 9 days heat_api_cfn
e66aa44f47b8 ca6a916cfd05 "kolla_start" 5 weeks ago Up 9 days heat_api
9ab6392ef1b2 8d58993a23ab "kolla_start" 5 weeks ago Up 3 weeks neutron_metadata_agent
569f1354a87c 14e8c85e8ef8 "kolla_start" 5 weeks ago Up 3 weeks neutron_l3_agent
e9099c5310c0 cd0739afdb29 "kolla_start" 5 weeks ago Up 3 weeks neutron_dhcp_agent
11eb7cacd3b3 aa895811b26e "kolla_start" 5 weeks ago Up 3 weeks neutron_openvswitch_agent
785cf3e744ea 7ab18cfbe4f5 "kolla_start" 5 weeks ago Up 3 weeks neutron_server
427567cc1180 760e48f2527b "kolla_start" 6 weeks ago Up 3 weeks openvswitch_vswitchd
8dfcd4fd96d4 c07ab7bd1910 "kolla_start" 6 weeks ago Up 3 weeks openvswitch_db
ab270aac1f9c b8af432eacfb "kolla_start" 6 weeks ago Up 9 days nova_compute
b5a9c0a1b4fb 42b0feb8ac68 "kolla_start" 6 weeks ago Up 3 weeks nova_novncproxy
ce83a1689d7a ff68c44578c6 "kolla_start" 6 weeks ago Up 3 weeks nova_consoleauth
5f86ab44406a b73d02cd3549 "kolla_start" 6 weeks ago Up 3 weeks nova_conductor
e032e7470744 a753a392e019 "kolla_start" 6 weeks ago Up 3 weeks nova_scheduler
32adaa773e43 c6a04101cdc2 "kolla_start" 6 weeks ago Up 3 weeks nova_api
828b050d9ef9 f477e69285b6 "kolla_start" 6 weeks ago Up 3 weeks placement_api
18cf42dc8e55 c9af2493c9e1 "kolla_start" 6 weeks ago Up 3 weeks nova_libvirt
45c35dc7faf0 b83bbe0247a8 "kolla_start" 6 weeks ago Up 3 weeks nova_ssh
SERVER porsche
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
2d9507963c87 kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_17
9769b466096d kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_16
6791b2bb9c02 kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
ffc300935f90 kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
855ab15b0cbd kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
a263b6fa8ac3 085ed25f53ec "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
b756d88de4b7 7aff079c0f1e "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
1dfdedd9fbb7 bfe9738a875a "kolla_start" 9 days ago Up 9 days openvswitch_db
362b4f7dc5f6 eea114977ec7 "kolla_start" 9 days ago Up 9 days nova_libvirt
18136a1b4414 098795b22f46 "kolla_start" 9 days ago Up 9 days nova_ssh
73f05836bf59 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
250df208df5c 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
8ad19d1e6da6 418b2bea1e64 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_1
990fc14fa554 418b2bea1e64 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
009e0b9e317a 493e108e9514 "kolla_start" 4 weeks ago Up 9 days nova_compute
SERVER saab
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b2f5d2b8e417 kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_13
64535306319d kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
1c7594f693e0 kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
96b377de4ffa kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
4ad987e372f5 3243d4926a66 "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
f12b6a1beaa0 101695c48d48 "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
13defa55503d 9de6f3c41d83 "kolla_start" 9 days ago Up 9 days openvswitch_db
dd84be822bd0 78ace7fc263d "kolla_start" 9 days ago Up 9 days nova_libvirt
6bc5c8b5b7e8 bc68d85b4669 "kolla_start" 9 days ago Up 9 days nova_ssh
43d75a221403 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
b009c3186a74 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
16277267d571 ff11952a6a94 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
7269edbe47eb abbf3258d4ee "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER audi
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
930f4733b77f kolla/ubuntu-source-ceph-osd:queens "kolla_start" 8 days ago Up 8 days ceph_osd_22
4c9c4cd98dda kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
86173044a85b kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
46cbf7bfb16e kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
62691e7cf399 3243d4926a66 "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
c9bdcca5cd7d 101695c48d48 "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
c53973ba8a4f 9de6f3c41d83 "kolla_start" 9 days ago Up 9 days openvswitch_db
0831964e140c 78ace7fc263d "kolla_start" 9 days ago Up 9 days nova_libvirt
a98850a1ab82 bc68d85b4669 "kolla_start" 9 days ago Up 9 days nova_ssh
e1f5b4c96846 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
2e888d0d3a9e 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
452d6465a5d6 ff11952a6a94 "kolla_start" 3 weeks ago Exited (0) 3 weeks ago bootstrap_osd_0
e4f15b62c6a7 abbf3258d4ee "kolla_start" 6 weeks ago Up 9 days nova_compute
SERVER radical
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
608a82d6ad45 kolla/ubuntu-source-cron:queens "kolla_start" 8 days ago Up 8 days cron
a775d01eabe8 kolla/ubuntu-source-kolla-toolbox:queens "kolla_start" 8 days ago Up 8 days kolla_toolbox
475b8900989b kolla/ubuntu-source-fluentd:queens "kolla_start" 8 days ago Up 8 days fluentd
a48c59fd969e d3cc178ce8c0 "kolla_start" 9 days ago Up 9 days neutron_openvswitch_agent
7369e5368602 800896c34a2e "kolla_start" 9 days ago Up 9 days openvswitch_vswitchd
0ca90d6a09e8 551909d28c50 "kolla_start" 9 days ago Up 9 days openvswitch_db
cc5228efb01b 6307a42d968d "kolla_start" 9 days ago Up 9 days nova_libvirt
bc3a36aa480f 0e00da6547d0 "kolla_start" 9 days ago Up 9 days nova_ssh
dd21cf3c1b15 89c2ec59b2b1 "kolla_start" 9 days ago Up 9 days cinder_backup
82b56aa60102 52ac8cf90164 "kolla_start" 9 days ago Up 9 days cinder_volume
0feafa193c05 64c10510ae70 "kolla_start" 6 weeks ago Up 9 days nova_compute
The various ceph startups were due a serious network failure I suffered
using iscsi based OSD's. None of the kolla instructions to recreate the
storage worked. I had to resort to copious dd'ing to zero all the disk
partitions before I could finally get it working afresh. Painful!!
The bootstrap_cinder with exit 1 was my attempt to downgrade to move to
queens rather than master but that failed due to the database schema
issue described below.
The last kolla-ansible upgrade (back to master) was successful with
ansible.log from the fluentd container showing all lines like:
2018-06-07 09:18:46,265 p=767 u=ansible | localhost | SUCCESS => {
"changed": false,
"user": "haproxy"
}
2018-06-07 09:19:14,436 p=796 u=ansible | localhost | SUCCESS => {
"changed": true,
"msg": "Variable change succeeded prev_value=OFF"
}
2018-06-07 09:19:29,562 p=826 u=ansible | localhost | SUCCESS => {
"changed": true,
"msg": "Variable change succeeded prev_value=ON"
}
2018-06-07 09:23:11,834 p=860 u=root | localhost | SUCCESS => {
"changed": false,
"disks": "[]"
}
2018-06-07 09:23:59,247 p=892 u=ansible | localhost | SUCCESS => {
"changed": true,
"msg": "Variable change succeeded prev_value=OFF"
}
2018-06-07 09:24:08,053 p=921 u=ansible | localhost | SUCCESS => {
"changed": true,
"msg": "Variable change succeeded prev_value=ON"
}
Not sure what else I can provide beyond the bootstrap_cinder logs which
show more fully:
++ cat /run_command
+ CMD='apache2 -DFOREGROUND'
+ ARGS=
+ [[ ! -n '' ]]
+ . kolla_extend_start
++ [[ ! -d /var/log/kolla/cinder ]]
+++ stat -c %a /var/log/kolla/cinder
++ [[ 755 != \7\5\5 ]]
++ . /usr/local/bin/kolla_cinder_extend_start
+++ set -o errexit
+++ [[ -n 0 ]]
+++ cinder-manage db sync
Error during database migration: "Database schema file with version 122 doesn't exist."
I am happy with running a stable version rather than master. Using master was
my trying to fix problems with ceph. I appear to be stuck not being able
to upgrade or downgrade at present. Whilst my cloud is mainly working
its just some secondary features like adding volumes that now no longer work.
I am not in the position to destroy the system and restart without
significant disruption.
Thank you for your attention.
Dave
On 21:09, Thu 14 Jun 18, Eduardo Gonzalez wrote:
> Hi,
>
> could you share a your globals file without secrets, a docker ps -a on all
> compute hosts and images too. If you are able to get n upgrade log will be
> helpful too.
>
> By the way, using master is not really recommended, many changes from other
> projects and kolla may break the deployment.
>
> Regards
>
> On Thu, Jun 14, 2018, 9:00 PM Dave Williams <dave at opensourcesolutions.co.uk>
> wrote:
>
> > I am using kolla-ansible 6.0.0 with openstack_release set to master in
> > globals.yml in a production environment.
> >
> > I am trying to fix an oslo_messaging.rpc.client.RemoteError when
> > undertaking server add volume
> > (https://bugs.launchpad.net/nova/+bug/1773393) and appear to have
> > tracked it down to an inconsistency of container versions.
> >
> > kollo-ansible upgrade runs to completion without error but leaves the
> > running nova_compute containers (and possibly others) at an earlier
> > version.
> >
> > The version running is
> > CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
> > 944f620a445c 7dc2d4695962 "kolla_start" 4 weeks ago Up 4 hours nova_compute
> >
> > whereas docker images -a shows
> > REPOSITORY TAG IMAGE ID CREATED SIZE
> > kolla/ubuntu-source-nova-compute master f2df8187f14e 15 hours ago 1.29GB
> > kolla/ubuntu-source-nova-compute <none> 582561ac010f 39 hours ago 1.29GB
> > kolla/ubuntu-source-nova-compute <none> 7dc2d4695962 3 months ago 1.22GB
> >
> > This implies f2df8187f14e is the one I should be using.
> > The image 582561ac010f was after I tried to switch to queens from master
> > but without success due to a bootstrap_cinder problem:
> > Error during database migration:
> > "Database schema file with version 122 doesn't exist."
> > I tried to investigate this but without any obvious resolution.
> >
> > All compute nodes show the same issue.
> >
> > As per the notes on
> > https://docs.openstack.org/kolla-ansible/latest/user/operating-kolla.html
> > I have checked and virt_type is set to kvm in nova.conf and so I cannot
> > see why the upgrade shouldnt have been successful.
> >
> > How do I get kolla to use the latest version pulled?
> >
> > Given I have running instances I am a little nervous of doing a deploy or
> > reconfigure.
> >
> > Thanks for help.
> >
> > Dave
> >
> >
> > _______________________________________________
> > OpenStack-operators mailing list
> > OpenStack-operators at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> >
More information about the OpenStack-operators
mailing list