We are stoked to announce the release of: kayobe 4.0.0: Deployment of OpenStack to bare metal using OpenStack kolla and bifrost This is the first release of kayobe. This release is part of the queens stable release series. The source is available from: https://git.openstack.org/cgit/openstack/kayobe Download the package from: https://tarballs.openstack.org/kayobe/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/openstack/kayobe For more details, please see below. 4.0.0 ^^^^^ New Features ************ * Adds a new overcloud admin network to improve network separation. The network is intended to be used for remote admin access e.g SSH. If "admin_oc_net_name" is not set, Kayobe will use the previous behaviour of using the overcloud provisioning network for this purpose. See Story 2002096 (https://storyboard.openstack.org/#!/story/2002096) * Adds support for installing extra Python packages inside the kolla- ansible virtualenv, such as when required by Ansible plugins. A list of extra requirements can be configured via the "kolla_ansible_venv_extra_requirements" variable in "$KAYOBE_CONFIG_PATH/kolla.yml". No extra packages are installed by default. * Add support for OpenStack Monasca which provides monitoring- as-a-service for OpenStack at scale. * Add support for deploying Apache Storm which is used by Monasca for alerting. * Add support for configuring MariaDB to support customising the Kolla deployment, or using an external DB. * Adds support for custom Barbican configuration. * Adds support for the Ansible 2.5 release. The version requirement has been increased for both kayobe and kolla ansible. * Adds support for setting the boot protocol of a network interface. Valid values are "static" and "dhcp". The default is "static". When set to an external DHCP server must be provided. * Adds support for installing custom Ansible Galaxy roles during "kayobe control host bootstrap" and "kayobe control host upgrade". Custom roles are defined in a requirements file at "$KAYOBE_CONFIG_PATH/ansible/requirements.yml". The roles will be installed to "$KAYOBE_CONFIG_PATH/ansible/roles/". * Adds support for configuration of Dell PowerConnect switches. This is integrated with the *kayobe physical network configure* command. * Adds a command to rename baremetal compute nodes to match their inventory host name - "kayobe baremetal compute rename" * Adds a new command, "kayobe baremetal compute update deployment image", which will update the deploy_kernel and deploy_ramdisk ironic node properties. * Add commands to update packages on seed and overcloud hosts: "kayobe seed host package update --packages <packages>" "kayobe overcloud host package update --packages <packages>" * Adds support for configuration of custom repositories. "yum_custom_repos" should be a dict of repositories. * Adds support for configuration of "live-restore" option in docker. This is enabled by setting the variable "docker_daemon_live_restore". The option is set to "false" by default. * Facilitates deployment of TLS certificate bundles in environments where SSL is required. To use this feature, populate the contents of the variable "kolla_tls_cert" - this will then be copied in to place for use by HAProxy. * Adds support for configuration of the user used by Kolla Ansible for remote execution. The user is configured via "kolla_ansible_user", its primary group via "kolla_ansible_group", and "kolla_ansible_become" determines whether privilege escalation is used by Kolla Ansible for all tasks or only required tasks. * Adds support for configuration of Mellanox switches running MLNX- OS. This is integrated with the *kayobe physical network configure* command. * Adds support for skipping installation of the "epel-release" package, by setting "yum_install_epel" to "false". In some cases this is desirable, such as when a local EPEL mirror is available, or access to the public repositories is not possible. * Adds support for configuration of per-host network interfaces in Kolla Ansible. Previously, all interfaces were configured in "globals.yml", meaning that all hosts used the same interface names. Now, interfaces are configured for each host via inventory files. * Introduces a new option - "pip_local_mirror" - to configure Pip package installation via a user-defined (often local) PyPi mirror. This is set on a per-user basis, and by default this is for the Kayobe Ansible user, the Kolla Ansible user, and root. See Story 2003315 (https://storyboard.openstack.org/#!/story/2003315) * Adds the ability to prevent configuration of the DNS resolver. This can be done by setting "resolv_is_managed" to "false". * Support configuring tunnel network and interface for VM to VM communication. * Support configuration of the Ironic Neutron Agent and Neutron ML2 baremetal plugin. * Adds an option to upgrade cloud-init in the overcloud host images, "overcloud_host_image_workaround_cloud_init_enabled". Please see: Story 2002610 (https://storyboard.openstack.org/#!/story/2002610) for full details. Upgrade Notes ************* * Modifies the default "kayobe-config" configuration to use a remote Python virtual environment for executing Kayobe Ansible tasks. This affects hosts in the "seed", "seed-hypervisor", and "overcloud" groups. See Story 2002010 for details. * It is now possible to specify a URL of a file containing a checksum of the Ironic Python Agent (IPA) images for the seed and overcloud Ironic and Ironic Inspector services. This allows Kayobe to detect changes in the image content and download as necessary. If specifying IPA images via URL, the checksums should be configured accordingly. The checksum URLs and algorithms are configured via these variables: * "{{ ipa_kernel_checksum_url }}" * "{{ ipa_kernel_checksum_algorithm }}" * "{{ ipa_ramdisk_checksum_url }}" * "{{ ipa_ramdisk_checksum_algorithm }}" For the seed this may be customised via these variables: * "{{ kolla_bifrost_ipa_kernel_checksum_url }}" * "{{ kolla_bifrost_ipa_kernel_checksum_algorithm }}" * "{{ kolla_bifrost_ipa_ramdisk_checksum_url }}" * "{{ kolla_bifrost_ipa_ramdisk_checksum_algorithm }}" For the overcloud Ironic Inspector service this may be customised via these variables: * "{{ inspector_ipa_kernel_checksum_url }}" * "{{ inspector_ipa_kernel_checksum_algorithm }}" * "{{ inspector_ipa_ramdisk_checksum_url }}" * "{{ inspector_ipa_ramdisk_checksum_algorithm }}" * The reference to "kolla_external_fqdn_cert" has been removed in favour of the "kolla_tls_cert" option, which handles setting this on the user's behalf. * Ironic is now configured to use the internal network to reach the TFTP server (by default). Bug Fixes ********* * Fixes an issue introduced by the release of "pip" version 10, whereby the Python "docker" package would fail to install. This is resolved by using a remote Python virtual environment for executing Kayobe Ansible tasks by default. See Story 2002010 for details. * Fixes an issue with introspection data not being collected when iPXE was enabled. This meant that certain introspection rules were not being applied. Notably, the local_link_connection field would not be updated on the ironic ports. * Fixes an issue with downloading Ironic Python Agent (IPA) images where new images would not be downloaded if the image had been downloaded previously. See Story 2001660 for details. * Fixes an issue where persistent sysctls were not being applied after a reboot. See story 2002972 for details. Changes in kayobe 945adf2cc1ea146dde597da7f4b2e4735c48efc5..4.0.0 ----------------------------------------------------------------- c9faeca Update .gitreview for stable/queens 9382208 Fix inspector dnsmasq interface name 92880c6 Fix list of valid switch types to include 'dellos6' or 'dellos9' 89560dd Remove extra configuration for InfluxDB ef84890 Fix IPA image download 392f04f Use readthedocs for release notes 9f3e899 Cleanup zuul jobs 4938474 Update some project home page to latest ea56539 Fix typos in task names 11dbe8b Fix seed vm deprovision 62baa42 Fix naming of Kolla install type config option dd9266f Include kayobe in zuul project list 9048c8c Use pxe_filter instead of deprecated manage_firewall 974ec85 Use a virtualenv for remote operations by default 372058c Allow installing extra packages inside the kolla-ansible virtualenv 53ee829 Support custom config for Barbican 9831302 Update python dependencies in kolla-ansible virtualenv 7fe53c3 Check nova VM status in CI f7badb2 Use openstack-hosted development config f197a65 Use infra's PyPI mirror during using CI f536f9a Fix Monasca kolla_enable flags d2d9f0d Add support for deploying Apache Storm d8a300c Add support for deploying Monasca 44b140c Use force rebuild feature in stackhpc.os-images role a1ea2cc Add monasca to image regex list 601b94d Add host package update to upgrade procedures 1ee9345 Support installing PyPI packages via a mirror 1b5d05d Update ironic IPA deployment images bea399e Per-host network interface configuration 1ee0484 Fix command for copying the Kayobe configuration e659fac Update the bug link for more accuracy 14ad2a2 Fix duplicate listing of MariaDB image 3176517 Support dhcp-hostsdir option in inspector dnsmasq template 679de79 Switch inspection store to use stable docker image c1ecbcd Cleanup unused code 491ed91 Add commands to update packages on hosts e748c1d RabbitMQ upgrade fails due to stale /etc/hosts 21ce37e Fixes for baremetal compute commands 27d833f Fix kayobe overcloud service config save d5ccd8d Add Open vSwitch as a supported switch type 4f20a2f Pin Ansible Galaxy dependencies 9b8ee81 Install setuptools when using easy_install b2a5ef3 Use overlay Docker storage driver for seed-base 5e3986b Template inspector.ipxe f349038 Make installation of epel-release optional 7ad3be5 Add kolla project dependencies to Zuul configuration cc47f7d Point README and docs to official release notes 2ddcd94 Use host networking for inspection store f0b8470 Fix ironic inspector rule registration 8005674 Add support for deploying Prometheus c852c59 Fix path to virtualenv in usage guide 9c1fa1d Add support for the Ironic Neutron agent 5df1156 Support configuring rp_filter mode 6c2e68a Support configuring tunnel network 8ad23be Persistent sysctls broken due to missing .conf suffix 2d5fd70 Reconcile all 'Ansible control host' references ecebcb8 Fix the task name 058a3e1 Add necessary _ for setup.cfg fc9ef3e Fix typo doc administration 41740f9 Make kolla ansible user and group configurable c175b07 Fix handling of switch_type variable in Ansible 2.5 5265993 Don't assume user's primary group name is the same as username bb28786 Add 'venvs' to list of things which we don't want git to track 0353dba Add support for configuring MariaDB abded1e Add support for Mellanox switches running MLNX-OS 3fca0d0 Adds a separate admin network f27461a Add support for Dell PowerConnect switches in NGS 920d9e0 Add Dell PowerConnect switch support 22cf08e Support forcing rebuild of deployment images d1ba6d5 add cloud-init workaround 2803950 Add support for neutron provider networks d4a0da9 create parent directories for extra config files 05dfcc8 Adds new command to rename baremetal compute nodes 18b5498 fix tox python3 overrides e7148bc Make tftp server listen on the internal interface 9037005 Enable iPXE boot in ironic a21d1e7 kolla dnsmasq server should listen on inspection interface 07b2f06 Support Ansible 2.5 0511f67 Adds configuration option for separate cleaning network 2294cf3 Adds controllers to inspection network by default 0a091c4 Add some regex for build image af8c88d Make provisioning workload physical network configurable 22c1553 Fix empty kolla_overcloud_inventory_storage_groups 853222c Add the storage group to the inventory 7341ced Fix Ansible warnings for use of until with {{ }} f231bae Replace Chinese quotes with English quotes b0cb2fd Specify Vagrant box version 2c27566 Add documentation for custom ansible playbooks 4038c82 Change reserved keyword 'action' to 'kayobe_action' 9ec76f9 Support installing galaxy roles from kayobe-config 97905f9 Update kayobe-config repo URL to openstack/kayobe-config d594faf Collect kayobe and kolla configuration in deployment CI jobs ac93b8e Fix yamllint issues in kolla-openstack role 6ab6452 Add vault password and config path to env vars 0ec7edf Test nova server (VM) boot in overcloud job 7451f55 Configure SELinux state in kolla ansible ce4d098 Don't create a virtualenv for kolla on the seed hypervisor b80e94c Fix permissions of kolla-ansible target virtualenv 8cf23b7 Support DHCP for managed network interfaces 53c5ee1 Allow resolv.conf configuration to be prevented 68fc8d3 Make kayobe ansible user bootstrap optional 1c376f0 Build release notes using reno b850bb9 Disable live-restore by default eb146e3 Add preliminary support for Monasca APIs f86c0ff Use queens version of dependencies 1c976bc Update release notes to mention TLS certicate bundle handling 6c5f72b Yum custom repo creation requires root 8ba28c2 Support docker live-restore option 8038e6e Add support for custom yum repositories d385b32 Add CI job for molecule tests cd6c366 Add a job for seed deployment 02c1efe Change github URLs to git.openstack.org dbc1f26 Follow the new PTI for document build e7b51de Add support for configuring InfluxDB 37fca8b Fix variable name - disable_selinux_reboot_timeout 71f493d Don't restart cloud-init when disabling it e45b5ac Use control group for Zookeeper 7f7d2f0 Add support for deploying Apache Kafka 7c9db3a Support copying TLS cert bundles into place 4cdf71f Add overcloud deployment job cff7a0f Add disable_selinux_do_reboot variable 6cba82f Specify MTU in bifrost configdrive network_data.json 87b458c Add support for deploying Zookeeper 64f502f Update README & CONTRIBUTING for OpenStack process bc5f3ab Fix use of tags with overcloud post configure 1579dc6 Use pbr to build the project 048fd82 Use stestr for running unit tests, add a coverage environment ab59380 Fix py35 python tests 2acd8a2 Add .gitreview file dc71c91 Add initial in-repo Zuul jobs 450a7a2 Fix tilde expansion in development environment function library 0ca7049 Add release note for Grafana post-deployment config eef61c7 Add release notes & bump version for kayobe 3.1.0 release dc6f95e Improve automated development environment documentation a71fea1 Support upper constraints for kolla target virtual environment 1cba598 Issue #130: De-nest storage groups 91119f9 Add documentation on writing tests f1f6a0b Don't specify -c flag to pip if no upper constraints 8cfcb3f Fix kolla-ceph tests 227ebca Define defaults for kolla upper constraints file 6ad2a69 User correct prefix for docker upper constraints variable 9b2c387 Don't install Python docker module da2b953 Remove PyYAML 7dd01ad Respect Kolla upper constraints in virtual envs f761a77 Comment out disable_cloud_init in overcloud.yml 2200504 Remove pip install sphinx from pep8 tox environment b66c740 Add disable cloud-init support b160237 Add documentation on running tests 968b4f5 Add a molecule scenario for kolla-openstack - enable-everything 7af95fe More fixes for kolla-openstack role defaults 07ef585 Make kolla-openstack molecule test pass 8f53f32 Add a simple molecule scenario for the kolla-openstack role c310717 Add molecule test utilities 318f73c Add a tox environment & dependencies for running molecule tests 0f5832e Make gitignore for galaxy roles more sane 63dba94 Address review comments c77ac65 Add designate config override e984cae Add kolla_enable_monasca flag 73c22ba Update unit tests and fix issue highlighted by them b651f12 Move setting of Grafana admin username out of Kayobe config ca73777 Remove admin_user override in grafana.ini e3af05c Set the Monasca control plane project ID 1999110 Fixes for ceph block device tagging (#1) 80f350b add tag for ceph + storage node cd33ebc Dev automation documentation review changes 820f9f2 Address dev environment review comments 6beb880 Add bashate to pep8 tox environment b32d9e4 Add configuration for ironic enable and default rescue interfaces 1993301 Use ansible_user_id instead of ansible_user c86b5f0 Ensure virtualenv parent directory exists for kolla and kolla-ansible b3880aa Add scripting around the development environment 4d533b0 Fix undefined variable in cadvisor role ed1e78e Added missing files per PR review. d6cc2ab Use Kolla default login name for Grafana 6277688 roles/cadvisor: Added. 04fb688 Update comment wording 1874968 Use monitoring node IP address for Grafana if no HAProxy 50d324d Organise and update grafana-conf role variables b191dc7 Ignore pep8 warning 4ac756b Use the grafana-conf role to clone the DB repo 3a757b5 Address review comments 0cd6d17 Support configuring Grafana 4028652 Don't require kolla_api_interface on localhost 6213260 Support configuring API interface via overcloud inventory file dbb92fb Pass MTU configuration to seed VM's configdrive 856cbed Add gitignore for libvirt-host and libvirt-vm roles 6662035 Configure all DNS servers for bifrost-provisioned overcloud hosts 40c6a06 Install pip when not using a kayobe target virtualenv 9c1d085 Workaround issue in CentOS cloud images with resolv.conf 53714fc Add a unit test for kayobe seed service deploy b5eb53f Check whether image cache directory is writeable bc6f517 Remove SELinux reboot from development docs 3a2ba67 Add kayobe user bootstrap support for the seed-hypervisor fe3fecb Support monitoring hosts by default in overcloud inventory df9fc0a Add support for configuring Grafana 2fafff1 Add extra conf for cinder and ceph af0372f Fix copy image ipa on seed 5c84047 Fix storage config for docker-ce 1aab914 Update contributing guide with IRC channel 635e9db Add IRC channel to README f3dbda1 Create and install kolla-ansible virtual environment in host configure 62074a8 Add missing kayobe command entry points to setup.py 8b17a75 Fix compute-node-discovery.yml - missing register 6a8b6b6 Always run dump-config.yml playbook in host configure d8fe45b Tag all (well, some of) the things (plays) 20ee6d6 Add a comment about the ansible version limit for kolla-ansible 7f04e9c Create and install virtualenvs on seed/seed-hv/overcloud host upgrade 5e82121 Don't fail if compute node is powered off in compute-node-discovery.yml 301e7bc CLI changes and release notes for remote virtualenvs ecf0527 Use (de)activate-virtualenv role to activate virtualenvs 3620be7 Support configuration of a remote virtualenv for kayobe 7f7d367 Support configuration of a remote virtualenv for kolla-ansible 73fed6d Add an issue template. 33cb069 Add unit tests for various host configure commands 422ffc0 Use a requirements file to install kolla-ansible, update ansible to 2.3 87d46a3 Update python docker package requirement note in role READMEs 5869f9b Add more detail on baremetal compute state transitions a2cbe94 Improve bare metal compute node management 1f30322 add collectd regex 4b7f3c2 Add docker registry config to kolla-ansible role test 7630998 Initial unit testing of ansible - kolla-ansible role 91c341a Add missing defaults for kolla-ansible docker configuration 6aef98b Add a variable to kolla-ansible role for path to passwords.yml 1021267 Use ansible_user_id rather than ansible_user 817df37 Don't quote a boolean value in globals.yml 84e8ba9 Allow controllers and seed groups to be non-existent in kolla-ansible role c818758 Remove support for colocated kolla & kolla-ansible 50a8e72 Only check presence of locally built IPA image on first controller bf608b1 Move libvirt-host and libvirt-vm to Ansible Galaxy roles 4f7a6dd Add blank line after pip install task 2bd0926 Added python-ironicclient (would be better going in the os-openstackclient role, but that's on galaxy bb22c94 Use largest MTU of interfaces when determining OVS veth MTU 1eff746 Sync sample inspector.yml config with group_vars 5b0a90b Support multiple external networks 3608993 Fix support for provisioning and external networks on different physical networks dbb2987 Remove config-mgmt group, instead use localhost 91f01ff Use a separate task to destroy node exporter, opensm and docker registry containers b8cb373 Refactor Vagrantfile to support VMware 7ef01d1 Add container-image-builders group 4123550 Ignore contents of .vagrant 493b2a1 Add documentation on custom kolla-ansible configuration 610c8a9 Update documentation for container-image-builders group 7f767b1 Convert variable to bool in group_by 92d70e7 Extend /etc/hosts fixup playbook for the loopback IP 6a6186f Add enable flag and image regex for manila def2e58 Add missing variables for seed VM data volume config to seed-vm.yml 6c4f179 Add support for free-form configuration of kolla-build.conf d130b8a Make more container image builds conditional 713da07 Don't specify a docker registry when kolla_docker_registry is defined but None 19614e9 Add an ansible group for container image builders 63cf1ab Fix image build regex 2a8f05a Add manila extra config path 92cad7f No need for a virtualenv in TravisCI - already running in one 7281847 Add a tox environment ansible-syntax for checking ansible syntax 3970b87 Move galaxy requirements.yml to top level 619ad3e Update external-net.yml to use the stackhpc.os-networks role 510db6b Fix dell playbook inclusion bdb90c0 add ldap conf for keystone and horizon 07733d1 Add support for setting MTU on veth interfaces bca9316 Remove stale script configure-kayobe.sh 00e03f6 Use a build matrix for TravisCI 8cfa1da Add heat configuration mk2 f43ac2e Add support for free-form configuration of heat c33d2a4 Don't run baremetal compute tasks when ironic is disabled 80b30b8 The default group doesn't need to be configurable 3cdc055 add conf regex for build image 77c13fe Added a comment to explain what's going on with kolla_nova_compute_ironic_host b0a6799 (potential) fix for https://github.com/stackhpc/kayobe/issues/71 ce3fd3b Add creation for directory CA docker c9db56e [roles/node-exporter] Added NTP collector. 3ec02fc [roles/node-exporter] collector option here has changed to path. 8f058e6 [roles/node-exporter] Remove restart-retries for Docker 17.05. b73b0b8 add CA conf for private registry 744345f Allow for non-existent groups in kolla-ansible top level group mapping b598f26 Add documentation for virtualised compute hosts a6680f0 Move configuration guide to a separate ToC 697b2ee Create a baremetal-compute group for baremetal compute nodes aee86e5 Add a check for controllers without ironic enabled 038c734 Add configuration for virtualised compute hosts 1ff98a6 Add custom for dns interface e56c68c Don't provide compute nodes that are in maintenance mode 8d26164 Fix default for idrac_network_ips - should be a dict e3b8fb5 add conf for private registry f5c3953 Add support for custom horizon configuration 4c9a243 network.rst: Document delay and lacp_rate options. 99b93ad networks.py: Added up/down-delay and lacp rate options. 74205ee Add a variable to configure which hosts run nova compute for ironic 2663a92 Add workaround for ansible bug 8743 to yum configs ac905ef network.rst: Document xmit_hash_policy option. a2b7504 networks.py: Added xmit_hash_policy to bonding option filters. 33fc66d redhat.yml: Added wildcard name to make update cache work. 5563c66 Don't overwrite custom kolla-ansible configuration files, merge them 1243f3e Fix typo in release notes f91b985 commands.py: Added Yum configuration to seed VM and hypervisor sections. 107de93 Add a command to check network connectivity between hosts e297ef1 ansible/yum.yml: Added seed-hypervisor to yum playbook. 4823db1 Updated Yum roles with review comments. a3bb4e1 commands.py: Wrapped line to make Travis happy. 1106ed5 group_vars: yum: Disable use of local mirror by default. 4b9f939 Added yum-cron update_cmd option. 2757c67 roles/yum-cron: Split from yum role. a00e978 Added default config file for yum role variables. a663f2e commands.py: Move yum playbook up. 790b5e4 roles/yum: redhat.yml: Removed surplus when statements. f90cb50 roles/yum: Added yum_cron_enabled option. afa3358 ansible/yum.yml: Added playbook. 237c94b roles/yum: Prefix all options with yum_ 42e2243 roles/yum: Use YAML styled options. 38001e5 roles/yum: Added use_local_mirror. 2aa5008 roles/yum: Use yum instead of package. 01684d8 roles/yum: Fixed update_cache options. b4b501a roles/yum: Added yum-cron configuration. 1a73fca commands.py: Added yum role to host configure. 0b8bd70 roles/yum: Added base YUM repo configuration for local mirror. dfa2969 roles/node-exporter: Fixed surplus command option. a868ba1 Revert "Use a local branch of MichaelRigart.interfaces role until merged upstream" 850a727 Set the Vagrant development VM's hostname f1543f0 Use a local branch of MichaelRigart.interfaces role until merged upstream 7168052 Restrict prometheus node exporter to overcloud hosts running docker 6351180 Fix kolla_docker_registry_username and kolla_docker_registry_password cb71f1d Add ceph config file for kolla (#48) a19501a Added Prometheus node exporter role (#34) cd5605f Add support for configuration of IP route tables and rules 3f273df Use kolla-ansible's defaults for neutron ML2 mechanism drivers 35cc193 Update container-image-build.yml 11e9827 Update container-image-build.yml adc08fe Update globals.yml.j2 2709698 Update kolla.yml bbe324b Update kolla ab73d76 Update container-image-build.yml 7a80af0 Update kolla.yml d35d139 Update kolla fd28173 add credentiels for registry 2f3be13 Disable swift by default 2b9a304 Change kolla build configuration path variable 66025bf Improve networking documentation 20e3b75 In latest Docker 17.05 restart-retires and unless-stopped are mutually exclusive. Remove restart-retries where used. db618c6 Fix operator precedence issue in controller network list 050e260 Add no_log to kolla_passwords module argument ba6d30c Don't fail to register introspection rules when variable is None ca284ae Fix ansible warnings for when clauses with curly braces 464a29e Add missing variable kolla_enable_heat 9187216 Add extra config for heat 7fc9390 Add all extra-configurable services to release notes 95af803 add version for ironic api (#37) 966173d add version for ironic api d440e8e Rework custom kolla-ansible configuration 9601159 Add support for configuration of custom fluentd filters 9c4e320 Add support for custom neutron and nova config files 288d7dc Remove nova configuration options which are not necessary in pike 13a1466 Add a --display argument to kayobe physical network configure 4f1ba98 Allow limiting physical network interface configuration to subsets 9d18779 Don't fail to register introspection rules when variable is None a20b3e0 Add support for --skip-tags and --kolla-skip-tags afe1b99 Support additional options for neutron generic switch driver config aa04494 Enable inspector firewall management by default 08466ba Change name of element for diskimage-builder b450e80 Add ElasticSearch as a Kolla feature flag da75d6b Use local_action instead of delegate_to in switch config tasks cf5c1ce Update development configuration for Kayobe 3.0.0 pike release be589e4 Remove explicit setting of versionless keystone endpoints in k-a ce60327 Fix SSH reconnection for docker role in Ansible 2.3 887f061 Remove stale variable from junos role invocation c7bcdf2 Remove default filter from junos switch timeout 1169ce1 Install ncclient python package for junos switches on ansible 2.3+ 8fc8937 Python devel packages not typically installed, add as a base package requirement 1666669 Update RedHat.yml c246f63 Kayobe 3.0.0 release a12aeeb Fix installation documentation syntax 454de62 Update documentation for new control host directory layout 7bc0274 Add documentation on generating and saving overcloud service configuration e5b8ce6 Perform docker-py upgrade to docker prior to installing kolla 1b28351 Fix container image pull command 50ca4ab Configure kolla-ansible before pulling container images 141c765 Add initial unit tests for kayobe CLI commands 00d3a47 Ensure kolla virtualenv contains docker package rather than docker-py 68e2e5e Add node_config_directory variable to overcloud service config save playbook 2d036b6 Apply RabbitMQ workaround for issue #14 to all overcloud hosts 513cfe9 Add --node-config-dir argument to overcloud service configuration save 7cde822 Make --node-config-dir required when generating overcloud service configuration 250dd49 Fix pep8 failure in CLI, remove stale comment 3496637 Improve help output for kayobe CLI commands 69ff994 Add save playbook 0840319 Add deployment image build to upgrade guide 3952a88 Don't use {{ project }} for overcloud service configuration generate 05b9bfb WIP: changes for drac-pxe role to improve reliability de32048 Add commands to generate and save overcloud service configuration b83bb6e Upgrade docker SDK for python during overcloud host upgrade f047fbd Add workaround for ansible issue #21188 to inspection store 4b197da Add a note to requirements.txt about Ansible dell network module bug 30350 c231256 Relax requirements.txt to allow ansible 2.3 a8f95c9 Move two neutron options from custom neutron.conf to globals.yml f008b6a Update software dependencies to pike releases 444801a Update to use pike requirements ab57a13 Add kolla_enable_ flags for new services added in Pike 7c7bbc0 Kayobe 2.0.0 release a0f49cb Stop using KOLLA_BASE_PATH to set base_path 4acbf52 Untangle configuration of kolla and kolla-ansible 02aca93 Separate network configuration from high level kayobe configuration 0c03d18 Add kayobe overcloud host upgrade 610d388 Add a workaround for ansible bug 8743 for users.yml 2e21ee0 Fix singleplatform-eng.users role entry in requirements.yml c7197f9 Use vars: to pass variables to roles included via an include_role task e7e4344 Fix galaxy role upgrade cb4e45b Add release notes for implemented but unreleased features 2529d20 Fix some 'issues' raised by ansible-lint 188e58b Allow kolla-ansible prechecks to be skipped c4e75cc Add ability to run ansible-lint b788737 Remove recurse argument from source_checkout_path creation 1fc6e27 Simplify installation instructions with multiple platforms dcdb9f7 Use become when creating image cache directory for seed VM a62ad6b Allow switch ports to be excluded from NGS trunk port list 1216fec Use the singleplatform-eng.users role to create the kayobe ansible user 287acd1 Support configuration of user accounts b0e199c Support the netmiko_juniper driver for Junipers in genericswitch 3e46067 Use hosts in the network group for default NGS trunk ports b6dc893 Use controller sysctl parameters as the defaults for monitoring hosts b153fa1 Advertise internal ironic API to nodes during provisioning fda941b Add configuration of inspection allocation pool for dev environment a27e074 Pass though host variables from kayobe to kolla-ansible inventory c576e4d Add support for Ubuntu control hosts 7b50904 Fix check for SELinux status in kolla-ansible role 8d54422 Use . instead of source 05fd950 Add TravisCI status badge to README bbbc55e Add static configuration of eth1 in development environment 4fbf0dd Disabled vagrant auto-configure of interface a1f7068 Add release notes to index TOC cc2906e Add Travis CI config ee09ae8 Add sphinx8, a thin wrapper around doc8 that supports sphinx 2e98f97 Add support for a free-form configuration directory for glance 5c6d85a Add network configuration for gateways in provisioning and inspection networks 5304c0a Add a data store for ironic inspector introspection data 00b6d7e Support KAYOBE_BASE_PATH in kayobe python module 316d16c Add support for configuration of sysctl parameters fa69ee2 Send default gateway DHCP option during workload inspection 61ffac5 Use provisioning network to access TFTP server during workload inspection c2f42af Add release notes to documentation, with notes for 1.0.0 and 1.1.0 5cf2055 Decompose overcloud inventory file into top level, components, and services 7b02fe8 Determine overcloud_groups variable more intelligently 3466fd7 Add network group, move neutron and load balancing services to it f0b409e Add <type>_network_interfaces for controllers, monitoring, seed, seed-hypervisor 4544e67 Add ansible_host and ansible_user definitions for seed-hypervisor a423e44 Add -kl/--kolla-limit argument to limit kolla-ansible target hosts 10de93d Fix pep8 errors 6580c08 Changes to MichaelRigart.interfaces role now merged upstream 1d9e8fc Separate the external network into external and public e5cec6a Add support for setting bmc_type=intel for Intel BMCs c5a4e46 Disable selinux during provision 4260593 Sync /vagrant folder using virtualbox shared folder d05b126 We don't need to set the gateway for aio network bd4c76a Fix incorrect ansible module in overcloud-ipa-images.yml 4d25311 Update development guide to include pulling container images 1c1d92b Add command to save overcloud introspection data 4cdf792 Perform all host network configuration in a single pass b24db07 Explicitly set IP=0.0.0.0 on interfaces with no IP address 112e36a Fix serialisation of ip-allocation role 7d7dc48 Fix destroy of opensm and docker-registry containers e5f889b Don't pull opensm or docker-registry images when disabled or destroying f17f82a Improve configuration of IPA collectors and benchmarks 5d6658b Improve ironic deployment image build for overcloud ebb81e4 Add command to build IPA deployment images for the seed f638616 Add the ability to call --list-tasks a97c41b Fix test_utils error due unmocked subprocess call a3d1b07 Fix kolla-ansible unit test failures 20a8436 Don't install bifrost into local virtualenv aa33406 Add stackhpc.os-images role to role dependencies 1e75020 Work around issue with delegate_to not respecting ansible_user 39a37a1 Add a value for inspector LLDP interface in development config 1de4e88 Fix syntax for inclusion of openstackclient role 8182d7f Remove unnecessary comma from JunOS switch config 9b694aa Fix typo in junos switch provider for SSH private key file da82044 Updates to juniper switch configuration 2226a97 Add documentation for setting up a development VM dc2ea4c Improve Vagrantfile, add development configuration f611fa1 Workaround ansible_selinux fact either being a dict or false 664dcf5 Run kolla-ansible configuration in host configure fe6c6a3 Support docker overlay storage driver d20118a Don't fail when iscsi services are not installed 00d0ee6 Set default value of kolla_enable_haproxy to True 8c6ca86 Fix defaults for environment variable lookups b0983e8 Allow base_path to be configured via /home/stackhpc-mark/kayobe env var 2a66c77 Improvements to seed VM provisioning 7a8e087 Change ownership of libvirt volume to qemu:qemu after creation c7cf0d1 Add support for physical_network attribute of networks d0acd84 Fix issue with adding user to docker group 2afc6fa Add support for bonded (LAG) host network interfaces b9e1243 Add support for configuration of Juniper switches 9e4c08d Fix up configuration and comments for networks c01f583 Add kayobe seed vm deprovision command f76f244 Add configuration for seed hypervisor a82047f Improve automation of seed VM network configuration fba0e1e Remove inactive network interface definitions from seed group vars 58c02fe Set default for seed VM image to CentOS 7 cloud image 19ceec4 Use virtualenv_path for all virtualenvs 26cd76a Add virtualenv_path variable, the base path for creation of virtualenvs 3eb7f68 Add base_path variable to simplify configuration of paths e1b2730 Add missing Ansible bug 8743 workarounds to config samples ce9aae6 Only run configuration tasks of kolla-ansible ccea06b Run kolla-ansible configuration during kayobe seed service deploy 5ca0854 Fix seed introspection rules c2771d7 Add libvirt-host role 4751a96 Fix docker MTU configuration when no MTU specified d638402 Fix kolla-ansible.yml when no seed or controller hosts exist 73cca44 Install kolla-ansible during kayobe control host bootstrap c8d122e Add a comment in the ip-allocation role about Yum and virtualenvs d49cdb4 Fix ip_allocation module for netaddr-0.7.5 c3b3607 Update kayobe installation dependencies 7258eb5 Add documentation and examples for ip_allocation module d1f3ef3 Install package dependencies in ip-allocation role 403b558 Fix ip_allocation module when allocation file does not exist 7ca01eb Fix typo in bootstrap role 4238573 Add networks for out-of-band management a220f0f Update setup.py version to 1.1.0 943a4cd Fix upgrade of docker-registry and opensm containers 6f21f50 Add minimal configuration of murano 158adef Quote container image build regexes 775f80d Fix default variable name for kolla_extra_magnum 26ea28a Support configuration of Fluentd output plugins 2693269 Support destroying the overcloud services efed119 Support passing additional function arguments to kolla-ansible 447b678 Use correct version in setup.py, 1.0.0 4507077 Add a note on upgrading ironic deployment images 2b70f10 Fix overcloud image pull command for non-kolla services 325583a Remove configuration of inspector ramdisk_logs_dir 6a06244 Change docs link in README to readthedocs hosted documentation 968949a Move administration tasks from the deployment guide to a new page 6446652 Add an upgrade guide 67def26 Update kolla-ansible inventory for pike 8d46463 Don't include kolla-ansible.yml from kolla.yml f40978b Alter ansible version constraint to <2.3.0 328455e Add control host upgrade, stop using yum on host 896bd16 Rename usage docs to deployment, separate out usage 22b56d5 Add support for static routes on networks 8cbeee7 Handle configuration dump failures in host configure a53e3d6 Force no check mode during configuration dump 1577ab3 Add check flag to ansible function arguments 9a7fae1 Redirect stderr to kolla-build.log during container image build a01c39b Synchronise example config files 3b76ff3 Use correct variable name in introspection rule plays 0446677 Add ipmi_address variables for Dell compute node inventory b84cb70 Correct role name in provision-net.yml 9fbbfa1 Default docker registry to disabled 56ee18d Add configuration to deploy a Docker registry on a controller 4c9a6da Support interface name map for Dell LLDP switch port workaround c0cf1c9 Allow extra free-form configuration of ironic inspector's dnsmasq service 53ac42c Add documentation of idrac-bootstrap.yml playbook variable idrac_limit 1e08a14 Add configuration of OpenSM Infiniband subnet manager in a Docker container d0e0c02 Add minimal configuration of sahara a9e84f4 Fix broken unit tests 253ed03 Add tool to count LOC 44e8c06 Perform IP allocation after discovering overcloud hosts 3a9dd4f Fix specification of ansible intersected limits 9e858dc Small fixes for disable-glean role 19e5d27 Add support for limiting target iDRACs in idrac-bootstrap.yml be63721 Fix environment variable lookup for vault password 71d05fe Fix compute node limit for compute-node-provide.yml 59ecedf Update README with magnum support 27db155 Add support for monitoring nodes dc7c2d9 Add a role to disable glean e2bb70d Support ifup on either end of a veth pair d91b83e Add documentation of reconfiguration and upgrade commands d82e9bc Add documentation of network configuration 0c08dea Separate configuration docs from usage 9033145 Support updates of the kolla passwords.yml file 30b8524 Support vault encrypted config files with kolla-ansible f05c142 Run kolla-ansible playbook on overcloud service deploy d606c1c Support barbican service, defaults to disabled b73e964 Allow extra free-form configuration for nova 17165c4 Allow configuration of neutron extension drivers 149a765 Extract neutron-net role into a separate project on galaxy eb5551e Extract nova-flavor role into a separate project on galaxy ed22958 Make external networks external c80c250 Add a playbook to create a neutron network for the external network eb8a42e Support configuration of controller ports for neutron ML2 generic switch driver 6e64a78 Support extra user configuration for magnum.conf 17babeb Allow neutron routers to be configured in neutron-net role eb9b799 Allow kolla build customisations to be added 8fb2a53 Add flag to enable magnum service 29e5c9c Factor out compute node inventory generation into a separate playbook 97dae0a Add a playbook and role to configure Dell compute nodes to PXE boot 4d67602 Add a playbook and role to set the boot mode (bios, uefi) of Dell servers cffbb03 Fixes now pushed upstream to MichaelRigart.interfaces role 34f8898 Support existing flavors in compute node flavor registration 5c825bd Allow target compute nodes to be limited in compute-node-provide.yml 7727bb8 Fix IPA image registration b62150f typo ccc8507 Avoid Ansible 2.3, does odd things, for now 6785e6f Premature optimisation: prevent checksum during stat unless required cb40320 Allow IPA images to be built locally f06483e Support encryption of configuration using Ansible Vault cb7ed2f Allow utils.run_command to return command output 339c331 Bring switch_interface group variable file up to date 2a43254 Move shade, openstackclient and projects roles to Ansible Galaxy 8ba62b5 Add heat_stack_owner role to test project 85f4774 Refactor test-project role into a general role for project registration 47cef30 Add a playbook to register nova flavors for baremetal nodes 7920568 Add a playbook to make compute nodes available in ironic 4edd753 Remove test-infra.yml playbook 454e888 Add doc8 for documentation style checking, fix the one issue found 501e35d Fix minor flake8 issues 7807016 License kayobe project under Apache2 75e02d5 Allow compute nodes being discovered to be limited 50ae62d iDRAC bootstrap - allow port descriptions to be empty, make control host configurable 3fd2640 Add CLI commands to reconfigure and upgrade the overcloud services 3b5d71d Separate IP allocation pool for inspection from kayobe and neutron pools cd306f4 Add validation of OpenStack auth parameters 83c3455 Check BMC type is supported in kayobe overcloud bios raid configure c56d126 Add inspector rules to add system vendor to metadata, use to set bmc_type 35aab4e Add kayobe overcloud hardware inspect command dcf5e39 Generate a public environment file for accessing external APIs as admin d6f08f0 Add additional ironic inspector collectors 2984dcf Allow nodes in deploy failed state to be deprovisioned 5bec04a Add missing footer for neutron.yml be94f7b Add config file with defaults for ipa.yml 17c198f Support configuration of BIOS and RAID for controllers b9b6213 Add a BMC configuration file to consolidate IPMI credentials and BMC type b40c33f Add missing CLI commands to usage documentation 45e62f4 Add version requirements to dependencies b39371e Add missing return values from kayobe CLI wrapper methods 5bdc94d During inspection, only add PXE boot port 60858d7 Pass kayobe CLI's verbose option through to ansible 65ed0da Separate physical configuration for discovery 92c9746 Create an SSH key in test project playbook if none exists 456b10e Allow specification of container images to build 518be97 Support specification of separate IP allocation pool for Neutron 175bb0a Install ipmitool before compute node discovery 30f7538 Add configuration of Neutron including genericswitch mech driver a23bdd2 Allow inspector plugin list to be extended 0d2d48e Move to stackhpc-4.0.0.1 branch of kolla and kolla-ansible 704f25c Flesh out Ironic configuration, particularly drivers cb1909d Use versionless Keystone endpoints 453cbda Add support for configuration of Jinja2 blocks in kolla images 58e1dd8 Remove overridden yum repositories and keys b2a6034 Enable IP routing and SNAT in seed for use during provisioning df20c90 Flesh out usage documentation 41686a5 Fix --wipe-disks argument to host configure a5f5204 Add some future goals to the feature list 76c301b Fix semantics of a unit test 61f7f80 Expand documentation and change to sphinx from MarkDown 08b83ab Correct module name in ironic-inspector-rules role README d4df9cc Create README for ironic-inspector-rules role 5c1d05b Update README for dell-switch role. f313f52 Update README for dell-switch-bmp role d1a87c0 Add README files for dell-switch and dell-switch-bmp roles 34edfbe Use workaround for Ansible issue with dynamic delegate_to 90f0fd1 Playbook and role to register a test project and other resources ef1456d Add a playbook to trigger discovery of compute nodes 706233f Support registration of Neutron subnets without a gateway IP address aa6e2e2 Add inspector rules to workaround Dell switch LLDP issues eab9c57 Add default values for inspector rule interpolation variables 6495f1b Install EPEL whenever we install pip c1dd865 Dell switch: Add spaces before interface config to ensure correct match 2d84a41 Add physical switches to known SSH hosts 26be2c5 Support Neutron VLAN networks 7b2be06 Add kayobe 'overcloud deprovision command' 8968040 Fix overcloud provision playbook for provisioning multiple nodes 2c1cebb Remove executable bit from veth interface config files 20fdea4 Add support for Bare Metal Provisioning (BMP) of Dell switches via seed ff7c40d Add filter for network prefix 7b05214 Add support for bootstrapping iDRACs on Dell servers dc45036 Add a net_mask filter 17ce724 Move Dell switch configuration to a dell-switch role 12884dd Add an argument to host configure to wipe block devices 2014888 Parameter encapsulation for Docker role 01c3a83 Update main.yml 99abd72 Read setup.py install_requires from requirements.txt file cf5db1d Second pass at Docker MTU assignment a5fe4b7 Introduce 1450 MTU for Docker-encapsulated networking 3b95716 Add EPEL repo for python-pip 9b33694 Add ansible and netaddr as dependencies of kayobe 25ca11b Use forked interfaces role with support for improved interface bouncing da5721a Use forked interfaces role with support for MTU configuration 6b2f5dd Add support for configuring MTU on network interfaces 873b694 Use our fork of the network interfaces role until a fix has been merged db81292 Remove --bifrost-limit CLI argument - now works with --limit 7ef2e49 Check controller nodes' provisioning states and proceed to available 495f8c2 Wait for controller nodes to become active after provisioning 52833cf Use static IP on provisioning network to access the seed 3ca08af Add kayobe CLI command to configure the physical network 4652c29 Improve permissions around Kolla configuration. d16eaf1 Remove kolla-host role, replace with a dev-tools role to install useful packages c26b30e Add support for registering a provisioning network and subnet in Neutron 4e6effb Add introspection rules for overcloud 70e3ab4 Add support for registering IPA images in overcloud fb4973f Use shade role in test playbooks 0ea9003 Refactor a shade role out of ironic-inspector-roles 473d473 Add tags for kolla, kolla-openstack and kolla-bifrost roles 3067a28 Add commands for building seed and overcloud container images a4b5c26 Simplify specification of playbooks in CLI 77c5f08 Add configuration for Bifrost image to Kolla globals.yml 6c04c49 Ensure Kolla hosts are not running iSCSI initiator services 133511b Improve configuration of Ironic and Ironic inspector 3f9935a Improve network configuration & external network support 58932ae Improve comments around network roles e919ae1 Remove PROBLEMS, as it is out of date. e994882 Synchronise Kolla inventory template with upstream 23fa471 Use Kolla config path to install openrc f59f15e Workaround for lack of python selinux module on PyPI 20499de Install ansible in the kolla virtualenv to ensure jinja2>=2.8 b05f023 Discovery of overcloud hosts from Bifrost's Ironic inventory c97a73e Ensure kayobe CLI option groups aren't duplicated 6e6a554 Update Kolla inventory with seed IP address after provisioning 55c330b Break kolla-ansible playbook out of kolla playbook 27a286c Add an inspector rule to store the PXE interface MAC address bd5b65d Allocate IPs in serial to prevent allocation race conditions 8425b3c Configure LVM and Docker direct-lvm storage on the controllers 08d34db Add initial work on network configuration for management network cd33e4a Add playbooks for interactions with DRACs 54ff228 Add more introspection rules - local boot, LLDP description to name d072c06 A couple of small dependency fixes cd70699 Add network interface configuration variables to config files 4ede1ae Install Bifrost into Kayobe virtualenv 07a33c6 Configure Docker to use direct-lvm storage backend 1260f9a Add support for configuration of LVM PVs, VGs and LVs 4010b3d Bifrost & inspector: add rules, configure IPA ramdisk & kernel 474e48b Separate configuration of host OS from service deployment f57f06c Change default namespace to stackhpc and release to 4.0.0.0rc1 (Ocata) e7f979e Support configuration of Bifrost inspection hooks and kernel params 99cd65e Add playbooks to build seed and overcloud Docker images cbc9ef7 Support configuration of Kolla build sources b7d8ad6 Changes to .gitignore 91dac75 Allow Kolla's docker namespace to be configured b235bcf Support Ironic inspector in Bifrost container e7c3e7c Flesh out the README with installation and usage information baf17c8 Add unit tests and style checks for Kayobe python module caf9b52 Add kayobe python module with CLI ec0794a Update Kolla inventory with seed VM IP 2a1a81c Add disable-selinux element to controller image recipe e9afc5f Add support for Bifrost dib_os_release aad71bc Support Ocata split of kolla-ansible from kolla, allow custom kolla passwords d385fe3 Create dump path locally in dump-config.yml a3dc154 Use custom kolla configuration path in post-deploy a4493ef Add kolla-build.yml playbook to support building images on the seed 5404539 Update test playbooks 2ef0a4b Add support for Kolla's enable_haproxy flag and allow it to be false 6149584 Add Ansible group variables file for seed Ansible SSH host efc7424 Add support for adding a user account for SSH access f066dd2 Add a simple command to dump Ansible configuration for one or more hosts cbd6fcc Make SSH keys configurable 94b911d Increase reboot wait timeout in disable-selinux for non-virt hosts ead380c Add support for allocation pools to IP allocation role a082bd2 Support Kolla install from source b654a70 Initial mega commit of Kayobe 72ba304 Add first iteration of PoC deployment scripts Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt new file mode 100644 index 0000000..1753d82 --- /dev/null +++ b/requirements.txt @@ -0,0 +1,14 @@ +# The order of packages is significant, because pip processes them in the order +# of appearance. Changing the order has an impact on the overall integration +# process, which may cause wedges in the gate later. + +pbr>=2.0 # Apache-2.0 +# Ansible 2.3 has a bug (#30350) in the Dell network modules. Pull in a version +# with the fix backported. It can be installed by uncommenting the following +# line and commenting the one after. +# -e git+https://github.com/stackhpc/ansible@issue-30350-2.3#egg=ansible-issue-30350-... # GPLv3 +ansible>=2.4.0,<2.6.0 # GPLv3 +cliff>=2.5.0 # Apache +netaddr!=0.7.16,>=0.7.13 # BSD +PyYAML>=3.10.0 # MIT +setuptools!=24.0.0,!=34.0.0,!=34.0.1,!=34.0.2,!=34.0.3,!=34.1.0,!=34.1.1,!=34.2.0,!=34.3.0,!=34.3.1,>=16.0 # PSF/ZPL diff --git a/test-requirements.txt b/test-requirements.txt new file mode 100644 index 0000000..c4ae1e8 --- /dev/null +++ b/test-requirements.txt @@ -0,0 +1,15 @@ +# The order of packages is significant, because pip processes them in the order +# of appearance. Changing the order has an impact on the overall integration +# process, which may cause wedges in the gate later. + +ansible-lint>=3.0.0 # MIT +bashate>=0.2 # Apache-2.0 +coverage>=4.0 # Apache-2.0 +doc8 # Apache-2.0 +docker<3 # Apache-2.0 +hacking>=0.12.0,<0.13 # Apache-2.0 +molecule<3 # MIT +oslotest>=1.10.0 # Apache-2.0 +# NOTE(mgoddard): This is required by tools/sphinx8. +sphinx>=1.5.1 # BSD +stestr # Apache-2.0