[TripleO] IPV6 Support

Alex Schultz aschultz at redhat.com
Fri Dec 3 21:07:43 UTC 2021


On Thu, Dec 2, 2021 at 11:58 PM Lokendra Rathour <lokendrarathour at gmail.com>
wrote:

> Hi Alex,
> From your message I could understand that Stein is no longer supported,
> but does it support ipv6, please advise.
> We are also using stein to test the Upgrade feature of Triple0. We can
> start with Train as well and install and upgrade to Ussurie. But ipv6
> support is something that we find a miss in the undercloud.conf or
> somewhere we can specify ipv6 details.
>
> Request you to please share any document/link which helps us try train on
> centos 8 with ipv6. For now, I am referring to this document.
> Undercloud Installation — TripleO 3.0.0 documentation (openstack.org)
> <https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/deployment/install_undercloud.html>
>
>
Unfortunately our documentation is usually for newer versions and train
documentation may not be there for ipv6 as we've reworked the network
templates in recent releases.  At this point if you're starting from
scratch using Wallaby is a better idea.

If you are looking for some example templates, we actually have a job in CI
that tests this and would have example configurations and commands.  This
job only uses ipv6 for the overcloud networks and not for the provisioning
network.

I don't think ipv6 provisioning is fully supported in Train. It might work
but it's something you'd need to do some advanced configuration in order to
get the interfaces correctly configured.

For our CI job, we have example templates in tripleo-heat-templates. These
could be used as a starting point.
https://opendev.org/openstack/tripleo-heat-templates/src/branch/stable/train/ci/environments/network/multiple-nics-ipv6

Our ipv6 job is:

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train

If you click on the last successful build and click "View log", it'll take
you to our CI logs.

Example:
https://review.rdoproject.org/zuul/build/3190c53f516543edb1844f28004d5c33

View Log takes you to:
https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train/3190c53/

All the deployment templates and configurations are located under the
logs/undercloud/home/zuul path.

https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train/3190c53/logs/undercloud/home/zuul/

For ipv6 the network configuration, the important flags/options to
`openstack overcloud deploy` would be:

-n network_data.yaml

This by default uses network_data.yaml from tripleo-heat-templates. This
has the ip information for the various networks. You can take the default
and copy/update it to fit your needs.  This file is used to generate some
of the network configurations during the deployment.

-e
/usr/share/openstack-tripleo-heat-templates/environments/network-isolation-v6.yaml

This environment file enables ipv6 for ports and configures all the
networks for use.  This also has examples on overriding default ips.

-e
/usr/share/openstack-tripleo-heat-templates/ci/environments/network/multiple-nics-ipv6/network-environment.yaml
-e /home/zuul/network-environment.yaml

These configuration files contain the references for the network interface
configs as well as setting the ranges necessary for the pools.

Good luck.


> Thanks again for your quick response. Your response will help me decide
> things at the initial point only.
> -Lokendra
>
>
> On Fri, Dec 3, 2021 at 11:28 AM Alex Schultz <aschultz at redhat.com> wrote:
>
>> The commands I provided were for Train on CentOS 8.  They were not
>> related to the original topic of the email (ipv6) but rather the container
>> startup issues.  Stein is no longer supported and it would not be
>> recommended to use it.
>>
>> On Thu, Dec 2, 2021 at 10:36 PM Lokendra Rathour <
>> lokendrarathour at gmail.com> wrote:
>>
>>> Hi Alex,
>>> we are trying on centos 7/8, and similar commands for centos 7/8 is not
>>> working. Can you please suggest related commands for the same?
>>> we have tried with yum/dnf in centos 7/8.
>>>
>>> Just to confirm again we are using the stein release on centos 7 where
>>> we want to use ipv6 or dual-stack if possible.
>>> Thanks once again for your help.
>>>
>>> -Lokendra
>>>
>>> On Thu, Nov 25, 2021 at 11:18 PM Alex Schultz <aschultz at redhat.com>
>>> wrote:
>>>
>>>> Yes IPV6 is supported, however the error you provided indicates
>>>> problems starting containers.  Make sure you pin to container-tools:3.0 to
>>>> ensure you get the version we expect.
>>>>
>>>>     dnf module -y disable container-tools:rhel8 ;
>>>>     dnf module -y enable container-tools:3.0
>>>>
>>>> On Thu, Nov 25, 2021 at 1:02 AM Lokendra Rathour <
>>>> lokendrarathour at gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>> I am trying to install the undercloud using the ipv6 address on Centos
>>>>> 8 using Train release.
>>>>> It is seen that the deployment of undercloud is getting failed with
>>>>> error as mentioned below. Same deployment is working in the normal ipv4
>>>>> case.
>>>>> So Questions:
>>>>>
>>>>>    1. is IPV6 supported in TripleO , if yes then please suggest how.
>>>>>
>>>>>
>>>>> Error:
>>>>> nied",
>>>>>     " attempt(s): 2",
>>>>>     "2021-11-25 07:25:31,535 WARNING: 65355 -- Retrying running
>>>>> container: zaqar",
>>>>>     "2021-11-25 07:25:34,887 ERROR: 65355 -- ['/usr/bin/podman',
>>>>> 'run', '--user', '0', '--name', 'container-puppet-zaqar', '--env',
>>>>> 'PUPPET_TAGS=file,file_line,concat,augeas,cron,zaqar_config', '--env',
>>>>> 'NAME=zaqar', '--env', 'HOSTNAME=undercloud', '--env', 'NO_ARCHIVE=',
>>>>> '--env', 'STEP=6', '--env', 'NET_HOST=true', '--env', 'DEBUG=False',
>>>>> '--volume', '/etc/localtime:/etc/localtime:ro', '--volume',
>>>>> '/tmp/tmp06nvxzzz:/etc/config.pp:ro', '--volume',
>>>>> '/etc/puppet/:/tmp/puppet-etc/:ro', '--volume',
>>>>> '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '--volume',
>>>>> '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro',
>>>>> '--volume',
>>>>> '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro',
>>>>> '--volume', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '--volume',
>>>>> '/var/lib/config-data:/var/lib/config-data/:rw', '--volume',
>>>>> '/var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro',
>>>>> '--volume', '/var/lib/container-puppet/puppetlabs/:/opt/puppetlabs/:ro',
>>>>> '--volume', '/dev/log:/dev/log:rw', '--rm', '--log-driver', 'k8s-file',
>>>>> '--log-opt', 'path=/var/log/containers/stdouts/container-puppet-zaqar.log',
>>>>> '--security-opt', 'label=disable', '--volume',
>>>>> '/usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro',
>>>>> '--entrypoint', '/var/lib/container-puppet/container-puppet.sh', '--net',
>>>>> 'host', '--volume', '/etc/hosts:/etc/hosts:ro', '--volume',
>>>>> '/var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro',
>>>>> 'undercloud.ctlplane.localdomain:8787/tripleotraincentos8/centos-binary-zaqar-wsgi:current-tripleo']
>>>>> run failed after Error: container_linux.go:370: starting container process
>>>>> caused: error adding seccomp filter rule for syscall bdflush: permission
>>>>> denied: OCI permission denied",
>>>>>     " attempt(s): 3",
>>>>>     "2021-11-25 07:25:34,888 WARNING: 65355 -- Retrying running
>>>>> container: zaqar",
>>>>>     "2021-11-25 07:25:34,888 ERROR: 65355 -- Failed running container
>>>>> for zaqar",
>>>>>     "2021-11-25 07:25:34,888 INFO: 65355 -- Finished processing puppet
>>>>> configs for zaqar",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring crond",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring
>>>>> glance_api",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring
>>>>> heat_api",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring heat",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring
>>>>> ironic_api",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring ironic",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring
>>>>> ironic_inspector",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring
>>>>> neutron",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring iscsid",
>>>>>     "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring
>>>>> keystone",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring
>>>>> memcached",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring
>>>>> mistral",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring mysql",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring nova",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring
>>>>> rabbitmq",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring
>>>>> placement",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring swift",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring
>>>>> swift_ringbuilder",
>>>>>     "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring zaqar"
>>>>>    ],
>>>>>    "stderr_lines": [],
>>>>>    "_ansible_no_log": false,
>>>>>    "attempts": 15
>>>>>   }
>>>>>  ]
>>>>> ]
>>>>> Not cleaning working directory
>>>>> /home/stack/tripleo-heat-installer-templates
>>>>> Not cleaning ansible directory /home/stack/undercloud-ansible-mw4crw92
>>>>> Install artifact is located at
>>>>> /home/stack/undercloud-install-20211125072536.tar.bzip2
>>>>>
>>>>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>>>>>
>>>>> Deployment Failed!
>>>>>
>>>>> ERROR: Heat log files:
>>>>> /var/log/heat-launcher/undercloud_deploy-o_qf1b4w
>>>>>
>>>>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>>>>>
>>>>> Deployment failed.
>>>>> Traceback (most recent call last):
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1345, in _standalone_deploy
>>>>>     raise exceptions.DeploymentError('Deployment failed')
>>>>> tripleoclient.exceptions.DeploymentError: Deployment failed
>>>>>
>>>>> During handling of the above exception, another exception occurred:
>>>>>
>>>>> Traceback (most recent call last):
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1363, in _standalone_deploy
>>>>>     raise exceptions.DeploymentError(six.text_type(e))
>>>>> tripleoclient.exceptions.DeploymentError: Deployment failed
>>>>>
>>>>> During handling of the above exception, another exception occurred:
>>>>>
>>>>> Traceback (most recent call last):
>>>>>   File "/usr/lib/python3.6/site-packages/cliff/app.py", line 401, in
>>>>> run_subcommand
>>>>>     result = cmd.run(parsed_args)
>>>>>   File "/usr/lib/python3.6/site-packages/cliff/command.py", line 185,
>>>>> in run
>>>>>     return_code = self.take_action(parsed_args) or 0
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1451, in take_action
>>>>>     if self._standalone_deploy(parsed_args) != 0:
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1400, in _standalone_deploy
>>>>>     raise exceptions.DeploymentError('Deployment failed.')
>>>>> tripleoclient.exceptions.DeploymentError: Deployment failed.
>>>>> clean_up Deploy: Deployment failed.
>>>>> Traceback (most recent call last):
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1345, in _standalone_deploy
>>>>>     raise exceptions.DeploymentError('Deployment failed')
>>>>> tripleoclient.exceptions.DeploymentError: Deployment failed
>>>>>
>>>>> During handling of the above exception, another exception occurred:
>>>>>
>>>>> Traceback (most recent call last):
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1363, in _standalone_deploy
>>>>>     raise exceptions.DeploymentError(six.text_type(e))
>>>>> tripleoclient.exceptions.DeploymentError: Deployment failed
>>>>>
>>>>> During handling of the above exception, another exception occurred:
>>>>>
>>>>> Traceback (most recent call last):
>>>>>   File "/usr/lib/python3.6/site-packages/osc_lib/shell.py", line 136,
>>>>> in run
>>>>>     ret_val = super(OpenStackShell, self).run(argv)
>>>>>   File "/usr/lib/python3.6/site-packages/cliff/app.py", line 281, in
>>>>> run
>>>>>     result = self.run_subcommand(remainder)
>>>>>   File "/usr/lib/python3.6/site-packages/osc_lib/shell.py", line 176,
>>>>> in run_subcommand
>>>>>     ret_value = super(OpenStackShell, self).run_subcommand(argv)
>>>>>   File "/usr/lib/python3.6/site-packages/cliff/app.py", line 401, in
>>>>> run_subcommand
>>>>>     result = cmd.run(parsed_args)
>>>>>   File "/usr/lib/python3.6/site-packages/cliff/command.py", line 185,
>>>>> in run
>>>>>     return_code = self.take_action(parsed_args) or 0
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1451, in take_action
>>>>>     if self._standalone_deploy(parsed_args) != 0:
>>>>>   File
>>>>> "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line
>>>>> 1400, in _standalone_deploy
>>>>>     raise exceptions.DeploymentError('Deployment failed.')
>>>>> tripleoclient.exceptions.DeploymentError: Deployment failed.
>>>>>
>>>>> END return value: 1
>>>>>
>>>>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>>>>>
>>>>> An error has occured while deploying the Undercloud.
>>>>>
>>>>> See the previous output for details about what went wrong.
>>>>>
>>>>> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
>>>>>
>>>>> Command '['sudo', '--preserve-env', 'openstack', 'tripleo', 'deploy',
>>>>> '--standalone', '--standalone-role', 'Undercloud', '--stack', 'undercloud',
>>>>> '--local-domain=localdomain', '--local-ip=abce:abce:abce::1/64',
>>>>> '--templates=/usr/share/openstack-tripleo-heat-templates/',
>>>>> '--networks-file=network_data_undercloud.yaml', '--heat-native', '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/undercloud.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/use-dns-for-vips.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/podman.yaml',
>>>>> '-e', '/home/stack/containers-prepare-parameter.yaml', '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic-inspector.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/mistral.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/zaqar-swift-backend.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/disable-telemetry.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/tempest.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/ssl/no-tls-endpoints-public-ip.yaml',
>>>>> '--deployment-user', 'stack', '--output-dir=/home/stack', '-e',
>>>>> '/home/stack/tripleo-config-generated-env-files/undercloud_parameters.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/tripleo-validations.yaml',
>>>>> '--debug', '--log-file=install-undercloud.log', '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/undercloud-stack-vstate-dropin.yaml']'
>>>>> returned non-zero exit status 1.
>>>>> Command '['sudo', '--preserve-env', 'openstack', 'tripleo', 'deploy',
>>>>> '--standalone', '--standalone-role', 'Undercloud', '--stack', 'undercloud',
>>>>> '--local-domain=localdomain', '--local-ip=abce:abce:abce::1/64',
>>>>> '--templates=/usr/share/openstack-tripleo-heat-templates/',
>>>>> '--networks-file=network_data_undercloud.yaml', '--heat-native', '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/undercloud.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/use-dns-for-vips.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/podman.yaml',
>>>>> '-e', '/home/stack/containers-prepare-parameter.yaml', '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic-inspector.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/mistral.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/zaqar-swift-backend.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/disable-telemetry.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/services/tempest.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/ssl/no-tls-endpoints-public-ip.yaml',
>>>>> '--deployment-user', 'stack', '--output-dir=/home/stack', '-e',
>>>>> '/home/stack/tripleo-config-generated-env-files/undercloud_parameters.yaml',
>>>>> '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/environments/tripleo-validations.yaml',
>>>>> '--debug', '--log-file=install-undercloud.log', '-e',
>>>>> '/usr/share/openstack-tripleo-heat-templates/undercloud-stack-vstate-dropin.yaml']'
>>>>> returned non-zero exit status 1.
>>>>> END return value: 1
>>>>> [stack at undercloud ~]$
>>>>>
>>>>>
>>>>>
>>>
>>> --
>>>
>>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20211203/105e7502/attachment-0001.htm>


More information about the openstack-discuss mailing list