On Thu, Dec 2, 2021 at 11:58 PM Lokendra Rathour <lokendrarathour@gmail.com> wrote:
Hi Alex,
From your message I could understand that Stein is no longer supported, but does it support ipv6, please advise.
We are also using stein to test the Upgrade feature of Triple0. We can start with Train as well and install and upgrade to Ussurie. But ipv6 support is something that we find a miss in the undercloud.conf or somewhere we can specify ipv6 details. 

Request you to please share any document/link which helps us try train on centos 8 with ipv6. For now, I am referring to this document.


Unfortunately our documentation is usually for newer versions and train documentation may not be there for ipv6 as we've reworked the network templates in recent releases.  At this point if you're starting from scratch using Wallaby is a better idea. 

If you are looking for some example templates, we actually have a job in CI that tests this and would have example configurations and commands.  This job only uses ipv6 for the overcloud networks and not for the provisioning network.

I don't think ipv6 provisioning is fully supported in Train. It might work but it's something you'd need to do some advanced configuration in order to get the interfaces correctly configured.

For our CI job, we have example templates in tripleo-heat-templates. These could be used as a starting point.
https://opendev.org/openstack/tripleo-heat-templates/src/branch/stable/train/ci/environments/network/multiple-nics-ipv6

Our ipv6 job is:

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train

If you click on the last successful build and click "View log", it'll take you to our CI logs.

Example: https://review.rdoproject.org/zuul/build/3190c53f516543edb1844f28004d5c33 

View Log takes you to:
https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train/3190c53/

All the deployment templates and configurations are located under the logs/undercloud/home/zuul path.

https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train/3190c53/logs/undercloud/home/zuul/

For ipv6 the network configuration, the important flags/options to `openstack overcloud deploy` would be:

-n network_data.yaml

This by default uses network_data.yaml from tripleo-heat-templates. This has the ip information for the various networks. You can take the default and copy/update it to fit your needs.  This file is used to generate some of the network configurations during the deployment.

-e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation-v6.yaml 

This environment file enables ipv6 for ports and configures all the networks for use.  This also has examples on overriding default ips.

-e /usr/share/openstack-tripleo-heat-templates/ci/environments/network/multiple-nics-ipv6/network-environment.yaml 
-e /home/zuul/network-environment.yaml

These configuration files contain the references for the network interface configs as well as setting the ranges necessary for the pools.

Good luck.
 
Thanks again for your quick response. Your response will help me decide things at the initial point only. 
-Lokendra


On Fri, Dec 3, 2021 at 11:28 AM Alex Schultz <aschultz@redhat.com> wrote:
The commands I provided were for Train on CentOS 8.  They were not related to the original topic of the email (ipv6) but rather the container startup issues.  Stein is no longer supported and it would not be recommended to use it. 

On Thu, Dec 2, 2021 at 10:36 PM Lokendra Rathour <lokendrarathour@gmail.com> wrote:
Hi Alex,
we are trying on centos 7/8, and similar commands for centos 7/8 is not working. Can you please suggest related commands for the same?
we have tried with yum/dnf in centos 7/8.

Just to confirm again we are using the stein release on centos 7 where we want to use ipv6 or dual-stack if possible.
Thanks once again for your help.

-Lokendra

On Thu, Nov 25, 2021 at 11:18 PM Alex Schultz <aschultz@redhat.com> wrote:
Yes IPV6 is supported, however the error you provided indicates problems starting containers.  Make sure you pin to container-tools:3.0 to ensure you get the version we expect.

    dnf module -y disable container-tools:rhel8 ;
    dnf module -y enable container-tools:3.0

On Thu, Nov 25, 2021 at 1:02 AM Lokendra Rathour <lokendrarathour@gmail.com> wrote:
Hi,
I am trying to install the undercloud using the ipv6 address on Centos 8 using Train release. 
It is seen that the deployment of undercloud is getting failed with error as mentioned below. Same deployment is working in the normal ipv4 case.
So Questions:
  1. is IPV6 supported in TripleO , if yes then please suggest how. 

Error:
nied",
    " attempt(s): 2",
    "2021-11-25 07:25:31,535 WARNING: 65355 -- Retrying running container: zaqar",
    "2021-11-25 07:25:34,887 ERROR: 65355 -- ['/usr/bin/podman', 'run', '--user', '0', '--name', 'container-puppet-zaqar', '--env', 'PUPPET_TAGS=file,file_line,concat,augeas,cron,zaqar_config', '--env', 'NAME=zaqar', '--env', 'HOSTNAME=undercloud', '--env', 'NO_ARCHIVE=', '--env', 'STEP=6', '--env', 'NET_HOST=true', '--env', 'DEBUG=False', '--volume', '/etc/localtime:/etc/localtime:ro', '--volume', '/tmp/tmp06nvxzzz:/etc/config.pp:ro', '--volume', '/etc/puppet/:/tmp/puppet-etc/:ro', '--volume', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '--volume', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '--volume', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '--volume', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '--volume', '/var/lib/config-data:/var/lib/config-data/:rw', '--volume', '/var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro', '--volume', '/var/lib/container-puppet/puppetlabs/:/opt/puppetlabs/:ro', '--volume', '/dev/log:/dev/log:rw', '--rm', '--log-driver', 'k8s-file', '--log-opt', 'path=/var/log/containers/stdouts/container-puppet-zaqar.log', '--security-opt', 'label=disable', '--volume', '/usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro', '--entrypoint', '/var/lib/container-puppet/container-puppet.sh', '--net', 'host', '--volume', '/etc/hosts:/etc/hosts:ro', '--volume', '/var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro', 'undercloud.ctlplane.localdomain:8787/tripleotraincentos8/centos-binary-zaqar-wsgi:current-tripleo'] run failed after Error: container_linux.go:370: starting container process caused: error adding seccomp filter rule for syscall bdflush: permission denied: OCI permission denied",
    " attempt(s): 3",
    "2021-11-25 07:25:34,888 WARNING: 65355 -- Retrying running container: zaqar",
    "2021-11-25 07:25:34,888 ERROR: 65355 -- Failed running container for zaqar",
    "2021-11-25 07:25:34,888 INFO: 65355 -- Finished processing puppet configs for zaqar",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring crond",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring glance_api",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring heat_api",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring heat",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring ironic_api",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring ironic",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring ironic_inspector",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring neutron",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring iscsid",
    "2021-11-25 07:25:34,889 ERROR: 65345 -- ERROR configuring keystone",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring memcached",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring mistral",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring mysql",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring nova",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring rabbitmq",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring placement",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring swift",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring swift_ringbuilder",
    "2021-11-25 07:25:34,890 ERROR: 65345 -- ERROR configuring zaqar"
   ],
   "stderr_lines": [],
   "_ansible_no_log": false,
   "attempts": 15
  }
 ]
]
Not cleaning working directory /home/stack/tripleo-heat-installer-templates
Not cleaning ansible directory /home/stack/undercloud-ansible-mw4crw92
Install artifact is located at /home/stack/undercloud-install-20211125072536.tar.bzip2

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Deployment Failed!

ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-o_qf1b4w

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Deployment failed.
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1345, in _standalone_deploy
    raise exceptions.DeploymentError('Deployment failed')
tripleoclient.exceptions.DeploymentError: Deployment failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1363, in _standalone_deploy
    raise exceptions.DeploymentError(six.text_type(e))
tripleoclient.exceptions.DeploymentError: Deployment failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/cliff/app.py", line 401, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python3.6/site-packages/cliff/command.py", line 185, in run
    return_code = self.take_action(parsed_args) or 0
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1451, in take_action
    if self._standalone_deploy(parsed_args) != 0:
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1400, in _standalone_deploy
    raise exceptions.DeploymentError('Deployment failed.')
tripleoclient.exceptions.DeploymentError: Deployment failed.
clean_up Deploy: Deployment failed.
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1345, in _standalone_deploy
    raise exceptions.DeploymentError('Deployment failed')
tripleoclient.exceptions.DeploymentError: Deployment failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1363, in _standalone_deploy
    raise exceptions.DeploymentError(six.text_type(e))
tripleoclient.exceptions.DeploymentError: Deployment failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/osc_lib/shell.py", line 136, in run
    ret_val = super(OpenStackShell, self).run(argv)
  File "/usr/lib/python3.6/site-packages/cliff/app.py", line 281, in run
    result = self.run_subcommand(remainder)
  File "/usr/lib/python3.6/site-packages/osc_lib/shell.py", line 176, in run_subcommand
    ret_value = super(OpenStackShell, self).run_subcommand(argv)
  File "/usr/lib/python3.6/site-packages/cliff/app.py", line 401, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python3.6/site-packages/cliff/command.py", line 185, in run
    return_code = self.take_action(parsed_args) or 0
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1451, in take_action
    if self._standalone_deploy(parsed_args) != 0:
  File "/usr/lib/python3.6/site-packages/tripleoclient/v1/tripleo_deploy.py", line 1400, in _standalone_deploy
    raise exceptions.DeploymentError('Deployment failed.')
tripleoclient.exceptions.DeploymentError: Deployment failed.

END return value: 1

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

An error has occured while deploying the Undercloud.

See the previous output for details about what went wrong.

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Command '['sudo', '--preserve-env', 'openstack', 'tripleo', 'deploy', '--standalone', '--standalone-role', 'Undercloud', '--stack', 'undercloud', '--local-domain=localdomain', '--local-ip=abce:abce:abce::1/64', '--templates=/usr/share/openstack-tripleo-heat-templates/', '--networks-file=network_data_undercloud.yaml', '--heat-native', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/undercloud.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/use-dns-for-vips.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/podman.yaml', '-e', '/home/stack/containers-prepare-parameter.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic-inspector.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/mistral.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/zaqar-swift-backend.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/disable-telemetry.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/tempest.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/ssl/no-tls-endpoints-public-ip.yaml', '--deployment-user', 'stack', '--output-dir=/home/stack', '-e', '/home/stack/tripleo-config-generated-env-files/undercloud_parameters.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/tripleo-validations.yaml', '--debug', '--log-file=install-undercloud.log', '-e', '/usr/share/openstack-tripleo-heat-templates/undercloud-stack-vstate-dropin.yaml']' returned non-zero exit status 1.
Command '['sudo', '--preserve-env', 'openstack', 'tripleo', 'deploy', '--standalone', '--standalone-role', 'Undercloud', '--stack', 'undercloud', '--local-domain=localdomain', '--local-ip=abce:abce:abce::1/64', '--templates=/usr/share/openstack-tripleo-heat-templates/', '--networks-file=network_data_undercloud.yaml', '--heat-native', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/undercloud.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/use-dns-for-vips.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/podman.yaml', '-e', '/home/stack/containers-prepare-parameter.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/ironic-inspector.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/mistral.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/zaqar-swift-backend.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/disable-telemetry.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/services/tempest.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/ssl/no-tls-endpoints-public-ip.yaml', '--deployment-user', 'stack', '--output-dir=/home/stack', '-e', '/home/stack/tripleo-config-generated-env-files/undercloud_parameters.yaml', '-e', '/usr/share/openstack-tripleo-heat-templates/environments/tripleo-validations.yaml', '--debug', '--log-file=install-undercloud.log', '-e', '/usr/share/openstack-tripleo-heat-templates/undercloud-stack-vstate-dropin.yaml']' returned non-zero exit status 1.
END return value: 1
[stack@undercloud ~]$




--