[openstack-dev] [devstack][python/pip][octavia] pip failure during octavia/pike image build by devstack
Michael Johnson
johnsomor at gmail.com
Sun May 20 01:57:25 UTC 2018
Yes, this just started occurring with Thursday/Fridays updates to the
Ubuntu cloud image upstream of us.
I have posted a patch for Queens here: https://review.openstack.org/#/c/569531
We will be back porting that as soon as we can to the other stable
releases. Please review the backports as they come out to help the
team merge them as soon as possible.
Michael (johnsom)
On Fri, May 18, 2018 at 10:16 PM, rezroo <openstack at roodsari.us> wrote:
> Hi - let's try this again - this time with pike :-)
> Any suggestions on how to get the image builder to create a larger loop
> device? I think that's what the problem is.
> Thanks in advance.
>
> 2018-05-19 05:03:04.523 | 2018-05-19 05:03:04.523 INFO
> diskimage_builder.block_device.level1.mbr [-] Write partition entry blockno
> [0] entry [0] start [2048] length [4190208] [57/1588]
> 2018-05-19 05:03:04.523 | 2018-05-19 05:03:04.523 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo sync]
> 2018-05-19 05:03:04.538 | 2018-05-19 05:03:04.537 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo kpartx -avs
> /dev/loop3]
> 2018-05-19 05:03:04.642 | 2018-05-19 05:03:04.642 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo mkfs -t ext4 -i 4096
> -J size=64 -L cloudimg-rootfs -U 376d4b4d-2597-4838-963a-3d
> 9c5fcb5d9c -q /dev/mapper/loop3p1]
> 2018-05-19 05:03:04.824 | 2018-05-19 05:03:04.823 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo mkdir -p
> /tmp/dib_build.zv2VZo3W/mnt/]
> 2018-05-19 05:03:04.833 | 2018-05-19 05:03:04.833 INFO
> diskimage_builder.block_device.level3.mount [-] Mounting [mount_mkfs_root]
> to [/tmp/dib_build.zv2VZo3W/mnt/]
> 2018-05-19 05:03:04.834 | 2018-05-19 05:03:04.833 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo mount
> /dev/mapper/loop3p1 /tmp/dib_build.zv2VZo3W/mnt/]
> 2018-05-19 05:03:04.850 | 2018-05-19 05:03:04.850 INFO
> diskimage_builder.block_device.blockdevice [-] create() finished
> 2018-05-19 05:03:05.527 | 2018-05-19 05:03:05.527 INFO
> diskimage_builder.block_device.blockdevice [-] Getting value for
> [image-block-device]
> 2018-05-19 05:03:06.168 | 2018-05-19 05:03:06.168 INFO
> diskimage_builder.block_device.blockdevice [-] Getting value for
> [image-block-devices]
> 2018-05-19 05:03:06.845 | 2018-05-19 05:03:06.845 INFO
> diskimage_builder.block_device.blockdevice [-] Creating fstab
> 2018-05-19 05:03:06.845 | 2018-05-19 05:03:06.845 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo mkdir -p
> /tmp/dib_build.zv2VZo3W/built/etc]
> 2018-05-19 05:03:06.855 | 2018-05-19 05:03:06.855 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo cp
> /tmp/dib_build.zv2VZo3W/states/block-device/fstab
> /tmp/dib_build.zv2VZo3W/bui
> lt/etc/fstab]
> 2018-05-19 05:03:12.946 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/10-bootloader-default-cmdline
> 2018-05-19 05:03:12.947 | + source
> /tmp/in_target.d/finalise.d/../environment.d/10-bootloader-default-cmdline
> 2018-05-19 05:03:12.947 | ++ export 'DIB_BOOTLOADER_DEFAULT_CMDLINE=nofb
> nomodeset vga=normal'
> 2018-05-19 05:03:12.947 | ++ DIB_BOOTLOADER_DEFAULT_CMDLINE='nofb nomodeset
> vga=normal'
> 2018-05-19 05:03:12.948 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/10-dib-init-system.bash
> 2018-05-19 05:03:12.950 | + source
> /tmp/in_target.d/finalise.d/../environment.d/10-dib-init-system.bash
> 2018-05-19 05:03:12.950 | ++++ dirname
> /tmp/in_target.d/finalise.d/../environment.d/10-dib-init-system.bash
> 2018-05-19 05:03:12.951 | +++
> PATH='$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/tmp/in_target.d/finalise.d/../environment.d/..'
> 2018-05-19 05:03:12.951 | +++ dib-init-system
> 2018-05-19 05:03:12.953 | ++ DIB_INIT_SYSTEM=systemd
> 2018-05-19 05:03:12.953 | ++ export DIB_INIT_SYSTEM
> 2018-05-19 05:03:12.954 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/10-pip-cache
> 2018-05-19 05:03:12.955 | + source
> /tmp/in_target.d/finalise.d/../environment.d/10-pip-cache
> 2018-05-19 05:03:12.955 | ++ export PIP_DOWNLOAD_CACHE=/tmp/pip
> 2018-05-19 05:03:12.955 | ++ PIP_DOWNLOAD_CACHE=/tmp/pip
> 2018-05-19 05:03:12.956 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/10-ubuntu-distro-name.bash
> 2018-05-19 05:03:12.958 | + source
> /tmp/in_target.d/finalise.d/../environment.d/10-ubuntu-distro-name.bash
> 2018-05-19 05:03:12.958 | ++ export DISTRO_NAME=ubuntu
> 2018-05-19 05:03:12.958 | ++ DISTRO_NAME=ubuntu
> 2018-05-19 05:03:12.958 | ++ export DIB_RELEASE=xenial
> 2018-05-19 05:03:12.958 | ++ DIB_RELEASE=xenial
> 2018-05-19 05:03:12.959 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/11-dib-install-type.bash
> 2018-05-19 05:03:12.961 | + source
> /tmp/in_target.d/finalise.d/../environment.d/11-dib-install-type.bash
> 2018-05-19 05:03:12.961 | ++ export DIB_DEFAULT_INSTALLTYPE=source
> 2018-05-19 05:03:12.961 | ++ DIB_DEFAULT_INSTALLTYPE=source
> 2018-05-19 05:03:12.962 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/14-manifests
> 2018-05-19 05:03:12.963 | + source
> /tmp/in_target.d/finalise.d/../environment.d/14-manifests
> 2018-05-19 05:03:12.964 | ++ export
> DIB_MANIFEST_IMAGE_DIR=/etc/dib-manifests
> 2018-05-19 05:03:12.964 | ++ DIB_MANIFEST_IMAGE_DIR=/etc/dib-manifests
> 2018-05-19 05:03:12.964 | ++ export
> DIB_MANIFEST_SAVE_DIR=/opt/stack/octavia/diskimage-create/amphora-x64-haproxy.d/
> 2018-05-19 05:03:12.964 | ++
> DIB_MANIFEST_SAVE_DIR=/opt/stack/octavia/diskimage-create/amphora-x64-haproxy.d/
> 2018-05-19 05:03:12.965 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/50-dib-python-version
> 2018-05-19 05:03:12.966 | + source
> /tmp/in_target.d/finalise.d/../environment.d/50-dib-python-version
> 2018-05-19 05:03:12.966 | ++ '[' -z '' ']'
> 2018-05-19 05:03:12.966 | ++ '[' ubuntu == ubuntu ']'
> 2018-05-19 05:03:12.966 | ++ '[' xenial == trusty ']'
> 2018-05-19 05:03:12.966 | ++ '[' -z '' ']'
> 2018-05-19 05:03:12.966 | ++ DIB_PYTHON_VERSION=3
> 2018-05-19 05:03:12.966 | ++ export DIB_PYTHON_VERSION
> 2018-05-19 05:03:12.967 | ++ export DIB_PYTHON=python3
> 2018-05-19 05:03:12.967 | ++ DIB_PYTHON=python3
> 2018-05-19 05:03:12.967 | dib-run-parts Sat May 19 05:03:12 UTC 2018
> Sourcing environment file
> /tmp/in_target.d/finalise.d/../environment.d/99-cloud-init-datasources.bash
> [1/1588]
> 2018-05-19 05:03:12.969 | + source
> /tmp/in_target.d/finalise.d/../environment.d/99-cloud-init-datasources.bash
> 2018-05-19 05:03:12.969 | ++ export DIB_CLOUD_INIT_DATASOURCES=ConfigDrive
> 2018-05-19 05:03:12.969 | ++ DIB_CLOUD_INIT_DATASOURCES=ConfigDrive
> 2018-05-19 05:03:12.970 | dib-run-parts Sat May 19 05:03:12 UTC 2018 Running
> /tmp/in_target.d/finalise.d/50-bootloader
> 2018-05-19 05:03:13.020 | INFO:root:Mapping for bootloader : grub-pc
> 2018-05-19 05:03:13.050 | Reading package lists...
> 2018-05-19 05:03:13.227 | Building dependency tree...
> 2018-05-19 05:03:13.227 | Reading state information...
> 2018-05-19 05:03:13.347 | The following additional packages will be
> installed:
> 2018-05-19 05:03:13.348 | grub-common grub-gfxpayload-lists grub-pc-bin
> grub2-common libfreetype6
> 2018-05-19 05:03:13.348 | Suggested packages:
> 2018-05-19 05:03:13.348 | multiboot-doc grub-emu xorriso desktop-base
> 2018-05-19 05:03:13.348 | Recommended packages:
> 2018-05-19 05:03:13.348 | os-prober
> 2018-05-19 05:03:13.349 | The following NEW packages will be installed:
> 2018-05-19 05:03:13.349 | grub-common grub-gfxpayload-lists grub-pc
> grub-pc-bin grub2-common
> 2018-05-19 05:03:13.350 | libfreetype6
> 2018-05-19 05:03:13.365 | 0 upgraded, 6 newly installed, 0 to remove and 0
> not upgraded.
> 2018-05-19 05:03:13.365 | Need to get 3621 kB of archives.
> 2018-05-19 05:03:13.365 | After this operation, 17.6 MB of additional disk
> space will be used.
> 2018-05-19 05:03:13.365 | E: You don't have enough free space in
> /var/cache/apt/archives/.
> 2018-05-19 05:03:13.981 | 2018-05-19 05:03:13.981 INFO
> diskimage_builder.block_device.level3.mount [-] Called for [mount_mkfs_root]
> 2018-05-19 05:03:13.981 | 2018-05-19 05:03:13.981 INFO
> diskimage_builder.block_device.utils [-] Calling [sudo umount
> /tmp/dib_build.zv2VZo3W/mnt/]
> 2018-05-19 05:03:13.991 | Traceback (most recent call last):
> 2018-05-19 05:03:13.991 | File "/usr/local/bin/dib-block-device", line 11,
> in <module>
> 2018-05-19 05:03:13.991 | sys.exit(main())
> 2018-05-19 05:03:13.991 | File
> "/usr/local/lib/python2.7/dist-packages/diskimage_builder/block_device/cmd.py",
> line 120, in main
> 2018-05-19 05:03:13.991 | return bdc.main()
> 2018-05-19 05:03:13.991 | File
> "/usr/local/lib/python2.7/dist-packages/diskimage_builder/block_device/cmd.py",
> line 115, in main
> 2018-05-19 05:03:13.991 | self.args.func()
> 2018-05-19 05:03:13.991 | File
> "/usr/local/lib/python2.7/dist-packages/diskimage_builder/block_device/cmd.py",
> line 39, in cmd_umount
> 2018-05-19 05:03:13.991 | self.bd.cmd_umount()
> 2018-05-19 05:03:13.991 | File
> "/usr/local/lib/python2.7/dist-packages/diskimage_builder/block_device/blockdevice.py",
> line 420, in cmd_umount
> 2018-05-19 05:03:13.991 | node.umount()
> 2018-05-19 05:03:13.991 | File
> "/usr/local/lib/python2.7/dist-packages/diskimage_builder/block_device/level3/mount.py",
> line 98, in umount
> 2018-05-19 05:03:13.992 | exec_sudo(["umount",
> self.state['mount'][self.mount_point]['path']])
> 2018-05-19 05:03:13.992 | File
> "/usr/local/lib/python2.7/dist-packages/diskimage_builder/block_device/utils.py",
> line 125, in exec_sudo
> 2018-05-19 05:03:13.992 | ' '.join(sudo_cmd))
> 2018-05-19 05:03:13.992 | subprocess.CalledProcessError: Command 'sudo
> umount /tmp/dib_build.zv2VZo3W/mnt/' returned non-zero exit status 32
> 2018-05-19 05:03:14.036 |
> +/opt/stack/octavia/devstack/plugin.sh:build_octavia_worker_image:1
> exit_trap
> 2018-05-19 05:03:14.042 | +./stack.sh:exit_trap:521 local
> r=1
> 2018-05-19 05:03:14.048 | ++./stack.sh:exit_trap:522 jobs
> -p
> 2018-05-19 05:03:14.055 | +./stack.sh:exit_trap:522 jobs=
> 2018-05-19 05:03:14.060 | +./stack.sh:exit_trap:525 [[ -n
> '' ]]
> 2018-05-19 05:03:14.066 | +./stack.sh:exit_trap:531 '[' -f
> /tmp/tmp.ivo3lCHyBX ']'
> 2018-05-19 05:03:14.071 | +./stack.sh:exit_trap:532 rm
> /tmp/tmp.ivo3lCHyBX
> 2018-05-19 05:03:14.077 | +./stack.sh:exit_trap:536
> kill_spinner
> 2018-05-19 05:03:14.083 | +./stack.sh:kill_spinner:417 '[' '!'
> -z '' ']'
> 2018-05-19 05:03:14.089 | +./stack.sh:exit_trap:538 [[ 1
> -ne 0 ]]
> 2018-05-19 05:03:14.094 | +./stack.sh:exit_trap:539 echo
> 'Error on exit'
> 2018-05-19 05:03:14.094 | Error on exit
> 2018-05-19 05:03:14.100 | +./stack.sh:exit_trap:541 type -p
> generate-subunit
> 2018-05-19 05:03:14.105 | +./stack.sh:exit_trap:542
> generate-subunit 1526704935 1259 fail
> 2018-05-19 05:03:14.528 | +./stack.sh:exit_trap:544 [[ -z
> /tmp ]]
> 2018-05-19 05:03:14.533 | +./stack.sh:exit_trap:547
> /home/stack/devstack/tools/worlddump.py -d /tmp
> stack at os100-pike-1:~/devstack$ 2018-05-19 05:03:15.527 |
> +./stack.sh:exit_trap:556 exit 1
>
> $ df -h
> Filesystem Size Used Avail Use% Mounted on
> udev 7.4G 0 7.4G 0% /dev
> tmpfs 1.5G 47M 1.5G 4% /run
> /dev/sda1 30G 5.7G 24G 20% /
> tmpfs 7.4G 4.0K 7.4G 1% /dev/shm
> tmpfs 5.0M 0 5.0M 0% /run/lock
> tmpfs 7.4G 0 7.4G 0% /sys/fs/cgroup
> tmpfs 1.5G 0 1.5G 0% /run/user/1000
> /dev/loop0 2.0G 47M 2.0G 3% /opt/stack/data/swift/drives/sdb1
> tmpfs 7.4G 504K 7.4G 1% /tmp/dib_build.zv2VZo3W
> tmpfs 7.4G 1.8G 5.6G 25% /tmp/dib_image.O61liYjw
> /dev/mapper/loop3p1 1.9G 1.7G 316K 100% /tmp/dib_build.zv2VZo3W/mnt
>
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
More information about the OpenStack-dev
mailing list