<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 02/08/16 03:11, Luigi Toscano wrote:<br>
</div>
<blockquote
cite="mid:2713383.UxTeEcNyeO@whitebase.usersys.redhat.com"
type="cite">
<pre wrap="">On Monday, 1 August 2016 10:56:21 CEST Zane Bitter wrote:
</pre>
<blockquote type="cite">
<pre wrap="">On 29/07/16 13:12, Luigi Toscano wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Hi all,
the Sahara jobs on the gate run the scenario tests (from sahara-tests)
using the fake plugin, so no real Hadoop/Spark/BigData operations are
performed, but other the other expected operations are executed on the
image. In order to do this we used for long time this image:
<a class="moz-txt-link-freetext" href="http://tarballs.openstack.org/heat-test-image/fedora-heat-test-image.qcow2">http://tarballs.openstack.org/heat-test-image/fedora-heat-test-image.qcow2</a>
which was updated early on this Friday (July 29th) from Fedora 22 to
Fedora 24 breaking our jobs with some cryptic error, maybe something
related to the repositories:
<a class="moz-txt-link-freetext" href="http://logs.openstack.org/46/335946/12/check/gate-sahara-tests-dsvm-scenar">http://logs.openstack.org/46/335946/12/check/gate-sahara-tests-dsvm-scenar</a>
io-nova-heat/5eeff52/logs/screen-sahara-eng.txt.gz?level=WARNING
</pre>
</blockquote>
<pre wrap="">So AFAICT from the log:
"rpm -q xfsprogs" prints "package xfsprogs is not installed" which is
expected if xfsprogs is not installed.
"yum install -y xfsprogs" redirects to "/usr/bin/dnf install -y
xfsprogs" which is expected on F24.
dnf fails with "Error: Failed to synchronize cache for repo 'fedora'"
which means it couldn't download the Fedora repository data.
"sudo mount -o data=writeback,noatime,nodiratime /dev/vdb
/volumes/disk1" then fails, doubtlessly because xfsprogs in not installed.
The absence of "sudo" in the yum command (when it does appear in the
mount command) is suspicious, but unlikely to be the reason it can't
sync the cache.
</pre>
</blockquote>
<pre wrap="">
This is why I mentioned the repositories, yes.
</pre>
<blockquote type="cite">
<pre wrap="">It's not obvious why this change of image would suddenly result in not
being able to install packages. It seems more likely that you've never
been able to install packages, but the previous image had xfsprogs
preinstalled and the new one doesn't. I don't know the specifics of how
that image is built, but certainly Fedora has been making an ongoing
effort to strip the cloud image back to basics.
</pre>
</blockquote>
<pre wrap="">
But this is not a normal Fedora image. If I read project-config correctly,
this is generated by this job:
<a class="moz-txt-link-freetext" href="http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/">http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/</a>
jobs/heat.yaml#n34
>From a brief chat on #heat on Friday it seems that the image is not gated or
checked or even used right now. Is it the case? The image is almost a simple
Fedora with few extra packages:
<a class="moz-txt-link-freetext" href="http://git.openstack.org/cgit/openstack/heat-templates/tree/hot/software-config/test-image/build-heat-test-image.sh">http://git.openstack.org/cgit/openstack/heat-templates/tree/hot/software-config/test-image/build-heat-test-image.sh</a>
</pre>
</blockquote>
<p><font face="Hack">We've stopped using this image recently because
the download failure rate from tarballs.openstack.org was
impacting heat's gate job reliability. We've switched to a
vanilla fedora for now because none of our tests actually
require a customized image. When we do have such tests we'll
likely do boot-time install of packages from an AFS infra
mirror.</font></p>
<p><font face="Hack">We had no idea that Sahara was using this image
in their gate, and it was certainly never intended for broader
consumption.</font></p>
<p><font face="Hack">Sahara would have a few options for an
alternative:</font></p>
<p><font face="Hack">- changing the test to work on a vanilla image</font></p>
<p><font face="Hack">- do boot-time installation of the required
packages</font></p>
<p><font face="Hack">- work with infra on creating and hosting a
custom image<br>
</font></p>
</body>
</html>