[openstack-dev] [all] Reviewing coverage jobs set up

Andreas Jaeger aj at suse.com
Mon Jul 18 18:09:54 UTC 2016


While looking at coverage jobs to enable them to allow use of
constraints in post jobs (something which has just been introduced and
needs some more testing before we take on the other jobs), I noticed
that we have quite a few coverage
jobs that are failing.

In general, I think coverage jobs should be run as check job so
that you know how the coverage changes. Running them only in the post
job means that in practice nobody sees the output of the job.

Out of 83 jobs having a post coverage job, 19 failed. See
below for list of failures and a list of all repos that have a coverage
post job setup.

I suggest that projects review their coverage setup and decide whether
they want to run it as part of the check queue, fix it, or remove it.

Btw. if you want to get the output of the post job, check the git SHA.
logs are found at ``http://logs.openstack.org/<first two characters of
commit SHA>/<commit SHA>``. For example, if a change is committed with
the sha 'deadbeef123456', the logs will be found at
``http://logs.openstack.org/de/deadbeef123456``.

Here're the failures (including some that run successful but coverage
did not collect any data):

cloudkitty-dashboard:
http://logs.openstack.org/11/113209883e3e9131602f35593bc0cb8880db19b9/post/cloudkitty-dashboard-coverage/c390a24/

designate-dashboard:
http://logs.openstack.org/56/5627ddb4a6eedb751fecced56d277961aac92436/post/designate-dashboard-coverage/73650dc/

horizon:
http://logs.openstack.org/8f/8f35c43bc5b4182d6e82a67cdc2beccd2364da8a/post/horizon-coverage/5535457/

monasca-ui:
http://logs.openstack.org/f0/f05e4992fb6ce722ac00c4aa6ad30ff89b453476/post/monasca-ui-coverage/af5105e/

murano-agent:
http://logs.openstack.org/14/1450eb39fb9f6dcbe1b70167d23d16e74f28dbd5/post/murano-agent-coverage/ee9c33a/

nodepool:
http://logs.openstack.org/e3/e345107476a82ddad82ea99e184398e0d0e7e85a/post/nodepool-coverage-db/8a0ee23/

nova:
http://logs.openstack.org/3f/3f700b5a5a498ba08e77378d34f059c3fa6845d8/post/nova-coverage-db/2bdabf8/

nova-docker:
http://logs.openstack.org/03/034a4842fc1ebba5912e02cff8cd197ae81eb0c3/post/nova-docker-coverage/879d790/

os-net-config:
http://logs.openstack.org/6b/6bb8412ef3d3f163d91f2884081b743f07a78f18/post/os-net-config-coverage/cba622a/

poppy:
http://logs.openstack.org/09/0948c854e4b8543f01d909437f09cfb23e71a5b0/post/poppy-coverage/ccbc8ad/

python-aodhclient:
http://logs.openstack.org/65/65d2e625ee3b359bae154a5da3931f48b48fe720/post/python-aodhclient-coverage/2d8a169/

python-gnocchiclient:
http://logs.openstack.org/81/81e1b91beb3d85760e574951e240a381d6a4d008/post/python-gnocchiclient-coverage/2d9a414/

python-monascaclient (this should be fixed with the enabling of
constraints):
http://logs.openstack.org/17/17b9eaa1ede715344ac9cb2049c63e25604476cb/post/python-monascaclient-coverage/2b44b1b/

sahara-dashboard:
http://logs.openstack.org/bc/bcf8e2938d7085799a3754a9ff6d245d73ec33ff/post/sahara-dashboard-coverage/7807a4e/console.html.gz

sahara-tests:
http://logs.openstack.org/91/914bf0646f4de85107324f0aa05e856961bb0ee6/post/sahara-tests-coverage/b65352b/

solum-dashboard:
http://logs.openstack.org/82/8235df5a5ab0d48a6b407931c1d998102050b1b9/post/solum-dashboard-coverage/8d23679/

trove:
http://logs.openstack.org/4a/4ad0dfe88c6362356c8083d167f43ab495da661d/post/trove-coverage-db/990fd71/

trove-dashboard:
http://logs.openstack.org/01/01815715539fad40e06e974d6fdf840957051b69/post/trove-dashboard-coverage/908f8df/

turbo-hipster:
http://logs.openstack.org/7e/7ef12b758020176fb3e13e5bb0154084b1456797/post/turbo-hipster-coverage/ab2d17a/


Full list of repos with coverage job defined:

openstack-dev/hacking hacking-coverage
openstack-dev/pbr pbr-coverage
openstack-infra/bindep bindep-coverage
openstack-infra/grafyaml grafyaml-coverage
openstack-infra/jenkins-job-builder jenkins-job-builder-coverage
openstack-infra/nodepool nodepool-coverage-db
openstack-infra/python-storyboardclient python-storyboardclient-coverage
openstack-infra/shade shade-coverage
openstack-infra/storyboard storyboard-coverage-db
openstack-infra/zuul zuul-coverage-db
openstack/ara ara-coverage
openstack/ceilometermiddleware ceilometermiddleware-coverage
openstack/cloudbase-init cloudbase-init-coverage
openstack/cloudkitty cloudkitty-coverage
openstack/cloudkitty-dashboard cloudkitty-dashboard-coverage
openstack/designate designate-coverage-db
openstack/designate-dashboard designate-dashboard-coverage
openstack/heat heat-coverage-db
openstack/heat-translator heat-translator-coverage
openstack/horizon horizon-coverage
openstack/ironic ironic-coverage-db
openstack/ironic-lib ironic-lib-coverage
openstack/keystonemiddleware keystonemiddleware-coverage
openstack/kiloeyes kiloeyes-coverage
openstack/manila manila-coverage-db
openstack/monasca-ui monasca-ui-coverage
openstack/murano murano-coverage-db
openstack/murano-agent murano-agent-coverage
openstack/neutron neutron-coverage
openstack/neutron-dynamic-routing neutron-dynamic-routing-coverage
openstack/neutron-fwaas neutron-fwaas-coverage
openstack/neutron-vpnaas neutron-vpnaas-coverage
openstack/nova nova-coverage-db
openstack/nova-docker nova-docker-coverage
openstack/os-apply-config os-apply-config-coverage
openstack/os-cloud-config os-cloud-config-coverage
openstack/os-collect-config os-collect-config-coverage
openstack/os-net-config os-net-config-coverage
openstack/oslo.concurrency oslo.concurrency-coverage
openstack/oslo.i18n oslo.i18n-coverage
openstack/oslo.messaging oslo.messaging-coverage
openstack/oslotest oslotest-coverage
openstack/osprofiler osprofiler-coverage
openstack/poppy poppy-coverage
openstack/poppy-ui poppy-ui-coverage
openstack/pycadf pycadf-coverage
openstack/python-aodhclient python-aodhclient-coverage
openstack/python-ceilometerclient python-ceilometerclient-coverage
openstack/python-cinderclient python-cinderclient-coverage
openstack/python-cloudkittyclient python-cloudkittyclient-coverage
openstack/python-designateclient python-designateclient-coverage
openstack/python-glanceclient python-glanceclient-coverage
openstack/python-gnocchiclient python-gnocchiclient-coverage
openstack/python-heatclient python-heatclient-coverage
openstack/python-ironicclient python-ironicclient-coverage
openstack/python-keystoneclient python-keystoneclient-coverage
openstack/python-manilaclient python-manilaclient-coverage
openstack/python-monascaclient python-monascaclient-coverage
openstack/python-neutronclient python-neutronclient-coverage
openstack/python-novaclient python-novaclient-coverage
openstack/python-openstackclient python-openstackclient-coverage
openstack/python-openstacksdk python-openstacksdk-coverage
openstack/python-rackclient python-rackclient-coverage
openstack/python-saharaclient python-saharaclient-coverage
openstack/python-solumclient python-solumclient-coverage
openstack/python-swiftclient python-swiftclient-coverage
openstack/rally rally-coverage
openstack/refstack-client refstack-client-coverage
openstack/sahara sahara-coverage-db
openstack/sahara-dashboard sahara-dashboard-coverage
openstack/sahara-tests sahara-tests-coverage
openstack/solum solum-coverage
openstack/solum-dashboard solum-dashboard-coverage
openstack/solum-infra-guestagent solum-infra-guestagent-coverage
openstack/swift swift-coverage
openstack/swift3 swift3-coverage
openstack/taskflow taskflow-coverage-db
openstack/tempest tempest-coverage
openstack/tooz tooz-coverage
openstack/tosca-parser tosca-parser-coverage
openstack/trove trove-coverage-db
openstack/trove-dashboard trove-dashboard-coverage
openstack/turbo-hipster turbo-hipster-coverage

Andreas
-- 
 Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi
  SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
   GF: Felix Imendörffer, Jane Smithard, Graham Norton,
       HRB 21284 (AG Nürnberg)
    GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126




More information about the OpenStack-dev mailing list