<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Eli,
<div class=""><br class="">
</div>
<div class="">I like this proposed approach. We did have a discussion with a few Stackers from openstack-infra in Tokyo to express our interest in using bare metal for gate testing. That’s still a way out, but that may be another way to speed this up further.
A third idea would be to adjust the nova virt driver in our devstack image to use libvirt/lxc by default (instead of libvirt/kvm) which would allow for bays to be created more rapidly. This would potentially allow us to to perform repeated bay creations int
he same pipeline in a reasonable timeframe.
<div class=""><br class="">
</div>
<div class="">Adrian<br class="">
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Nov 11, 2015, at 11:02 PM, Qiao,Liyong <<a href="mailto:liyong.qiao@intel.com" class="">liyong.qiao@intel.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div bgcolor="#FFFFFF" text="#000000" class="">hello all:<br class="">
<br class="">
I will update some Magnum functional testing status, functional/integration testing<br class="">
is important to us, since we change/modify the Heat template rapidly, we need to<br class="">
verify the modification is correct, so we need to cover all templates Magnum has.<br class="">
and currently we only has k8s testing(only test with atomic image), we need to<br class="">
add more, like swarm(WIP), mesos(under plan), also , we may need to support COS image.<br class="">
lots of work need to be done.<br class="">
<br class="">
for the functional testing time costing, we discussed during the Tokyo summit,<br class="">
Adrian expected that we can reduce the timing cost to 20min.<br class="">
<br class="">
I did some analyses on the functional/integrated testing on gate pipeline.<br class="">
the stages will be follows:<br class="">
take k8s functional testing for example, we did follow testing case:<br class="">
<br class="">
1) baymodel creation<br class="">
2) bay(tls_disabled=True) creation/deletion<br class="">
3) bay(tls_disabled=False) creation to testing k8s api and delete it after testing.<br class="">
<br class="">
for each stage, the time costing is follows:<br class="">
<ul class="">
<li class="">devstack prepare: 5-6 mins </li><li class="">Running devstack: 15 mins(include downloading atomic image) </li><li class="">1) and 2) 15 mins </li><li class="">3) 15 +3 mins </li></ul>
totally about 60 mins currently a example is 1h 05m 57s<br class="">
see <a class="moz-txt-link-freetext" href="http://logs.openstack.org/10/243910/1/check/gate-functional-dsvm-magnum-k8s/5e61039/console.html">
http://logs.openstack.org/10/243910/1/check/gate-functional-dsvm-magnum-k8s/5e61039/console.html</a><br class="">
for all time stamps.<br class="">
<br class="">
I don't think it is possible to reduce time to 20 mins, since devstack setup will take 20 mins already.<br class="">
<br class="">
To reduce time, I suggest to only create 1 bay each pipeline and do vary kinds of testing<br class="">
on this bay, if want to test some specify bay (for example, network_driver etc), create<br class="">
a new pipeline .<br class="">
<br class="">
So, Ｉ think we can <b class="">delete 2)</b>, since 3) will do similar things(create/delete), the different is
<br class="">
3) use tls_disabled=False. <b class="">what do you think </b>?<br class="">
see <a class="moz-txt-link-freetext" href="https://review.openstack.org/244378">https://review.openstack.org/244378</a> for the time costing, will reduce to 45 min (48m 50s in the example.)<br class="">
<br class="">
=================================<br class="">
For other related functional testing works:<br class="">
I 'v done the split of functional testing per COE, we have pipeline as:<br class="">
<ul class="">
<li class="">gate-functional-dsvm-magnum-api 30 mins </li><li class="">gate-functional-dsvm-magnum-k8s 60 mins </li></ul>
And for swam pipeline, patches is done, under reviewing now(works fine on gate)<br class="">
<a class="moz-txt-link-freetext" href="https://review.openstack.org/244391">https://review.openstack.org/244391</a><br class="">
<a class="moz-txt-link-freetext" href="https://review.openstack.org/226125">https://review.openstack.org/226125</a><br class="">
<br class="">
========================<br class="">
<pre class="moz-signature" cols="72">--
BR, Eli(Li Yong)Qiao</pre>
</div>
<span id="cid:316C5459-6C4E-4F26-B9E7-9D838337ED1C@home"><liyong_qiao.vcf></span>__________________________________________________________________________<br class="">
OpenStack Development Mailing List (not for usage questions)<br class="">
Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">
OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</div>
</body>
</html>