<div dir="ltr"><div>Hi Mohan,</div><div>Even if I clone the master branch of networking-sfc project,I get the following errir when creating flow-classifier, therefore I do precise the logical-source-port.</div><div><br></div><div>2016-06-10 05:34:05.693 10799 ERROR neutron.api.v2.resource DBError: (pymysql.err.IntegrityError) (1048, u"Column 'logical_source_port' cannot be null") </div><div> </div><div>I'm trying the example in [1] </div><div><br></div><div>Here is a "ovs-ofctl dump-flows" on br-int ofter creating port-chain, I expected to see vxlan or gre tunnel encapsulation entries as explained in [1], may I know why there is no tunnel entry in br-int ?</div><div><br></div><div>sudo ovs-ofctl dump-flows br-int</div><div>NXST_FLOW reply (xid=0x4):</div><div> cookie=0x90444f3c8fabcbe0, duration=2840.983s, table=0, n_packets=0, n_bytes=0, idle_age=2840, priority=10,icmp6,in_port=16,icmp_type=136 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2837.039s, table=0, n_packets=0, n_bytes=0, idle_age=2837, priority=10,icmp6,in_port=17,icmp_type=136 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2831.688s, table=0, n_packets=0, n_bytes=0, idle_age=2831, priority=10,icmp6,in_port=19,icmp_type=136 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2831.038s, table=0, n_packets=0, n_bytes=0, idle_age=2831, priority=10,icmp6,in_port=18,icmp_type=136 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2801.555s, table=0, n_packets=0, n_bytes=0, idle_age=2801, priority=10,icmp6,in_port=20,icmp_type=136 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2840.605s, table=0, n_packets=8, n_bytes=336, idle_age=2591, priority=10,arp,in_port=16 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2836.759s, table=0, n_packets=0, n_bytes=0, idle_age=2836, priority=10,arp,in_port=17 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2831.485s, table=0, n_packets=0, n_bytes=0, idle_age=2831, priority=10,arp,in_port=19 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2830.816s, table=0, n_packets=21, n_bytes=882, idle_age=1605, priority=10,arp,in_port=18 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=2801.309s, table=0, n_packets=10, n_bytes=420, idle_age=545, priority=10,arp,in_port=20 actions=resubmit(,24)</div><div> cookie=0x90444f3c8fabcbe0, duration=15755.073s, table=0, n_packets=3241, n_bytes=366555, idle_age=545, priority=0 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=15754.687s, table=23, n_packets=0, n_bytes=0, idle_age=15754, priority=0 actions=drop</div><div> cookie=0x90444f3c8fabcbe0, duration=2841.201s, table=24, n_packets=0, n_bytes=0, idle_age=2841, priority=2,icmp6,in_port=16,icmp_type=136,nd_target=fe80::f816:3eff:fe2d:c29d actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2837.177s, table=24, n_packets=0, n_bytes=0, idle_age=2837, priority=2,icmp6,in_port=17,icmp_type=136,nd_target=fe80::f816:3eff:fee0:f8ca actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2831.794s, table=24, n_packets=0, n_bytes=0, idle_age=2831, priority=2,icmp6,in_port=19,icmp_type=136,nd_target=fe80::f816:3eff:fe86:a668 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2831.150s, table=24, n_packets=0, n_bytes=0, idle_age=2831, priority=2,icmp6,in_port=18,icmp_type=136,nd_target=fe80::f816:3eff:feb4:965f actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2801.675s, table=24, n_packets=0, n_bytes=0, idle_age=2801, priority=2,icmp6,in_port=20,icmp_type=136,nd_target=fe80::f816:3eff:fe5a:3097 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2840.794s, table=24, n_packets=8, n_bytes=336, idle_age=2591, priority=2,arp,in_port=16,arp_spa=55.55.55.3 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2836.901s, table=24, n_packets=0, n_bytes=0, idle_age=2836, priority=2,arp,in_port=17,arp_spa=55.55.55.4 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2831.587s, table=24, n_packets=0, n_bytes=0, idle_age=2831, priority=2,arp,in_port=19,arp_spa=55.55.55.6 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2830.933s, table=24, n_packets=21, n_bytes=882, idle_age=1605, priority=2,arp,in_port=18,arp_spa=55.55.55.5 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=2801.431s, table=24, n_packets=10, n_bytes=420, idle_age=545, priority=2,arp,in_port=20,arp_spa=55.55.55.8 actions=NORMAL</div><div> cookie=0x90444f3c8fabcbe0, duration=15754.273s, table=24, n_packets=0, n_bytes=0, idle_age=15754, priority=0 actions=drop</div><div><br></div><div><br></div><div>is there a link that explains how pipelines are created by SFC in br-int to compare with my flows entries ?</div><div><br></div><div>Does the flow-classifier referer to floating IPs or tenant network IPs to do the classification ?</div><div><br></div><div>Regards,</div><div><br></div><div>[1] <a href="http://docs.openstack.org/developer/networking-sfc/system_design%20and_workflow.html">http://docs.openstack.org/developer/networking-sfc/system_design%20and_workflow.html</a></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 9 June 2016 at 18:59, Henry Fourie <span dir="ltr"><<a href="mailto:louis.fourie@huawei.com" target="_blank">louis.fourie@huawei.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Alioune,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> The logical-source-port refers to a Neutron port of the VM that<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">originates the traffic that is to be processed by the port-chain.<u></u><u></u></span></p>
<p style="margin-left:20.4pt">
<u></u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><span>-<span style="font:7.0pt "Times New Roman"">
</span></span></span><u></u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Louis<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Alioune [mailto:<a href="mailto:balioune3@gmail.com" target="_blank">balioune3@gmail.com</a>]
<br>
<b>Sent:</b> Thursday, June 09, 2016 6:50 AM<br>
<b>To:</b> Mohan Kumar<br>
<b>Cc:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [neutron][SFC]<u></u><u></u></span></p>
</div><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Thanks Mohan,<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">After setting service_plugins and adding sfc tables to neutrondb, I can create port-pair, port-pair-group but classifier creation still claim a logical-source-port parameter.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">neutron flow-classifier-create --ethertype IPv4 --source-ip-prefix
<a href="http://55.55.55.2/32" target="_blank">55.55.55.2/32</a> --destination-ip-prefix <a href="http://55.55.55.9/32" target="_blank">
55.55.55.9/32</a> --protocol tcp --source-port 22:22 --destination-port 1:65000 FC1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">ERROR:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">neutron flow-classifier-create: error: argument --logical-source-port is required<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">Try 'neutron help flow-classifier-create' for more information.<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Please someone can explain what does --logical-source-port correspond to ?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Does the classifier require port-create like SF ?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On 9 June 2016 at 09:21, Mohan Kumar <<a href="mailto:nmohankumar1011@gmail.com" target="_blank">nmohankumar1011@gmail.com</a>> wrote:<u></u><u></u></p>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">Alioune,</span></b><u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">networking-sfc resources not installed / not reachable ,
</span></b><span style="font-size:7.5pt">If installation is okay, Possibly you may missed service_plugins entry in
<b>neutron.conf </b>( in case of manual networking-sfc installation) </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt">it should be ,</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">service_plugins = neutron.services.l3_router.l3_router_plugin.L3RouterPlugin,networking_sfc.services.flowclassifier.plugin.FlowClassifierPlugin,networking_sfc.services.sfc.plugin.SfcPlugin</span></b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt"> </span></b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">and restart q-svc services in screen -x </span></b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">Thanks.,</span></b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">Mohankumar.N </span></b><u></u><u></u></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Thu, Jun 9, 2016 at 12:58 AM, Alioune <<a href="mailto:balioune3@gmail.com" target="_blank">balioune3@gmail.com</a>> wrote:<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">I've switched from devstack to a normal deployment of openstack/mitaka and neutron-l2 agent is working fine with sfc. I can boot instances, create ports.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">However I can not create neither flow-classifier nor port-pair ...<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">neutron flow-classifier-create --ethertype IPv4 --source-ip-prefix
<a href="http://22.1.20.1/32" target="_blank">22.1.20.1/32</a> --destination-ip-prefix
<a href="http://172.4.5.6/32" target="_blank">172.4.5.6/32</a> --protocol tcp --source-port 23:23 --destination-port 100:100 FC1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">returns: neutron flow-classifier-create: error: argument --logical-source-port is required<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Try 'neutron help flow-classifier-create' for more information.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"> neutron port-pair-create --ingress=p1 --egress=p2 PP1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">404 Not Found<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">The resource could not be found.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Neutron server returns request_ids: ['req-1bfd0983-4a61-4b32-90b3-252004d90e65']<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">neutron --version<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">4.1.1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">p1,p2,p3,p4 have already been created, I can ping instances attached to these ports.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Since I've not installed networking-sfc, are there additional config to set in neutron config files ?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Or is it due to neutron-client version ?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards<u></u><u></u></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On 8 June 2016 at 20:31, Mohan Kumar <<a href="mailto:nmohankumar1011@gmail.com" target="_blank">nmohankumar1011@gmail.com</a>> wrote:<u></u><u></u></p>
<p>neutron agent not able to fetch details from ovsdb . Could you check below options 1.restart ovsdb-server and execute ovs_vsctl list-br 2. execute ovs- vsctl list-br manually and try to check error.<u></u><u></u></p>
<p>3. Could be ovs cleanup issue , please check the output of sudo service openvswitch restart and /etc/init.d/openvswich** restart , both should be same
<br>
<br>
Thanks.,<br>
Mohankumar.N<u></u><u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">On Jun 7, 2016 6:04 PM, "Alioune" <<a href="mailto:balioune3@gmail.com" target="_blank">balioune3@gmail.com</a>> wrote:<u></u><u></u></p>
<div>
<p class="MsoNormal">Hi Mohan/Cathy<u></u><u></u></p>
<div>
<p class="MsoNormal"> I've installed now ovs 2.4.0 and followed <a href="https://wiki.openstack.org/wiki/Neutron/ServiceInsertionAndChaining" target="_blank">https://wiki.openstack.org/wiki/Neutron/ServiceInsertionAndChaining</a> but I got this error :<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">+ neutron-ovs-cleanup<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.465 22147 INFO neutron.common.config [-] Logging enabled!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.468 22147 INFO neutron.common.config [-] /usr/local/bin/neutron-ovs-cleanup version 7.1.1.dev4<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', 'list-br'].<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl Traceback (most recent call last):<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl File "/opt/stack/neutron/neutron/agent/ovsdb/impl_vsctl.py", line 63, in run_vsctl<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl log_fail_as_error=False).rstrip()<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl File "/opt/stack/neutron/neutron/agent/linux/utils.py", line 159, in execute<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl raise RuntimeError(m)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl RuntimeError:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl Command: ['sudo', 'ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', 'list-br']<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl Exit code: 1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.505 22147 ERROR neutron.agent.ovsdb.impl_vsctl<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 CRITICAL neutron [-] RuntimeError:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Command: ['sudo', 'ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', 'list-br']<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Exit code: 1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron Traceback (most recent call last):<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/usr/local/bin/neutron-ovs-cleanup", line 10, in <module><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron sys.exit(main())<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/cmd/ovs_cleanup.py", line 89, in main<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron ovs_bridges = set(ovs.get_bridges())<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/common/ovs_lib.py", line 132, in get_bridges<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron return self.ovsdb.list_br().execute(check_error=True)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/ovsdb/impl_vsctl.py", line 83, in execute<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron txn.add(self)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/ovsdb/api.py", line 70, in __exit__<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron self.result = self.commit()<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/ovsdb/impl_vsctl.py", line 50, in commit<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron res = self.run_vsctl(args)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/ovsdb/impl_vsctl.py", line 70, in run_vsctl<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron ctxt.reraise = False<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron six.reraise(self.type_, self.value, self.tb)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/ovsdb/impl_vsctl.py", line 63, in run_vsctl<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron log_fail_as_error=False).rstrip()<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron File "/opt/stack/neutron/neutron/agent/linux/utils.py", line 159, in execute<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron raise RuntimeError(m)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron RuntimeError:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron Command: ['sudo', 'ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', 'list-br']<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron Exit code: 1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2016-06-07 11:25:36.512 22147 ERROR neutron<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ exit_trap<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ local r=1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">++ jobs -p<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ jobs=<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ [[ -n '' ]]<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ kill_spinner<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ '[' '!' -z '' ']'<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ [[ 1 -ne 0 ]]<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ echo 'Error on exit'<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Error on exit<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ generate-subunit 1465296797 1939 fail<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ [[ -z /opt/stack/logs ]]<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ /home/alioune/devstack/tools/worlddump.py -d /opt/stack/logs<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">World dumping... see /opt/stack/logs/worlddump-2016-06-07-112537.txt for details<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">+ exit 1<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On 7 June 2016 at 12:08, Mohan Kumar <<a href="mailto:nmohankumar1011@gmail.com" target="_blank">nmohankumar1011@gmail.com</a>> wrote:<u></u><u></u></p>
<div>
<p class="MsoNormal">Hi <b><span style="font-size:7.5pt">shihanzhang / </span></b><span style="font-size:8.5pt;font-family:"Helvetica","sans-serif";color:black">Alioune</span><b><span style="font-size:7.5pt"> ,</span></b><u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:7.5pt">your kernel (check with uname -r ) should support OVS version , below table compare kern</span></b><span style="color:black">el versions and corresponding Open vSwitch release support</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<pre style="word-wrap:break-word;white-space:pre-wrap"><span style="color:black">| Open vSwitch | Linux kernel<u></u><u></u></span></pre>
<pre><span style="color:black">|:------------:|:-------------:<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.4.x | 2.6.18 to 3.2<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.5.x | 2.6.18 to 3.2<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.6.x | 2.6.18 to 3.2<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.7.x | 2.6.18 to 3.3<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.8.x | 2.6.18 to 3.4<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.9.x | 2.6.18 to 3.8<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.10.x | 2.6.18 to 3.8<u></u><u></u></span></pre>
<pre><span style="color:black">| 1.11.x | 2.6.18 to 3.8<u></u><u></u></span></pre>
<pre><span style="color:black">| 2.0.x | 2.6.32 to 3.10<u></u><u></u></span></pre>
<pre><span style="color:black">| 2.1.x | 2.6.32 to 3.11<u></u><u></u></span></pre>
<pre><span style="color:black">| 2.3.x | 2.6.32 to 3.14<u></u><u></u></span></pre>
<pre><span style="color:black">| 2.4.x | 2.6.32 to 4.0<u></u><u></u></span></pre>
<pre><span style="color:black">| 2.5.x | 2.6.32 to 4.3<u></u><u></u></span></pre>
<pre style="word-wrap:break-word"><span style="color:black"><a href="http://openvswitch.org/support/dist-docs/FAQ.md.txt" target="_blank">http://openvswitch.org/support/dist-docs/FAQ.md.txt</a> (<br></span><span style="font-family:"Arial","sans-serif";color:black">### Q: What Linux kernel versions does each Open vSwitch release work with?)</span><u></u><u></u></pre>
<pre style="word-wrap:break-word">I installed SFC with OVS 2.4.0 and 2.5.0 and not seen any issue <u></u><u></u></pre>
<pre style="word-wrap:break-word"><span style="font-family:"Arial","sans-serif"">Please check SFC wiki for installation guidelines : </span><a href="https://wiki.openstack.org/wiki/Neutron/ServiceInsertionAndChaining" target="_blank"><span style="font-family:"Arial","sans-serif"">https://wiki.openstack.org/wiki/Neutron/ServiceInsertionAndChaining</span></a><u></u><u></u></pre>
<pre style="word-wrap:break-word"><u></u> <u></u></pre>
<pre style="word-wrap:break-word"><span style="font-family:"Arial","sans-serif"">Thanks.,</span><u></u><u></u></pre>
<pre style="word-wrap:break-word">Mohankumar.N<u></u><u></u></pre>
<pre style="word-wrap:break-word"><u></u> <u></u></pre>
<pre style="word-wrap:break-word"><u></u> <u></u></pre>
<pre style="word-wrap:break-word"><u></u> <u></u></pre>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">On Tue, Jun 7, 2016 at 1:46 PM, shihanzhang <<a href="mailto:ayshihanzhang@126.com" target="_blank">ayshihanzhang@126.com</a>> wrote:<u></u><u></u></p>
</div>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:"Helvetica","sans-serif";color:black">Hi Alioune and Cathy,</span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:"Helvetica","sans-serif";color:black"> For devstack on ubuntu14.04, the default ovs version is 2.0.2, so there was the error as Alioune said.</span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:"Helvetica","sans-serif";color:black"> Do we need to install speical ovs version in networking-sfc devstack plugin.sh?</span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><u></u><u></u></span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:"Helvetica","sans-serif";color:black"> </span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><u></u><u></u></span></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><br>
<br>
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><br>
</span><span style="font-size:8.5pt;font-family:"MS Gothic";color:black">在</span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"> 2016-06-07 07:48:26</span><span style="font-size:8.5pt;font-family:"MS Gothic";color:black">，</span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black">"Cathy
Zhang" <<a href="mailto:Cathy.H.Zhang@huawei.com" target="_blank">Cathy.H.Zhang@huawei.com</a>>
</span><span style="font-size:8.5pt;font-family:"MS Gothic";color:black">写道：</span><span style="font-size:8.5pt;font-family:"Arial","sans-serif";color:black"><u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span style="color:black">Hi Alioune,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:black">Which OVS version are you using?
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:black">Try openvswitch version 2.4.0 and restart the openvswitch-server before installing the devstack.
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:black">Cathy<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span><span style="color:black"><u></u><u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black"> Alioune
[mailto:<a href="mailto:balioune3@gmail.com" target="_blank">balioune3@gmail.com</a>]
<br>
<b>Sent:</b> Friday, June 03, 2016 9:07 AM<br>
<b>To:</b> <a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a><br>
<b>Cc:</b> Cathy Zhang<br>
<b>Subject:</b> [openstack-dev][neutron][SFC]</span><span style="color:black"><u></u><u></u></span></p>
</div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span style="color:black">Probleme with OpenStack SFC<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Hi all, <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">I've installed Openstack SFC with devstack and all module are corretly running except the neutron L2-agent<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">After a "screen -rd", it seems that there is a conflict between l2-agent and SFC (see trace bellow).<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">I solved the issue with "sudo ovs-vsctl set bridge br protocols=OpenFlow10,OpenFlow11,OpenFlow12,OpenFlow13" on all openvswitch bridge (br-int, br-ex,
br-tun and br-mgmt0).<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">I would like to know:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> - If someone knows why this error arrises ?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> - is there another way to solve it ?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Regards,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:56.323 WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] OVS
is dead. OVSNeutronAgent will keep running and checking OVS status periodically.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:56.330 DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] Agent
rpc_loop - iteration:4722 completed. Processed ports statistics: {'regular': {'updated': 0, 'added': 0, 'removed': 0}}. Elapsed:0.086 from (pid=12775) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1680<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.256 DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] Agent
rpc_loop - iteration:4723 started from (pid=12775) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1732<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.258 DEBUG neutron.agent.linux.utils [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] Running command (rootwrap daemon): ['ovs-ofctl',
'-O openflow13', 'dump-flows', 'br-int', 'table=23'] from (pid=12775) execute_rootwrap_daemon /opt/stack/neutron/neutron/agent/linux/utils.py:101<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.311 ERROR neutron.agent.linux.utils [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Command: ['ovs-ofctl', '-O openflow13', 'dump-flows', 'br-int', 'table=23']<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Exit code: 1<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Stdin:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Stdout:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Stderr: 2016-06-03T12:51:58Z|00001|vconn|WARN|unix:/var/run/openvswitch/br-int.mgmt: version negotiation failed (we support version 0x04, peer supports
version 0x01)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">ovs-ofctl: br-int: failed to connect to socket (Broken pipe)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 ERROR networking_sfc.services.sfc.common.ovs_ext_lib [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Command: ['ovs-ofctl', '-O openflow13', 'dump-flows', 'br-int', 'table=23']<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Exit code: 1<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Stdin:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Stdout:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Stderr: 2016-06-03T12:51:58Z|00001|vconn|WARN|unix:/var/run/openvswitch/br-int.mgmt: version negotiation failed (we support version 0x04, peer supports
version 0x01)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">ovs-ofctl: br-int: failed to connect to socket (Broken pipe)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib Traceback (most recent call last):<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib File "/opt/stack/networking-sfc/networking_sfc/services/sfc/common/ovs_ext_lib.py",
line 125, in run_ofctl<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib process_input=process_input)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib File "/opt/stack/neutron/neutron/agent/linux/utils.py", line 159, in execute<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib raise RuntimeError(m)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib RuntimeError:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib Command: ['ovs-ofctl', '-O openflow13', 'dump-flows', 'br-int', 'table=23']<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib Exit code: 1<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib Stdin:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib Stdout:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib Stderr: 2016-06-03T12:51:58Z|00001|vconn|WARN|unix:/var/run/openvswitch/br-int.mgmt:
version negotiation failed (we support version 0x04, peer supports version 0x01)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib ovs-ofctl: br-int: failed to connect to socket (Broken pipe)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.323 TRACE networking_sfc.services.sfc.common.ovs_ext_lib<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.335 ERROR networking_sfc.services.sfc.common.ovs_ext_lib [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] Unable to execute ['ovs-ofctl',
'-O openflow13', 'dump-flows', 'br-int', 'table=23'].<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.337 WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] OVS
is dead. OVSNeutronAgent will keep running and checking OVS status periodically.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2016-06-03 12:51:58.341 DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-1258bbbc-7211-4cfd-ab7c-8b856604f768 None None] Agent
rpc_loop - iteration:4723 completed. Processed ports statistics: {'regular': {'updated': 0, 'added': 0, 'removed': 0}}. Elapsed:0.085 from (pid=12775) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1680<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> <u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<p> <u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
<br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>