Open Stack

Hi, Yipei,

When you play Tricircle, it’s important to know that Tricircle is the OpenStack API gateway to other OpenStack instances. In the Readme, Pod1, Pod2 are two OpenStack instances, before trying Tricircle, you can make sure the environment is normal or not by executeing command separately on Pod1, Pod2, just  Nova –os-region-name Pod1, or Nova –os-region-name Pod2, in fact, because Pod1,Pod2 are two normal OpenStack instances, any command to Pod1,Pod2 should be successful.  Otherwise that means there are some issue in the installation of the environment itself. Only when each bottom OpenStack can work correctly, then you can even manually add Tricircle, or through the scripts in the github to install Tircircle automaticly, as the API gateway to Pod1 and Pod2, just like you add one load balancer before your multiple web servers.

After the Tricircle was added, then the API will flow from Tricircle services like Nova-APIGW/Cinder-APIGW/Neutron API to the bottom Pod1, Pod2.

So if you use Nova boot, and some error happened, you can ask question:

1.      Is the command sent to the Tricircle Nova-APIGW?

2.      What’ll will do for the Nova-APIGW for the next step?

3.      Is the API request forwarded by Tricircle correctly to the proper bottom OpenStack?

4.      Is the bottom OpenStack working normal even without Tricircle?

5.      Is the API request forwarded by Tricircle includes the correct request content?

6.      …

You can carry the map before you try to fix the issue. And break down a big system into smaller part, and make sure which part works fine, which not in order.

From the information you provided, can’t make judgment the error is occurred at Tricircle services, or bottom pod, or which pod. Don’t know which step the error occurred. And don’t know the request information, how the requested will be routed and processed, a lot of context needed to diagnose an error.

Best Regards
Chaoyi Huang ( Joe Huang )

From: Yipei Niu [mailto:newypei at gmail.com]
Sent: Wednesday, March 23, 2016 10:36 AM
To: OpenStack Development Mailing List (not for usage questions)
Cc: joehuang; Zhiyuan Cai
Subject: [tricircle] playing tricircle with two node configuration

Hi, Joe and Zhiyuan,

I have already finished installing devstack in two nodes with tricircle. I encounter some errors when testing cross-pod L3 networking with DevStack. I followed the README.md in github, every thing goes well until I boot virtual machines with the following command:

nova boot --flavor 1 --image 60a8184b-a4be-463d-a8a1-48719edc37a3 --nic net-id=76356099-f3bd-40a5-83bd-600b78b671eb --availability-zone az1 vm1

The info in the terminal is as follows:
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
ERROR (ClientException): Unknown Error (HTTP 500)

I run rejoin-stack.sh and find some error in n-api screen. In n-api.log, the error is as follows:
2016-03-22 19:19:38.248 ^[[01;31mERROR nova.api.openstack.extensions [^[[01;36mreq-cf58e7aa-bd7d-483f-aa57-bca5268ce963 ^[[00;36madmin admin^[[01;31m] ^[[01;35m^[[01;31mUnexpected exception in API method^[[00m
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00mTraceback (most recent call last):
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/api/openstack/extensions.py", line 478, in wrapped
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    return f(*args, **kwargs)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/api/validation/__init__.py", line 73, in wrapper
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    return func(*args, **kwargs)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/api/validation/__init__.py", line 73, in wrapper
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    return func(*args, **kwargs)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 604, in create
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    **create_kwargs)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/hooks.py", line 149, in inner
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    rv = f(*args, **kwargs)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/compute/api.py", line 1504, in create
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    check_server_group_quota=check_server_group_quota)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/compute/api.py", line 1097, in _create_instance
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    auto_disk_config, reservation_id, max_count)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/compute/api.py", line 871, in _validate_and_build_base_options
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    pci_request_info, requested_networks)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/network/neutronv2/api.py", line 981, in create_pci_requests_for_sriov_ports
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    neutron = get_client(context, admin=True)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/network/neutronv2/api.py", line 149, in get_client
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    _ADMIN_AUTH = _load_auth_plugin(CONF)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m  File "/opt/stack/nova/nova/network/neutronv2/api.py", line 125, in _load_auth_plugin
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m    raise neutron_client_exc.Unauthorized(message=err_msg)
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00mUnauthorized: Unknown auth plugin: None
^[[01;31m2016-03-22 19:19:38.248 TRACE nova.api.openstack.extensions ^[[01;35m^[[00m
2016-03-22 20:04:19.992 ^[[00;36mINFO nova.api.openstack.wsgi [^[[01;36mreq-ed35efe8-5dc0-40b0-bb2b-c1a73618aa50 ^[[00;36madmin admin^[[00;36m] ^[[01;35m^[[00;36mHTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'neutronclient.common.exceptions.Unauthorized'>^[[00m
2016-03-22 20:04:19.993 ^[[00;32mDEBUG nova.api.openstack.wsgi [^[[01;36mreq-ed35efe8-5dc0-40b0-bb2b-c1a73618aa50 ^[[00;36madmin admin^[[00;32m] ^[[01;35m^[[00;32mReturning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'neutronclient.common.exceptions.Unauthorized'>^[[00m ^[[00;33mfrom (pid=17273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1180^[[00m
2016-03-22 20:04:20.007 ^[[00;36mINFO nova.osapi_compute.wsgi.server [^[[01;36mreq-ed35efe8-5dc0-40b0-bb2b-c1a73618aa50 ^[[00;36madmin admin^[[00;36m] ^[[01;35m^[[00;36m192.168.56.101 "POST /v2.1/1f824c3b19a64fa1a401125f41324731/servers HTTP/1.1" status: 500 len: 520 time: 1.1018770^[[00m

Best regards,
Yipei
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20160323/ab28c5e3/attachment.html>