[Openstack] error creating instance
Uwe Sauter
uwe.sauter.de at gmail.com
Mon Jun 29 12:40:19 UTC 2015
Oh, I think I see where your confusion comes from.
You have to completely separate your thoughts of the way internal (tenant) networks and external (provider) networks are managed.
Internal (tenant) networks are managed by Neutron. External (provider) networks are outside of the configuration abilities of Neutron.
Defining
network_vlan_ranges = external:1101:2000
tells Neutron that there are several provider networks with VLAN IDs ranging from 1101 to 2000 that are all tagged with the name
"external" that you use when you create an external network like
# neutron net-create ext-net --router:external True --provider:physical_network external …
^^^^^^^^
As Neutron has no idea which VLAN ID it should use for the external network, it cannot work that way.
On the other hand if you want to use VLANs as tenant networks, you need a bridge on the compute host that you tag with a name, like
[ml2_type_vlan]
tenant_network_types = vlan
network_vlan_ranges = physnet1:2000:2099
[ovs]
bridge_mappings = physnet1:br-eno1
You also have to create that bridge manually and assign the physical interface to it.
The same applies for the network node that also needs to know on which bridge the "physnet1" network is connected and which VLAN
IDs it can use.
Then you also need the switch ports where compute node and network node are connected to be trunk ports, meaning they allow
traffic for the selected VLAN IDs.
Hope that helps,
Uwe
Am 29.06.2015 um 14:26 schrieb Uwe Sauter:
> Your configuration on host compute5 is missing the bridge mapping.
>
>
> Am 29.06.2015 um 14:19 schrieb Yngvi Páll Þorfinnsson:
>> OK Uwe
>>
>> On the controller node , this is present in the [ml2_type_vlan]
>> /etc/neutron/plugins/ml2/ml2_conf.ini
>>
>> [ml2_type_vlan]
>> tenant_network_types = vlan,gre
>> network_vlan_ranges = external:1101:2000
>>
>> i.e. I added the line
>> tenant_network_types = vlan,gre
>>
>> I rebooted the controller server, but I get the same error as before.
>>
>> Ok, I'm sending the detailed output for neutron agent-list ;
>>
>> root at controller2:/# neutron agent-list
>> +--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
>> | id | agent_type | host | alive | admin_state_up | binary |
>> +--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
>> | 1c06fb08-105c-4659-ae0e-4a905931311e | Open vSwitch agent | compute5 | :-) | True | neutron-openvswitch-agent |
>> | 3a8d9e36-c743-4f68-92c7-c0aa970b3f45 | Open vSwitch agent | network2 | :-) | True | neutron-openvswitch-agent |
>> | a3733a57-9867-4d3f-9a3a-f948c0c0da8c | Metadata agent | network2 | :-) | True | neutron-metadata-agent |
>> | a510128e-6848-48f2-8640-86d1dd1d58e4 | Open vSwitch agent | compute4 | xxx | True | neutron-openvswitch-agent |
>> | b7201350-4c74-4509-8ed9-248e7ec8d057 | DHCP agent | network2 | :-) | True | neutron-dhcp-agent |
>> | cf356c5d-d6da-4648-a2e8-90d594e46d11 | L3 agent | network2 | :-) | True | neutron-l3-agent |
>> +--------------------------------------+--------------------+----------+-------+----------------+---------------------------+
>> root at controller2:/#
>> root at controller2:/# neutron agent-show 1c06fb08-105c-4659-ae0e-4a905931311e
>> +---------------------+--------------------------------------------+
>> | Field | Value |
>> +---------------------+--------------------------------------------+
>> | admin_state_up | True |
>> | agent_type | Open vSwitch agent |
>> | alive | True |
>> | binary | neutron-openvswitch-agent |
>> | configurations | { |
>> | | "arp_responder_enabled": false, |
>> | | "tunneling_ip": "172.22.15.17", |
>> | | "devices": 0, |
>> | | "l2_population": false, |
>> | | "tunnel_types": [ |
>> | | "gre" |
>> | | ], |
>> | | "enable_distributed_routing": false, |
>> | | "bridge_mappings": {} |
>> | | } |
>> | created_at | 2015-06-26 14:51:14 |
>> | description | |
>> | heartbeat_timestamp | 2015-06-29 12:12:50 |
>> | host | compute5 |
>> | id | 1c06fb08-105c-4659-ae0e-4a905931311e |
>> | started_at | 2015-06-26 15:14:42 |
>> | topic | N/A |
>> +---------------------+--------------------------------------------+
>> root at controller2:/#
>> root at controller2:/# neutron agent-show 3a8d9e36-c743-4f68-92c7-c0aa970b3f45
>> +---------------------+--------------------------------------------+
>> | Field | Value |
>> +---------------------+--------------------------------------------+
>> | admin_state_up | True |
>> | agent_type | Open vSwitch agent |
>> | alive | True |
>> | binary | neutron-openvswitch-agent |
>> | configurations | { |
>> | | "arp_responder_enabled": false, |
>> | | "tunneling_ip": "172.22.15.14", |
>> | | "devices": 2, |
>> | | "l2_population": false, |
>> | | "tunnel_types": [ |
>> | | "gre" |
>> | | ], |
>> | | "enable_distributed_routing": false, |
>> | | "bridge_mappings": { |
>> | | "external": "br-ex" |
>> | | } |
>> | | } |
>> | created_at | 2015-06-11 12:38:06 |
>> | description | |
>> | heartbeat_timestamp | 2015-06-29 12:13:34 |
>> | host | network2 |
>> | id | 3a8d9e36-c743-4f68-92c7-c0aa970b3f45 |
>> | started_at | 2015-06-29 08:47:18 |
>> | topic | N/A |
>> +---------------------+--------------------------------------------+
>> root at controller2:/#
>> root at controller2:/# neutron agent-show a3733a57-9867-4d3f-9a3a-f948c0c0da8c
>> +---------------------+-----------------------------------------------------------------+
>> | Field | Value |
>> +---------------------+-----------------------------------------------------------------+
>> | admin_state_up | True |
>> | agent_type | Metadata agent |
>> | alive | True |
>> | binary | neutron-metadata-agent |
>> | configurations | { |
>> | | "nova_metadata_ip": "172.22.14.22", |
>> | | "nova_metadata_port": 8775, |
>> | | "metadata_proxy_socket": "/var/lib/neutron/metadata_proxy" |
>> | | } |
>> | created_at | 2015-06-11 12:38:06 |
>> | description | |
>> | heartbeat_timestamp | 2015-06-29 12:13:23 |
>> | host | network2 |
>> | id | a3733a57-9867-4d3f-9a3a-f948c0c0da8c |
>> | started_at | 2015-06-29 08:47:30 |
>> | topic | N/A |
>> +---------------------+-----------------------------------------------------------------+
>> root at controller2:/#
>> root at controller2:/# neutron agent-show b7201350-4c74-4509-8ed9-248e7ec8d057
>> +---------------------+----------------------------------------------------------+
>> | Field | Value |
>> +---------------------+----------------------------------------------------------+
>> | admin_state_up | True |
>> | agent_type | DHCP agent |
>> | alive | True |
>> | binary | neutron-dhcp-agent |
>> | configurations | { |
>> | | "subnets": 1, |
>> | | "use_namespaces": true, |
>> | | "dhcp_lease_duration": 86400, |
>> | | "dhcp_driver": "neutron.agent.linux.dhcp.Dnsmasq", |
>> | | "networks": 1, |
>> | | "ports": 3 |
>> | | } |
>> | created_at | 2015-06-11 12:38:08 |
>> | description | |
>> | heartbeat_timestamp | 2015-06-29 12:13:28 |
>> | host | network2 |
>> | id | b7201350-4c74-4509-8ed9-248e7ec8d057 |
>> | started_at | 2015-06-29 08:47:26 |
>> | topic | dhcp_agent |
>> +---------------------+----------------------------------------------------------+
>> root at controller2:/#
>> root at controller2:/# neutron agent-show cf356c5d-d6da-4648-a2e8-90d594e46d11
>> +---------------------+-------------------------------------------------------------------------------+
>> | Field | Value |
>> +---------------------+-------------------------------------------------------------------------------+
>> | admin_state_up | True |
>> | agent_type | L3 agent |
>> | alive | True |
>> | binary | neutron-l3-agent |
>> | configurations | { |
>> | | "router_id": "", |
>> | | "agent_mode": "legacy", |
>> | | "gateway_external_network_id": "", |
>> | | "handle_internal_only_routers": true, |
>> | | "use_namespaces": true, |
>> | | "routers": 1, |
>> | | "interfaces": 1, |
>> | | "floating_ips": 0, |
>> | | "interface_driver": "neutron.agent.linux.interface.OVSInterfaceDriver", |
>> | | "external_network_bridge": "br-ex", |
>> | | "ex_gw_ports": 1 |
>> | | } |
>> | created_at | 2015-06-16 10:20:18 |
>> | description | |
>> | heartbeat_timestamp | 2015-06-29 12:13:57 |
>> | host | network2 |
>> | id | cf356c5d-d6da-4648-a2e8-90d594e46d11 |
>> | started_at | 2015-06-29 08:47:22 |
>> | topic | l3_agent |
>> +---------------------+-------------------------------------------------------------------------------+
>> root at controller2:/#
>>
>>
>> best regards
>> Yngvi
>>
>>
>> -----Original Message-----
>> From: Uwe Sauter [mailto:uwe.sauter.de at gmail.com]
>> Sent: 29. júní 2015 11:43
>> To: openstack at lists.openstack.org
>> Subject: Re: [Openstack] error creating instance
>>
>> Oh, and one other thing:
>>
>> please do a
>>
>> # neutron agent-list
>>
>> and for each entry with agent_type=="Open vSwitch agent" do a
>>
>> # neutron agent-show <ID of that entry>
>>
>> and provide that information. This way we can see the actual running configuration…
>>
>>
>> Uwe
>>
>>
>>
>>
>>
>>
>> Am 29.06.2015 um 13:01 schrieb Yngvi Páll Þorfinnsson:
>>> Hi
>>>
>>> I should add to this information,
>>> I'm using VLANs on compute, network and swift nodes.
>>>
>>> But not on the controller node.
>>> I'm not sure if that causes problems ?
>>>
>>> Best regards
>>> Yngvi
>>>
>>>
>>> Hi Andreas
>>>
>>> I'v attached those files from a network node:
>>>
>>> Ml2_conf.ini
>>> Neutron.conf
>>> L3_agent.ini
>>> Nova-compute.log
>>>
>>> I've setup 3 vlans on one interface and configured bonding It works and I have good connection between the servers:
>>>
>>> root at network2:/# cat /proc/net/vlan/config
>>> VLAN Dev name | VLAN ID
>>> Name-Type: VLAN_NAME_TYPE_RAW_PLUS_VID_NO_PAD
>>> bond0.48 | 48 | bond0
>>> bond0.47 | 47 | bond0
>>> bond0.45 | 45 | bond0
>>>
>>> Tunnel network -> bond0.47
>>> Mgmt network -> bond0.48
>>> Extrenal network -> bond0.45
>>>
>>> And when I check for bridges and ports on the network node:
>>>
>>> root at network2:/# ovs-vsctl list-br
>>> br-ex
>>> br-int
>>> br-tun
>>>
>>> root at network2:/# ovs-vsctl list-ports br-ex
>>> bond0.45
>>> phy-br-ex
>>> qg-eb22e091-62
>>>
>>> best regards
>>> Yngvi
>>>
>>>
>>> -----Original Message-----
>>> From: Andreas Scheuring [mailto:scheuran at linux.vnet.ibm.com]
>>> Sent: 29. júní 2015 06:59
>>> To: Yngvi Páll Þorfinnsson
>>> Cc: openstack at lists.openstack.org
>>> Subject: Re: [Openstack] error creating instance
>>>
>>> The issue seems to be related to a neutron missconfiguration.
>>> --> Unexpected vif_type=binding_failed
>>>
>>> Please have a look at your neutron server config file in the network
>>> node(s) and the l2 agent config files (ovs?). You should find additional information there.
>>>
>>>
>>> If this doesn't help, please provide these log files, the neutron config files and a brief description of how your nodes network are set up.
>>>
>>>
>>> Andreas
>>>
>>>
>>>
>>> On Fr, 2015-06-26 at 15:05 +0000, Yngvi Páll Þorfinnsson wrote:
>>>> Hi
>>>>
>>>>
>>>>
>>>> Can someone please help on this matter?
>>>>
>>>>
>>>>
>>>> I have installed and configured OpenStack(Juno) environment on
>>>> Ubuntu(14.04).
>>>>
>>>> We have currently 1 controller node, 3 network nodes and 4 compute
>>>> nodes as well as 4 swift nodes.
>>>>
>>>> I'm using OpenStack Networking (neutron).
>>>>
>>>> I‘v recently introduced VLANs for tunnel-, mgmt- and external
>>>> networks.
>>>>
>>>>
>>>>
>>>> When I try to create a instance, with this cmd:
>>>>
>>>>
>>>>
>>>> nova boot --flavor m1.tiny --image cirros-0.3.3-x86_64 --nic
>>>> net-id=7a344656-815c-4116-b697-b52f9fdc6e4c --security-group default
>>>> --key-name demo-key demo-instance3
>>>>
>>>>
>>>>
>>>> it fails. The status from nova list is :
>>>>
>>>> root at controller2:/# nova list
>>>>
>>>> +--------------------------------------+-----------------+--------+------------+-------------+-----------------------+
>>>>
>>>> | ID | Name | Status |
>>>> Task State | Power State | Networks |
>>>>
>>>> +--------------------------------------+-----------------+--------+------------+-------------+-----------------------+
>>>>
>>>> | ca662fc0-2417-4da1-be2c-d6ccf90ed732 | demo-instance22 | ERROR | -
>>>> | NOSTATE | |
>>>>
>>>> | 17d26ca3-f56c-4a87-ae0a-acfafea4838c | demo-instance30 | ERROR | -
>>>> | NOSTATE | demo-net=x.x.x.x |
>>>>
>>>> +--------------------------------------+-----------------+--------+------------+-------------+-----------------------+
>>>>
>>>>
>>>>
>>>> This error apperas in the /var/log/syslog file on the computer node:
>>>>
>>>>
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.597951] nbd8: p1
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.668430] EXT4-fs (nbd8): VFS:
>>>> Can't find ext4 filesystem
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.668521] EXT4-fs (nbd8): VFS:
>>>> Can't find ext4 filesystem
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.668583] EXT4-fs (nbd8): VFS:
>>>> Can't find ext4 filesystem
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.668899] FAT-fs (nbd8): bogus
>>>> number of reserved sectors
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.668936] FAT-fs (nbd8): Can't
>>>> find a valid FAT filesystem
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.753989] block nbd8:
>>>> NBD_DISCONNECT
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.754056] block nbd8: Receive
>>>> control failed (result -32)
>>>>
>>>> Jun 26 14:55:04 compute5 kernel: [ 2187.754161] block nbd8: queue
>>>> cleared
>>>>
>>>>
>>>>
>>>> Also, this is logged on the computer node, in
>>>> /var/log/nova/nova-compute.log
>>>>
>>>>
>>>>
>>>> 2015-06-26 14:55:02.591 7961 AUDIT nova.compute.claims [-] [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] disk limit not specified,
>>>> defaulting to unlimited
>>>>
>>>> 2015-06-26 14:55:02.606 7961 AUDIT nova.compute.claims [-] [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] Claim successful
>>>>
>>>> 2015-06-26 14:55:02.721 7961 INFO nova.scheduler.client.report [-]
>>>> Compute_service record updated for ('compute5')
>>>>
>>>> 2015-06-26 14:55:02.836 7961 INFO nova.scheduler.client.report [-]
>>>> Compute_service record updated for ('compute5')
>>>>
>>>> 2015-06-26 14:55:03.115 7961 INFO nova.virt.libvirt.driver [-]
>>>> [instance: 17d26ca3-f56c-4a87-ae0a-acfafea4838c] Creating image
>>>>
>>>> 2015-06-26 14:55:03.118 7961 INFO nova.openstack.common.lockutils [-]
>>>> Created lock path: /var/lib/nova/instances/locks
>>>>
>>>> 2015-06-26 14:55:03.458 7961 INFO nova.scheduler.client.report [-]
>>>> Compute_service record updated for ('compute5', 'compute5.siminn.is')
>>>>
>>>> 2015-06-26 14:55:04.088 7961 INFO nova.virt.disk.vfs.api [-] Unable
>>>> to import guestfsfalling back to VFSLocalFS
>>>>
>>>> 2015-06-26 14:55:04.363 7961 ERROR nova.compute.manager [-] [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] Instance failed to spawn
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] Traceback (most recent call
>>>> last):
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] File
>>>> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line
>>>> 2267, in _build_resources
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] yield resources
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] File
>>>> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line
>>>> 2137, in _build_and_run_instance
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c]
>>>> block_device_info=block_device_info)
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] File
>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>> 2620, in spawn
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] write_to_disk=True)
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] File
>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>> 4159, in _get_guest_xml
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] context)
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] File
>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>> 3937, in _get_guest_config
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] flavor,
>>>> CONF.libvirt.virt_type)
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] File
>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/vif.py", line
>>>> 352, in get_config
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] _("Unexpected vif_type=%s")
>>>> % vif_type)
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c] NovaException: Unexpected
>>>> vif_type=binding_failed
>>>>
>>>> 2015-06-26 14:55:04.363 7961 TRACE nova.compute.manager [instance:
>>>> 17d26ca3-f56c-4a87-ae0a-acfafea4838c]
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Best regards
>>>>
>>>> Yngvi
>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>> Post to : openstack at lists.openstack.org
>>>> Unsubscribe :
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>> --
>>> Andreas
>>> (IRC: scheuran)
>>>
>>>
>>> _______________________________________________
>>> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>
>>
>> _______________________________________________
>> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to : openstack at lists.openstack.org
>> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>
More information about the Openstack
mailing list