Open Stack

Hey folks,

I am so so so so close to being done with my first openstack deployment 
here.  It is a relatively basic setup that mirrors the "Diablo starter 
guide".

However I seem to be stuck on a simple issue.  I can't make multiple 
networks work, and hence I can't make multiple projects work because of 
what appears to be problems I'm having configuring nova-network.

What is really strange is that for some reason my "appproj" user is 
somehow making nodes launch inside the "proj" network.

I am not sure why this is happening.  Should I have these networks on 
separate br100/br101 interfaces?  Separate vlans?  I'm losing my mind 
here. :)

/var/log/nova # nova-manage network list
id       IPv4                  IPv6               start address      
DNS1               DNS2               VlanID             project        
     uuid
17       192.168.4.0/24        None               192.168.4.3        
None               None               100                proj           
     None
21       192.168.5.0/24        None               192.168.5.3        
None               None               100                appproj1       
     None

/var/log/nova # euca-describe-instances
RESERVATION    r-z80ezowp    appproj1    default
INSTANCE    i-00000022    ami-0000000c    192.168.4.9    192.168.4.9    
running    appkey (appproj1, amber)    0        m1.tiny    
2012-01-30T01:36:05Z    nova    aki-0000000b    ami-00000000
RESERVATION    r-1jhgh53l    proj    default
INSTANCE    i-0000001d    ami-00000004    192.168.4.5    192.168.4.5    
running    mykey (proj, amber)    0        m1.tiny    
2012-01-30T01:12:57Z    nova    aki-00000003    ami-00000000


Note how i-00000022 is inside PROJECT="appproj1", but ip is 192.168.4.9 
(this should be 192.168.5.x!!!!!).

Let me show the config and output of some commands:

> /var/log/nova # cat /etc/nova/nova.conf
> --dhcpbridge_flagfile=/etc/nova/nova.conf
> --dhcpbridge=/usr/bin/nova-dhcpbridge
> --logdir=/var/log/nova
> --lock_path=/var/lock/nova
> --state_path=/var/lib/nova
> --verbose
> --s3_host=10.254.13.50
> --rabbit_host=10.254.13.50
> --cc_host=10.254.13.50
> --ec2_url=http://10.254.13.50:8773/services/Cloud
> --fixed_range=192.168.0.0/16
> --network_size=256
> --FAKE_subdomain=ec2
> --routing_source_ip=10.254.13.50
> --sql_connection=mysql://XXX:XXX@10.254.13.50/nova
> --glance_api_servers=192.168.3.1:9292
> --image_service=nova.image.glance.GlanceImageService
> --iscsi_ip_prefix=192.168.
> --vlan_interface=eth1
> --public_interface=eth0
> --nova_url=http://10.254.13.50:8774/v1.1/



/var/log/nova # ip addr list
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
     inet 127.0.0.1/8 scope host lo
     inet 169.254.169.254/32 scope link lo
     inet6 ::1/128 scope host
        valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP 
qlen 1000
     link/ether 84:2b:2b:4e:0d:dc brd ff:ff:ff:ff:ff:ff
     inet 10.254.13.50/25 brd 10.254.13.127 scope global eth0
     inet6 fe80::862b:2bff:fe4e:ddc/64 scope link
        valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP 
qlen 1000
     link/ether 84:2b:2b:4e:0d:dd brd ff:ff:ff:ff:ff:ff
     inet 192.168.3.1/24 brd 192.168.3.255 scope global eth1
     inet6 fe80::862b:2bff:fe4e:ddd/64 scope link
        valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue 
state DOWN
     link/ether 42:09:56:f6:99:44 brd ff:ff:ff:ff:ff:ff
     inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
6: vlan100 at eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc 
noqueue master br100 state UP
     link/ether 02:16:3e:27:ce:b1 brd ff:ff:ff:ff:ff:ff
     inet6 fe80::16:3eff:fe27:ceb1/64 scope link
        valid_lft forever preferred_lft forever
7: br100: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
     link/ether 02:16:3e:27:ce:b1 brd ff:ff:ff:ff:ff:ff
     inet 192.168.5.1/24 brd 192.168.5.255 scope global br100
     inet 192.168.4.1/24 brd 192.168.4.255 scope global br100
     inet6 fe80::b069:faff:feb5:2869/64 scope link
        valid_lft forever preferred_lft forever
8: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast 
master br100 state UNKNOWN qlen 500
     link/ether fe:16:3e:48:e4:aa brd ff:ff:ff:ff:ff:ff
     inet6 fe80::fc16:3eff:fe48:e4aa/64 scope link
        valid_lft forever preferred_lft forever
11: vnet1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast 
master br100 state UNKNOWN qlen 500
     link/ether fe:16:3e:44:d5:c9 brd ff:ff:ff:ff:ff:ff
     inet6 fe80::fc16:3eff:fe44:d5c9/64 scope link
        valid_lft forever preferred_lft forever