I've got it working right now using FlatDHCPManager. :)<br>The problem with the tty's is that there's no tty configured to the instance image, but I can access it quite fine with ssh, both the ttylinux and the Ubuntu image. I may open a bug later to documentate the change I had to do with libvirt.xml.template for it to work.<br>
<br>Just clear me out on this, why wouldn't FlatManager work injecting the fixed IP? Is it fine to use FlatDHCPManager with just one interface? I have a controller, two compute nodes and a gateway in a simple L2 network. The controller bridge now seems to have 2 IPs because it responds both pings.<br>
<br>I'm still having some trouble with live migration, but I will do some more research on it before and then, if I can't get it to work, I'll create another topic regarding it.<br><br>Thanks for the help. :)<br>
<br><div class="gmail_quote">Em 5 de outubro de 2011 11:16, Rogério Vinhal Nunes <span dir="ltr"><<a href="mailto:rogervn@dcc.ufmg.br">rogervn@dcc.ufmg.br</a>></span> escreveu:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
It's not clear to me why should I be using DHCP. I've configured the system to use the simple FlatManager, shouldn't it inject the desired IP in the image when the instance spawns? Is there a DHCP running even if I don't use Vlan or FlatDHCP?<br>
<br>I've actually used tcpdump to look for DHCP packages and found out that the instances are indeed sending broadcast requests and having no response.<br><br>My system is a cloud controller with two compute nodes, shouldn't I be able to set it up with FlatManager? My configuration was generated by the nova-install script and I did some changes as I needed to make it work. My bridge is configured to xenbr0 in the database and also in the system.<br>
<br>This is the controller nova.conf:<br><br>--dhcpbridge_flagfile=/etc/nova/nova.conf<br>--dhcpbridge=/usr/bin/nova-dhcpbridge<br>--logdir=/var/log/nova<br>--state_path=/var/lib/nova<br>--lock_path=/var/lock/nova<br>--verbose<br>
--s3_host=127.0.0.1<br>--rabbit_host=10.0.254.6<br>--cc_host=10.0.254.6<br>--ec2_url=<a href="http://10.0.254.6:8773/services/Cloud" target="_blank">http://10.0.254.6:8773/services/Cloud</a><br>--fixed_range=<a href="http://10.0.10.0/24" target="_blank">10.0.10.0/24</a><br>
--network_size=100<br>--FAKE_subdomain=ec2<br>--routing_source_ip=10.0.254.6<br>--verbose<br>--sql_connection=mysql://<a href="http://root:root@10.0.254.6/nova" target="_blank">root:root@10.0.254.6/nova</a><br>--network_manager=nova.network.manager.FlatManager<br>
--flat_network_bridge=xenbr0<br>--glance_api_servers=<a href="http://10.0.254.6:9292" target="_blank">10.0.254.6:9292</a><br>--image_service=nova.image.glance.GlanceImageService<br><br>And this is the compute nodes nova.conf:<br>
<br>--dhcpbridge_flagfile=/etc/nova/nova.conf<br>
--dhcpbridge=/usr/bin/nova-dhcpbridge<br>--logdir=/var/log/nova<br>--state_path=/var/lib/nova<br>--lock_path=/var/lock/nova<br>--verbose<br>--s3_host=10.0.254.6<br>--rabbit_host=10.0.254.6<br>--cc_host=10.0.254.6<br>--ec2_url=<a href="http://10.0.254.6:8773/services/Cloud" target="_blank">http://10.0.254.6:8773/services/Cloud</a><br>
--sql_connection=mysql://<a href="http://root:root@10.0.254.6/nova" target="_blank">root:root@10.0.254.6/nova</a><br>--network_manager=nova.network.manager.FlatManager<br>--flat_network_bridge=xenbr0<br>--libvirt_type=xen<br>
--xenapi_remap_vbd_dev=true<br>
--glance_api_servers=<a href="http://10.0.254.6:9292" target="_blank">10.0.254.6:9292</a><br>--image_service=nova.image.glance.GlanceImageService<br>--nouse_cow_images<br><br><br>Thanks for the support, I may be a little more confused about the configuration than I thought.<br>
<br><div class="gmail_quote">Em 4 de outubro de 2011 18:24, Vishvananda Ishaya <span dir="ltr"><<a href="mailto:vishvananda@gmail.com" target="_blank">vishvananda@gmail.com</a>></span> escreveu:<div><div></div><div class="h5">
<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Yes that is the rule. But that rule is not going to work if you don't receive an ip address via dhcp. So you need to make sure the dhcp piece is working. My guess is that once you get dhcp working, the metadata rule will work since it looks like it is being created correctly.<div>
<br></div><div>Vish</div><div><div></div><div><div><br><div><div>On Oct 4, 2011, at 12:38 PM, Rogério Vinhal Nunes wrote:</div><br><blockquote type="cite">I don't think the ubuntu image is expecting xvda anywhere. The disk is sda and after I've changed the libvirt.xml.template, so is "root=" option. The image is the ubuntu localimage mentioned in the documentation.<br>
<br>I've tried to "telnet 169.254.169.254 32" in the compute node and it didn't find anything while "telnet 10.0.254.6 8773" does respond. This is the part of the iptables-save that messes with the routing of nova, did the Diablo configuration also change regarding to this?<br>
<br>-A PREROUTING -j nova-compute-PREROUTING <br>-A PREROUTING -d <a href="http://169.254.169.254/32" target="_blank">169.254.169.254/32</a> -p tcp -m tcp --dport 80 -j DNAT --to-destination <a href="http://10.0.254.6:8773/" target="_blank">10.0.254.6:8773</a> <br>
-A POSTROUTING -j nova-compute-POSTROUTING<br><br>I understand that it should forward anything destined to <a href="http://169.254.169.254/32" target="_blank">169.254.169.254/32</a> port 80 to <a href="http://10.0.254.6:8773/" target="_blank">10.0.254.6:8773</a>. But that isn't happening even with telnet. Does the nova-compute-PREROUTING rule have a part in this? The configuration I've done is just running "iptables -A PREROUTING -d <a href="http://169.254.169.254/32" target="_blank">169.254.169.254/32</a> -p tcp -m tcp --dport 80 -j DNAT --to-destination <a href="http://10.0.254.6:8773/" target="_blank">10.0.254.6:8773</a>" .<br>
<br><div class="gmail_quote">Em 4 de outubro de 2011 16:22, Vishvananda Ishaya <span dir="ltr"><<a href="mailto:vishvananda@gmail.com" target="_blank">vishvananda@gmail.com</a>></span> escreveu:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">It looks like your dhcp is failing for some reason. There are a number of things that could theoretically cause this. You might start using tcpdump to find out if the dhcp request packet is coming out of the vm and if it is being responded to by dnsmasq on the nova-network host. I'm not sure about the ubuntu image, is it expecting xvda there?<div>
<div></div><div><div><br></div><div><div><div>On Oct 4, 2011, at 12:02 PM, Rogério Vinhal Nunes wrote:</div><br><blockquote type="cite">That pretty much solved the disk image problem, thanks. You really should put that in the official documentation, that is no trace of that option in it.<br>
<br>But it's still not working. After that I had to change the libvirt.xml.template to use sda instead of xvda in the root option. There should be sda in the root option or xvda in the disk option, mixing both of them, as of is happening right now, will never work.<br>
<br>Even after this small setup, it won't work. ttylinux image boots and complains about not being able to reach IP 169.254.169.254 (I've done the PREROUTING iptables configuration in the compute nodes), and stalls just after the "setting shared object cache" with no console opened:<br>
<br>-----------<br>startup crond [ OK ]<br>wget: can't connect to remote host (169.254.169.254): Network is unreachable<br>cloud-userdata: failed to read instance id<br>===== cloud-final: system completely up in 31.15 seconds ====<br>
wget: can't connect to remote host (169.254.169.254): Network is unreachable<br>wget: can't connect to remote host (169.254.169.254): Network is unreachable<br>wget: can't connect to remote host (169.254.169.254): Network is unreachable<br>
instance-id: <br> public-ipv4: <br> local-ipv4 : <br>=> First-Boot Sequence:<br>setting shared object cache [running ldconfig] [ OK ]<br>-----------<br><br>The ubuntu image does almost the same, but nothing to do with networking, it mounts the ext4 filesystem and then just hangs with no console:<br>
<br>-----------<br>[ 0.160477] md: ... autorun DONE.<br>[ 0.160659] EXT3-fs (sda): error: couldn't mount because of unsupported optional features (240)<br>[ 0.160909] EXT2-fs (sda): error: couldn't mount because of unsupported optional features (240)<br>
[ 0.161908] EXT4-fs (sda): mounted filesystem with ordered data mode. Opts: (null)<br>[ 0.161930] VFS: Mounted root (ext4 filesystem) readonly on device 202:0.<br>[ 0.178088] devtmpfs: mounted<br>[ 0.178195] Freeing unused kernel memory: 828k freed<br>
[ 0.178425] Write protecting the kernel read-only data: 10240k<br>[ 0.183386] Freeing unused kernel memory: 308k freed<br>[ 0.184074] Freeing unused kernel memory: 1612k freed<br>mountall: Disconnected from Plymouth<br>
------------<br><br>Both of them are assigned IPs for the configured nova-network in the "euca-describe-instances", but none of them ping back.<br><br>I feel I'm getting really close to get this working. If you guys could lend me a little more help I would be very much appreciated.<br>
<br><div class="gmail_quote">Em 4 de outubro de 2011 09:12, Vishvananda Ishaya <span dir="ltr"><<a href="mailto:vishvananda@gmail.com" target="_blank">vishvananda@gmail.com</a>></span> escreveu:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p>You may need to set --nouse_cow_images<br>
Sounds like your image might be a copy on write qcow2 with a backing file. You can verify that with qemu-img info /var/lib/nova/instances/disk <br>
That kind of image won't work with xen.</p><div><div></div><div>
<div class="gmail_quote">On Oct 3, 2011 9:44 AM, "Rogério Vinhal Nunes" <<a href="mailto:rogervn@dcc.ufmg.br" target="_blank">rogervn@dcc.ufmg.br</a>> wrote:<br type="attribution">> Hey guys, I'm still trying to get this working, but I still don't understand<br>
> what's happening.<br>> <br>> In the ttylinux busybox I do a fdisk -l and it says the disk is only 18 MB<br>> large and doesn't have a valid partition table:<br>> <br>> ------------<br>> / # fdisk -l<br>
> <br>> Disk /dev/sda: 18 MB, 18874368 bytes<br>> 255 heads, 63 sectors/track, 2 cylinders<br>> Units = cylinders of 16065 * 512 = 8225280 bytes<br>> <br>> Disk /dev/sda doesn't contain a valid partition table<br>
> ------------<br>> <br>> When looking in the instance directory as I said before, the image is only<br>> 18 MB large (while I think ttylinux should be 24 MB), this may be a problem.<br>> I'm using glance as a image server and mounted the /var/lib/instances using<br>
> NFS from the cloud controller.<br>> <br>> What can I do to get more information? I need to get this configuration<br>> working.<br>> <br>> Em 28 de setembro de 2011 15:50, Rogério Vinhal Nunes<br>> <<a href="mailto:rogervn@dcc.ufmg.br" target="_blank">rogervn@dcc.ufmg.br</a>>escreveu:<br>
> <br>>> Yes, I've tried the ttylinux right now, it starts the instance, but it<br>>> booted up a busybox, probably a recover from initrd (see output in the end<br>>> of this e-maill). I can access the instance by doing a xl console in the<br>
>> host, describe-instances shows the status "running test".<br>>><br>>> I've successfully booted a separated vm with an old image I used with Xen<br>>> with Xen + libvirt just changing the openstack's libvirt.xml. It just works<br>
>> fine.<br>>><br>>> The instance dir in /var/lib/nova/instances files look like this:<br>>><br>>> 0 -rw-r----- 1 nova nogroup 0 2011-09-28 15:43 console.log<br>>> 15M -rw-r--r-- 1 nova nogroup 18M 2011-09-28 15:43 disk<br>
>> 4,3M -rw-r--r-- 1 nova nogroup 4,3M 2011-09-28 15:43 kernel<br>>> 4,0K -rw-r--r-- 1 nova nogroup 1,3K 2011-09-28 15:43 libvirt.xml<br>>> 5,7M -rw-r--r-- 1 nova nogroup 5,7M 2011-09-28 15:43 ramdisk<br>
>><br>>> this is the last output I get when I get into the instance console:<br>>><br>>> [ 0.078066] blkfront: sda: barriers enabled<br>>> [ 0.078394] sda: unknown partition table<br>
>> [ 0.170040] XENBUS: Device with no driver: device/vkbd/0<br>
>> [ 0.170051] XENBUS: Device with no driver: device/vfb/0<br>>> [ 0.170056] XENBUS: Device with no driver: device/console/0<br>>> [ 0.170074] Magic number: 1:252:3141<br>>> [ 0.170114] /build/buildd/linux-2.6.35/drivers/rtc/hctosys.c: unable to<br>
>> open rtc device (rtc0)<br>>> [ 0.170122] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found<br>>> [ 0.170127] EDD information not available.<br>>> [ 0.170259] Freeing unused kernel memory: 828k freed<br>
>> [ 0.170460] Write protecting the kernel read-only data: 10240k<br>>> [ 0.173975] Freeing unused kernel memory: 308k freed<br>>> [ 0.174481] Freeing unused kernel memory: 1620k freed<br>>> badness occurred in ramdisk<br>
>><br>>><br>>> BusyBox v1.15.3 (Ubuntu 1:1.15.3-1ubuntu5) built-in shell (ash)<br>>> Enter 'help' for a list of built-in commands.<br>>><br>>> /bin/sh: can't access tty; job control turned off<br>
>> / #<br>>> / #<br>>><br>>><br>>> Em 28 de setembro de 2011 14:06, Joshua Harlow <<a href="mailto:harlowja@yahoo-inc.com" target="_blank">harlowja@yahoo-inc.com</a>>escreveu:<br>>><br>
>> Can u try with the ttylinux images and see if those work for you?<br>
>>><br>>>> I know when I tried it I had to adjust the libvirt xml was creating (which<br>>>> may have not been the right solution) to get those to work.<br>>>><br>>>> I think the ttylinux ones might work better (from the last time I tried).<br>
>>><br>>>><br>>>> On 9/27/11 7:11 PM, "Todd Deshane" <<a href="mailto:todd.deshane@xen.org" target="_blank">todd.deshane@xen.org</a>> wrote:<br>>>><br>>>> 2011/9/27 Rogério Vinhal Nunes <<a href="mailto:rogervn@dcc.ufmg.br" target="_blank">rogervn@dcc.ufmg.br</a>>:<br>
>>> > Hello, I've upgraded to Diablo to see if this issue was resolved, but<br>>>> > apparently it isn't.<br>>>> ><br>>>> > There is already a thread talking about it, but it didn't come to a<br>
>>> solution<br>>>> > that I could use. After having Openstack configured with Xen and libvirt<br>>>> in<br>>>> > Ubuntu 10.04 whenever I run an instance it is started, but it stops with<br>
>>> a<br>>>> > kernel panic trying to mount root by using xvda, but sda is the only<br>>>> > available.<br>>>> ><br>>>> > I'm using Diablo's nova + glance and the<br>
>>> > ubuntu1010-UEC-localuser-image.tar.gz from the manual.<br>>>> ><br>>>> > The kernel panic is like this:<br>>>> ><br>>>> > [ 0.170563] VFS: Cannot open root device "xvda" or unknown-block(0,0)<br>
>>> > [ 0.170572] Please append a correct "root=" boot option; here are the<br>>>> > available partitions:<br>>>> > [ 0.170585] ca00 32768 sda driver: vbd<br>
>>> > [ 0.170594] Kernel panic - not syncing: VFS: Unable to mount root fs<br>
>>> on<br>>>> > unknown-block(0,0)<br>>>> > [ 0.170604] Pid: 1, comm: swapper Not tainted 2.6.35-24-virtual<br>>>> > #42-Ubuntu<br>>>> ><br>>>> > I've played with libvirt.xml.template, it changed a lot since Cactus, so<br>
>>> I<br>>>> > tried to replace xvda with sda, and the kernel panic didn't go away,<br>>>> just<br>>>> > changed a little:<br>>>> ><br>>>> > [ 0.161237] List of all partitions:<br>
>>> > [ 0.161248] ca00 32768 sda driver: vbd<br>>>> > [ 0.161257] No filesystem could mount root, tried: ext3 ext2 ext4<br>>>> > fuseblk<br>>>> > [ 0.161275] Kernel panic - not syncing: VFS: Unable to mount root fs<br>
>>> on<br>>>> > unknown-block(202,0)<br>>>> > [ 0.161286] Pid: 1, comm: swapper Not tainted 2.6.35-24-virtual<br>>>> > #42-Ubuntu<br>>>> ><br>>>><br>>>> Are you able to start a guest manually with Xen + libvirt (without<br>
>>> OpenStack)?<br>>>><br>>>> That's the first step to debugging this issue.<br>>>><br>>>> > I've tried using --xenapi_remap_vbd_dev=true, but it didn't work (it<br>
>>> > wouldn't also because I'm using libvirt, not xenapi).<br>>>> ><br>>>><br>>>> Would XCP or XenServer work for you in general? (The XenAPI-based<br>>>> hypervisors are more tested and even have more features compared with<br>
>>> libvirt - <a href="http://wiki.openstack.org/XenAPI" target="_blank">http://wiki.openstack.org/XenAPI</a>)<br>>>><br>>>><br>>>> Or even Project Kronos (also uses XCP/XenServer toolstack)<br>
>>> <a href="http://blog.xen.org/index.php/2011/07/22/project-kronos/" target="_blank">http://blog.xen.org/index.php/2011/07/22/project-kronos/</a><br>
>>><br>>>> Thanks,<br>>>> Todd<br>>>><br>>>> --<br>>>> Todd Deshane<br>>>> <a href="http://www.linkedin.com/in/deshantm" target="_blank">http://www.linkedin.com/in/deshantm</a><br>
>>> <a href="http://www.xen.org/products/cloudxen.html" target="_blank">http://www.xen.org/products/cloudxen.html</a><br>>>> <a href="http://runningxen.com/" target="_blank">http://runningxen.com/</a><br>
>>><br>>>> _______________________________________________<br>
>>> Mailing list: <a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a><br>>>> Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
>>> Unsubscribe : <a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a><br>>>> More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
>>><br>>>><br>>><br></div>
</div></div></blockquote></div><br>
</blockquote></div><br></div></div></div></div></blockquote></div><br>
</blockquote></div><br></div></div></div></div></blockquote></div></div></div><br>
</blockquote></div><br>