<div dir="ltr">In my experience the networking is by far the hardest part of the setup, though the entire manual setup of openstack is mostly an exercise in whether you can follow ~150 steps without making a typing error. I have some bash scripts we use here to quickly setup a test stack using intel NUC / gigabyte brix systems. I can send those your way if you want.<br>
<br>Here's my nova.conf - you'll have to fill in data for about 25% of the lines, and make sure 'controller' resolves to the management IP of the controller node from the compute host. Everything wrapped in ${} needs to be replaced. If you didn't use the openstack setup guide for the rest of the setup you may need to change other values (ports/usernames). If you're not using Neutron for networking you'll need to change a lot.<div>
<br></div><div><div>[DEFAULT]</div><div>dhcpbridge_flagfile=/etc/nova/nova.conf</div><div>dhcpbridge=/usr/bin/nova-dhcpbridge</div><div>logdir=/var/log/nova</div><div>state_path=/var/lib/nova</div><div>lock_path=/var/lock/nova</div>
<div>force_dhcp_release=True</div><div>iscsi_helper=tgtadm</div><div>libvirt_use_virtio_for_bridges=True</div><div>connection_type=libvirt</div><div>root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf</div><div>verbose=True</div>
<div>ec2_private_dns_show_ip=True</div><div>api_paste_config=/etc/nova/api-paste.ini</div><div>volumes_path=/var/lib/nova/volumes</div><div>enabled_apis=ec2,osapi_compute,metadata</div><div>ec2_dmz_host=controller</div><div>
<br></div><div><br></div><div># Use keystone for auth</div><div>auth_strategy=keystone</div><div><br></div><div># Use RabbitMQ</div><div>#rpc_backend = nova.rpc.impl_kombu</div><div>rpc_backend = rabbit</div><div>rabbit_host = controller</div>
<div>rabbit_userid = guest</div><div>rabbit_password = ${RABBIT_PASSWORD}</div><div><br></div><div># VNC Service setup</div><div>vnc_enabled=True</div><div>vncserver_listen=0.0.0.0</div><div><br></div><div># The next 2 entries must have the management IP of this compute node</div>
<div>my_ip = ${COMPUTE_NODE_IP}</div><div>vncserver_proxyclient_address = ${COMPUTE_NODE_IP}</div><div><br></div><div># The next 2 entries should point to the public IP of the vnc proxy (controller) node</div><div>novncproxy_base_url = http://${CONTROLLER_PUBLIC_IP}:6080/vnc_auto.html</div>
<div>xpvvncproxy_base_url = http://${CONTROLLER_PUBLIC_IP}:6081/console</div><div><br></div><div># Glance image storage</div><div>glance_host = controller</div><div><br></div><div># OpenVSwitch Networking using Neutron</div>
<div>network_api_class = nova.network.neutronv2.api.API</div><div>neutron_url = <a href="http://controller:9696">http://controller:9696</a></div><div>neutron_auth_strategy = keystone</div><div>neutron_admin_tenant_name = service</div>
<div>neutron_admin_username = neutron</div><div>neutron_admin_password = ${NEUTRON_KEYSTONE_PASSWORD}</div><div>neutron_admin_auth_url = <a href="http://controller:35357/v2.0">http://controller:35357/v2.0</a></div><div>linuxnet_interface_driver = nova.network.linux_net.LinuxOVSInterfaceDriver</div>
<div>firewall_driver = nova.virt.firewall.NoopFirewallDriver</div><div>security_group_api = neutron</div><div>service_neutron_metadata_proxy=True</div><div>neutron_metadata_proxy_shared_secret = ${NEUTRON_METADATA_SECRET}</div>
<div><br></div><div># Ceilometer usage tracking</div><div>instance_usage_audit = True</div><div>instance_usage_audit_period = hour</div><div>notify_on_state_change = vm_and_task_state</div><div>notification_driver = nova.openstack.common.notifier.rpc_notifier</div>
<div>notification_driver = ceilometer.compute.nova_notifier</div><div><br></div><div><br></div><div>[database]</div><div>connection=connection = mysql://nova:${NOVA_DB_PASSWORD}@controller/nova</div><div><br></div><div>[keystone_authtoken]</div>
<div>auth_uri = <a href="http://controller:5000">http://controller:5000</a></div><div>auth_host = controller</div><div>auth_port = 35357</div><div>auth_protocol = http</div><div>admin_tenant_name = service</div><div>admin_user = nova</div>
<div>admin_password = ${NOVA_KEYSTONE_PASSWORD}</div><div><br></div><div><br></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Jun 26, 2014 at 12:21 PM, O'Reilly, Dan <span dir="ltr"><<a href="mailto:Daniel.OReilly@dish.com" target="_blank">Daniel.OReilly@dish.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Yes, I’ve been looking at it. But with the plethora of available settings, a working configuration would be incredibly useful. <grin><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Andrew Mann [mailto:<a href="mailto:andrew@divvycloud.com" target="_blank">andrew@divvycloud.com</a>] <br>
<b>Sent:</b> Thursday, June 26, 2014 11:20 AM</span></p><div><div class="h5"><br><b>To:</b> O'Reilly, Dan<br><b>Cc:</b> <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack] Architectural question<u></u><u></u></div></div><p></p></div><div><div class="h5"><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal"><a href="http://docs.openstack.org/trunk/config-reference/content/section_compute-hypervisors.html" target="_blank">http://docs.openstack.org/trunk/config-reference/content/section_compute-hypervisors.html</a> has configuration entries for each hypervisor type.<u></u><u></u></p>
</div><div><p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p><div><p class="MsoNormal">On Thu, Jun 26, 2014 at 12:06 PM, O'Reilly, Dan <<a href="mailto:Daniel.OReilly@dish.com" target="_blank">Daniel.OReilly@dish.com</a>> wrote:<u></u><u></u></p>
<div><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">OK. So, next question is the specific configuration for each compute node. Do you know if there are sample configurations (e.g., nova.conf) available for these?</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span><u></u><u></u></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks!</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span><u></u><u></u></p><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Andrew Mann [mailto:<a href="mailto:andrew@divvycloud.com" target="_blank">andrew@divvycloud.com</a>] <br>
<b>Sent:</b> Thursday, June 26, 2014 10:22 AM<br><b>To:</b> O'Reilly, Dan<br><b>Cc:</b> <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br><b>Subject:</b> Re: [Openstack] Architectural question</span><u></u><u></u></p>
</div><div><div><p class="MsoNormal"> <u></u><u></u></p><div><p class="MsoNormal">Dan,<u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">If I understand your question properly, you can do this from the Horizon management web interface as an admin user. Under Admin->System Panel->Host Aggregates setup 3 aggregates each in their own availability zone, and then assign each host into a corresponding aggregate.<u></u><u></u></p>
</div><div><p class="MsoNormal"> <u></u><u></u></p></div><div><p class="MsoNormal">I don't think the controller node needs any special configuration, and the compute nodes should just need the configuration to use the specific hypervisor you want on that host. Each compute node must be running before it can be added to the host aggregate through the UI.<u></u><u></u></p>
</div><div><p class="MsoNormal"> <u></u><u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12.0pt"> <u></u><u></u></p><div><p class="MsoNormal">On Thu, Jun 26, 2014 at 10:45 AM, O'Reilly, Dan <<a href="mailto:Daniel.OReilly@dish.com" target="_blank">Daniel.OReilly@dish.com</a>> wrote:<u></u><u></u></p>
<div><div><p class="MsoNormal">I’m building a cloud and have a question about architecture/viability. Right now, I have the following configuration:<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p>-<span style="font-size:7.0pt"> </span>Controller node running RHEL 6.5<u></u><u></u></p>
<p>-<span style="font-size:7.0pt"> </span>Network node running RHEL 6.5<u></u><u></u></p><p>-<span style="font-size:7.0pt"> </span>5 node Ceph cluster for block and object storage<u></u><u></u></p><p>-<span style="font-size:7.0pt"> </span>3 compute nodes:<u></u><u></u></p>
<p style="margin-left:1.0in"><span style="font-family:"Courier New"">o</span><span style="font-size:7.0pt"> </span>1 running RHEL 6.5 and VMware as the hypervisor<u></u><u></u></p><p style="margin-left:1.0in">
<span style="font-family:"Courier New"">o</span><span style="font-size:7.0pt"> </span>1 running RHEL 6.5 and KVM as the hypervisor<u></u><u></u></p><p style="margin-left:1.0in"><span style="font-family:"Courier New"">o</span><span style="font-size:7.0pt"> </span>1 running CentOS 6.5 and Xen as the hypervisor<u></u><u></u></p>
<p class="MsoNormal" style="margin-left:.5in"> <u></u><u></u></p><p class="MsoNormal">The basic question is on the compute nodes. I’m doing 3 different hypervisors to do a best-of-breed study (each will be in its own availability zone). Hence, one of each type. But is it even possible to have 3 compute nodes like this, and if so, how do I configure the compute software that runs on the controller node to handle this; and how do I configure each of the 3 compute nodes as well?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal"><span style="color:#1f497d">Dan O'Reilly</span><u></u><u></u></p><p class="MsoNormal"><span style="color:#1f497d">UNIX Systems Administration</span><u></u><u></u></p>
<p class="MsoNormal"><span style="color:blue"><img border="0" width="65" height="45" src="cid:image001.jpg@01CF9130.D84A00E0" alt="cid:638154011@09122011-048B"></span><u></u><u></u></p><p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1f497d">9601 S. Meridian Blvd.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1f497d">Englewood, CO 80112</span><u></u><u></u></p><p class="MsoNormal"><span style="color:#1f497d"><a href="tel:720-514-6293" target="_blank">720-514-6293</a></span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p></div></div><p class="MsoNormal" style="margin-bottom:12.0pt"><br>_______________________________________________<br>Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><u></u><u></u></p>
</div><p class="MsoNormal"><br><br clear="all"><u></u><u></u></p><div><p class="MsoNormal"> <u></u><u></u></p></div><p class="MsoNormal">-- <u></u><u></u></p><div><p class="MsoNormal">Andrew Mann<u></u><u></u></p><div><p class="MsoNormal">
DivvyCloud Inc.<u></u><u></u></p></div><div><p class="MsoNormal"><a href="http://www.divvycloud.com" target="_blank">www.divvycloud.com</a><u></u><u></u></p></div></div></div></div></div></div></div></div><p class="MsoNormal">
<br><br clear="all"><u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><p class="MsoNormal">-- <u></u><u></u></p><div><p class="MsoNormal">Andrew Mann<u></u><u></u></p><div><p class="MsoNormal">DivvyCloud Inc.<u></u><u></u></p>
</div><div><p class="MsoNormal"><a href="http://www.divvycloud.com" target="_blank">www.divvycloud.com</a><u></u><u></u></p></div></div></div></div></div></div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>
<div dir="ltr">Andrew Mann<div>DivvyCloud Inc.</div><div><a href="http://www.divvycloud.com" target="_blank">www.divvycloud.com</a></div></div>
</div>