[Openstack-operators] [openstack-dev] [nova][ironic] Concerns over rigid resource class-only ironic scheduling

melanie witt melwittt at gmail.com
Thu Sep 14 16:30:32 UTC 2017


On Thu, 7 Sep 2017 14:57:24 -0500, Matt Riedemann wrote:
> Some more background information is in the ironic spec here:
> 
> https://review.openstack.org/#/c/500429/
> 
> Also, be aware of these release notes for Pike related to baremetal 
> scheduling:
> 
> http://docs-draft.openstack.org/77/501477/1/check/gate-nova-releasenotes/1dc7513//releasenotes/build/html/unreleased.html#id2 
> 
> 
> In Pike, nova is using a combination of VCPU/MEMORY_MB/DISK_GB resource 
> class amounts from the flavor during scheduling as it always has, but it 
> will also check for the custom resource_class which comes from the 
> ironic node. The custom resource class is optional in Pike but will be a 
> hard requirement in Queens, or at least that was the plan. The idea 
> being that long-term we'd stop consulting VCPU/MEMORY_MB/DISK_GB from 
> the flavor during scheduling and just use the atomic node.resource_class 
> since we want to allocate a nova instance to an entire ironic node, and 
> this is also why the Exact* filters were used too.
> 
> There are more details on using custom resource classes for scheduling 
> here:
> 
> https://specs.openstack.org/openstack/nova-specs/specs/pike/approved/custom-resource-classes-in-flavors.html 
> 
> 
> Nisha is raising the question about whether or not we're making 
> incorrect assumptions about how people are using nova/ironic and they 
> want to use the non-Exact filters for VCPU/MEMORY_MB/DISK_GB, which as 
> far as I have ever heard is not recommended/supported upstream as it can 
> lead to resource tracking issues in Nova that eventually lead to 
> scheduling failures later because of the scheduler thinking a node is 
> available for more than one instance when it's really not.

This came up in the Nova PTG room yesterday and I wanted to reply on the 
thread with what I understood about it, for those who weren't in the 
session. In general, it's recommended to use the exact filters (1 flavor 
per Ironic node hardware config) as there's no concept of partially 
claiming a baremetal node.

But, with the old non-exact filters, you _could_ get away with creating 
fewer flavors than you have hardware configs and get "fuzzy matching" on 
Ironic nodes, to get nodes whose configs are "close enough" but not 
exact. This might be helpful in situations where you have some oddball 
configs you don't want to have separate flavors for.
I was thinking, if it's possible to assign more than one resource class 
to an Ironic node, maybe you could get similar behavior to the old 
non-exact filters. So if you have an oddball config, you could tag it as 
multiple resource classes that it's "close enough" to for a match. But 
I'm not sure whether it's possible for an Ironic node to be tagged with 
more than one resource class.

-melanie



More information about the OpenStack-operators mailing list