[ops][nova] Problems with AggregateMultiTenancyIsolation/AggregateInstanceExtraSpecsFilter after Train --> Yoga update

Massimo Sgaravatto massimo.sgaravatto at gmail.com
Fri May 27 08:08:31 UTC 2022


Dear all

We have the following use case:

- reserve 3 hypervisors for VMs with "big" flavors (whatever the users of
these instances are)
- partition the rest of the hypervisors according to the project (so
projects A1,A2..,An can use only subset S1 of hypervisors,
project B1,B2,..,Bm can use only subset S2 of hypervisors)

We implemented this:

1- by setting an aggregate_instance_extra_spec  'size'  property (with
value 'normal' or 'big') for each flavor  [*]
2- by creating a BigVMs  HostAggregate for size=big [**]
3- by creating an HostAggregate for size=normal for each project, such as
this one [***]


This used to work.

A few days ago we updated our infrastructure from Train to Yoga
This was an offline Fast Forward Update: we went through the intermediate
releases just to do the dbsyncs.
Since this update the instantiation of VMs with flavors with the size=big
property doesn't work anymore


This is what I see in nova-scheduler log:
2022-05-27 08:38:02.058 5273 INFO nova.filters
[req-f92c0e38-262a-4d22-a7fd-8874c4265401 e237e43716fb490db5bda4b777835669
32b5d42c02b0411b8ebf2c33079eeecf - default default] Filtering removed all
hosts for the request with instance ID
'2412e188-9d5f-4812-ad21-195769a3c220'. Filter results:
['AggregateMultiTenancyIsolation: (start: 59, end: 10)',
'AggregateInstanceExtraSpecsFilter: (start: 10, end: 0)']


Only modifying the  property of the BigVMs HA using the filter_tenant_id
adding the relevant project:

[root at cld-ctrl-01 ~]# openstack aggregate show BigVMs | grep prop
| properties        | filter_tenant_id='32b5d42c02b0411b8ebf2c33079eeecf',
size='big'                       |

the scheduling works

Specifying each project and keeping the list up-to-date would be a problem.
Moreover if I am not wrong there is a maximum length for the property field.

Any hints ?
I didn't find anything related to this issue in the nova release notes for
Openstack releases > Train


These are the filters that we enabled:

[filter_scheduler]
enabled_filters =
AggregateMultiTenancyIsolation,AggregateInstanceExtraSpecsFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGro\
upAffinityFilter,PciPassthroughFilter,NUMATopologyFilter


Thanks a lot, Massimo


[*]
E.g.
[root at cld-ctrl-01 ~]# openstack flavor show cldareapd.medium | grep prope
| properties                 | aggregate_instance_extra_specs:size='normal'
|[root at cld-ctrl-01 ~]# openstack flavor show
cloudvenetocloudveneto.40cores128GB25-bigunipd | grep prop
| properties                 | aggregate_instance_extra_specs:size='big'
   |


[**]

[root at cld-ctrl-01 ~]# openstack aggregate show BigVMs
+-------------------+---------------------------------------------------------------------------------------+
| Field             | Value
                                |
+-------------------+---------------------------------------------------------------------------------------+
| availability_zone | nova
                                 |
| created_at        | 2018-06-20T06:54:51.000000
                                 |
| deleted_at        | None
                                 |
| hosts             | cld-blu-08.cloud.pd.infn.it,
cld-blu-09.cloud.pd.infn.it, cld-blu-10.cloud.pd.infn.it |
| id                | 135
                                |
| is_deleted        | False
                                |
| name              | BigVMs
                                 |
| properties        |size='big'                       |
| updated_at        | None
                                 |
| uuid              | 4b593395-1c76-441c-9022-d421f4ea2dfb
                                 |
+-------------------+---------------------------------------------------------------------------------------+


[***]
[root at cld-ctrl-01 ~]# openstack aggregate show Unipd-AdminTesting-Unipd
+-------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field             | Value



                                    |
+-------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| availability_zone | nova



                                     |
| created_at        | 2018-04-12T07:31:01.000000



                                     |
| deleted_at        | None



                                     |
| hosts             | cld-blu-01.cloud.pd.infn.it,
cld-blu-02.cloud.pd.infn.it, cld-blu-05.cloud.pd.infn.it,
cld-blu-06.cloud.pd.infn.it, cld-blu-07.cloud.pd.infn.it,
cld-blu-11.cloud.pd.infn.it, cld-blu-12.cloud.pd.infn.it,
cld-blu-13.cloud.pd.infn.it, cld-blu-14.cloud.pd.infn.it,
cld-blu-15.cloud.pd.infn.it, cld-blu-16.cloud.pd.infn.it |
| id                | 126



                                    |
| is_deleted        | False



                                    |
| name              | Unipd-AdminTesting-Unipd



                                     |
| properties        | filter_tenant_id='32b5d42c02b0411b8ebf2c33079eeecf',
size='normal'


                                     |
| updated_at        | 2018-06-08T09:06:20.000000



                                     |
| uuid              | 38f6a0d4-77ab-42e0-abeb-57e06ba13cca



                                     |
+-------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
[root at cld-ctrl-01 ~]#
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20220527/e32143f3/attachment-0001.htm>


More information about the openstack-discuss mailing list