<div dir="ltr"><div>It looks like I need now to create a HostAggregate for "size=big" for each project, specifying as properties:</div><div> filter_tenant_id=<projectid>, size='big'<br></div><div><br></div><div>Is this the expected behaviour ?<br></div><div><br></div><div>Till Train a single HostAggregate with the property: size='big' was enough</div><div><br></div><div>Thanks, Massimo</div><div><br></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, May 27, 2022 at 10:08 AM Massimo Sgaravatto <<a href="mailto:massimo.sgaravatto@gmail.com">massimo.sgaravatto@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Dear all</div><div><br></div>We have the following use case:<div><br></div><div>- reserve 3 hypervisors for VMs with "big" flavors (whatever the users of these instances are)</div><div>- partition the rest of the hypervisors according to the project (so projects A1,A2..,An can use only subset S1 of hypervisors, project B1,B2,..,Bm can use only subset S2 of hypervisors)</div><div><br></div><div>We implemented this:</div><div><br></div><div>1- by setting an aggregate_instance_extra_spec 'size' property (with value 'normal' or 'big') for each flavor [*]</div>2- by creating a BigVMs HostAggregate for size=big [**]<div>3- by creating an HostAggregate for size=normal for each project, such as this one [***]</div><div><br></div><div> <br><div>This used to work.</div><div><br></div><div>A few days ago we updated our infrastructure from Train to Yoga</div><div>This was an offline Fast Forward Update: we went through the intermediate releases just to do the dbsyncs.<br></div><div>Since this update the instantiation of VMs with flavors with the size=big property doesn't work anymore<br></div><div><br></div><div><br></div><div>This is what I see in nova-scheduler log:</div><div>2022-05-27 08:38:02.058 5273 INFO nova.filters [req-f92c0e38-262a-4d22-a7fd-8874c4265401 e237e43716fb490db5bda4b777835669 32b5d42c02b0411b8ebf2c33079eeecf - default default] Filtering removed all hosts for the request with instance ID '2412e188-9d5f-4812-ad21-195769a3c220'. Filter results: ['AggregateMultiTenancyIsolation: (start: 59, end: 10)', 'AggregateInstanceExtraSpecsFilter: (start: 10, end: 0)']<br></div><div><br></div><div><br></div><div>Only modifying the property of the BigVMs HA using the filter_tenant_id adding the relevant project:</div><div><br></div><div>[root@cld-ctrl-01 ~]# openstack aggregate show BigVMs | grep prop<br>| properties | filter_tenant_id='32b5d42c02b0411b8ebf2c33079eeecf', size='big' |<br></div><div><br></div><div>the scheduling works</div><div><br></div><div>Specifying each project and keeping the list up-to-date would be a problem. Moreover if I am not wrong there is a maximum length for the property field.</div><div><br></div><div>Any hints ?</div><div>I didn't find anything related to this issue in the nova release notes for Openstack releases > Train </div><div><br></div><div><br></div><div>These are the filters that we enabled:</div><div><br></div><div>[filter_scheduler]<br>enabled_filters = AggregateMultiTenancyIsolation,AggregateInstanceExtraSpecsFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGro\<br>upAffinityFilter,PciPassthroughFilter,NUMATopologyFilter<br></div><div><br></div><div><br></div><div>Thanks a lot, Massimo</div><div><br></div><div><br></div><div>[*]</div><div>E.g.</div><div>[root@cld-ctrl-01 ~]# openstack flavor show cldareapd.medium | grep prope<br>| properties | aggregate_instance_extra_specs:size='normal' |[root@cld-ctrl-01 ~]# openstack flavor show cloudvenetocloudveneto.40cores128GB25-bigunipd | grep prop<br></div>| properties | aggregate_instance_extra_specs:size='big' |<br></div><div><br></div><div><br></div><div>[**]</div><div><br></div><div>[root@cld-ctrl-01 ~]# openstack aggregate show BigVMs<br>+-------------------+---------------------------------------------------------------------------------------+<br>| Field | Value |<br>+-------------------+---------------------------------------------------------------------------------------+<br>| availability_zone | nova |<br>| created_at | 2018-06-20T06:54:51.000000 |<br>| deleted_at | None |<br>| hosts | <a href="http://cld-blu-08.cloud.pd.infn.it" target="_blank">cld-blu-08.cloud.pd.infn.it</a>, <a href="http://cld-blu-09.cloud.pd.infn.it" target="_blank">cld-blu-09.cloud.pd.infn.it</a>, <a href="http://cld-blu-10.cloud.pd.infn.it" target="_blank">cld-blu-10.cloud.pd.infn.it</a> |<br>| id | 135 |<br>| is_deleted | False |<br>| name | BigVMs |<br>| properties |size='big' |<br>| updated_at | None |<br>| uuid | 4b593395-1c76-441c-9022-d421f4ea2dfb |<br>+-------------------+---------------------------------------------------------------------------------------+<br></div><div><br></div><div><br></div><div>[***]</div><div>[root@cld-ctrl-01 ~]# openstack aggregate show Unipd-AdminTesting-Unipd<br>+-------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<br>| Field | Value |<br>+-------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<br>| availability_zone | nova |<br>| created_at | 2018-04-12T07:31:01.000000 |<br>| deleted_at | None |<br>| hosts | <a href="http://cld-blu-01.cloud.pd.infn.it" target="_blank">cld-blu-01.cloud.pd.infn.it</a>, <a href="http://cld-blu-02.cloud.pd.infn.it" target="_blank">cld-blu-02.cloud.pd.infn.it</a>, <a href="http://cld-blu-05.cloud.pd.infn.it" target="_blank">cld-blu-05.cloud.pd.infn.it</a>, <a href="http://cld-blu-06.cloud.pd.infn.it" target="_blank">cld-blu-06.cloud.pd.infn.it</a>, <a href="http://cld-blu-07.cloud.pd.infn.it" target="_blank">cld-blu-07.cloud.pd.infn.it</a>, <a href="http://cld-blu-11.cloud.pd.infn.it" target="_blank">cld-blu-11.cloud.pd.infn.it</a>, <a href="http://cld-blu-12.cloud.pd.infn.it" target="_blank">cld-blu-12.cloud.pd.infn.it</a>, <a href="http://cld-blu-13.cloud.pd.infn.it" target="_blank">cld-blu-13.cloud.pd.infn.it</a>, <a href="http://cld-blu-14.cloud.pd.infn.it" target="_blank">cld-blu-14.cloud.pd.infn.it</a>, <a href="http://cld-blu-15.cloud.pd.infn.it" target="_blank">cld-blu-15.cloud.pd.infn.it</a>, <a href="http://cld-blu-16.cloud.pd.infn.it" target="_blank">cld-blu-16.cloud.pd.infn.it</a> |<br>| id | 126 |<br>| is_deleted | False |<br>| name | Unipd-AdminTesting-Unipd |<br>| properties | filter_tenant_id='32b5d42c02b0411b8ebf2c33079eeecf', size='normal' |<br>| updated_at | 2018-06-08T09:06:20.000000 |<br>| uuid | 38f6a0d4-77ab-42e0-abeb-57e06ba13cca |<br>+-------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<br>[root@cld-ctrl-01 ~]# <br></div><div><br></div></div>
</blockquote></div>