[openstack-dev] [ironic] this week's priorities and subteam reports

Yeleswarapu, Ramamani ramamani.yeleswarapu at intel.com
Mon Jan 29 18:14:50 UTC 2018


Hi,

We are glad to present this week's priorities and subteam report for Ironic. As usual, this is pulled directly from the Ironic whiteboard[0] and formatted.

This Week's Priorities (as of the weekly ironic meeting)
========================================================
Bugs that we want to land in this release:
1. ironic - Don't try to lock upfront for vif removal: https://review.openstack.org/#/c/534441/

FFEs that have been granted, need to land by Feb 2:
1. Classic drivers deprecation:
    - champions: rloo, stendulker
    - https://review.openstack.org/#/q/topic:bug/1690185+(status:open+OR+status:merged)
    1.1. Deprecate classic drivers: https://review.openstack.org/#/c/536928/
    1.2. Switch contributor documentation to hardware types: https://review.openstack.org/#/c/537959/
    1.3. Switch the CI to hardware types: https://review.openstack.org/#/c/536875/
2. Routed Networks support
    - champions: TheJulia, sambetts
    - https://review.openstack.org/#/q/project:openstack/networking-baremetal
    - https://review.openstack.org/521838 Switch from MechanismDriver to SimpleAgentMechanismDriverBase. **
    - https://review.openstack.org/#/c/536792/ Use reporting_interval option from neutron
    - https://review.openstack.org/#/c/536040/ Flat networks use node.uuid when binding ports. **
    - https://review.openstack.org/#/c/537353 Add documentation for baremetal mech **
        - https://review.openstack.org/#/c/532349/7 Add support to bind type vlan networks
        - https://review.openstack.org/524709 Make the agent distributed using hashring and notifications
    - CI patches:
        - https://review.openstack.org/#/c/531275/ Devstack - use neutron segments (routed provider networks)
        - https://review.openstack.org/#/c/531637/ Wait for ironic-neutron-agent to report state
        - https://review.openstack.org/#/c/530117/ Devstack - Add ironic-neutron-agent
        - https://review.openstack.org/#/c/530409/ Add dsvm job

3. Traits:
    - champions: rloo, TheJulia
    - https://review.openstack.org/#/q/topic:bug/1722194+(status:open+OR+status:merged)
    3.1. Add traits field to node notifications: https://review.openstack.org/#/c/536979/
    3.2. Fix nits found in node traits: https://review.openstack.org/#/c/537386/
    3.3. Add documentation for node traits: https://review.openstack.org/#/c/536980/
    3.4. Sort node traits in comparisons: https://review.openstack.org/#/c/538653/
4. Rescue
    4.1. Requires quick review for devstack changes. We cannot land devstack changes as the client calls did not land in Queens.
    4.2. TheJuia to do so after Monday meeting.
        - champions: dtantsur, TheJulia
        - https://review.openstack.org/#/q/topic:bug/1526449+(status:open+OR+status:merged)
    4.1. devstack: add support for rescue mode: https://review.openstack.org/#/c/524118/
        - rest of test patches can't land since they depend on a nova-related patch
    4.2. Update "standalone" job for supporting rescue mode: https://review.openstack.org/#/c/537821/
    4.3. Rescue mode standalone tests: https://review.openstack.org/#/c/538119/ (failing CI, not ready for reviews)
    4.4. Follow-up for agent rescue implementation: https://review.openstack.org/#/c/538252/
    4.5. Add documentation for rescue interface: https://review.openstack.org/#/c/419606/ (needs update)
    4.6. Follow-up patch for rescue extension for CoreOS: https://review.openstack.org/#/c/538429/
    4.7. Add documentation for rescue mode: https://review.openstack.org/#/c/431622/ (needs update)
5. Implementation for UEFI iSCSI boot for ILO:
    - champions: TheJulia, stendulker
    5.1. follow up patch needed, for https://review.openstack.org/#/c/468288/
6. deprecating python-oneviewclient from OneView interfaces
    - champions: dtantsur, TheJulia
    - https://review.openstack.org/#/q/status:merged+project:openstack/ironic+branch:master+topic:bug/1693788
    - Appears to be in good shape - Reno should be updated
    - https://review.openstack.org/#/c/524729/11/releasenotes/notes/remove-python-oneviewclient-b1d345ef861e156e.yaml

Vendor priorities
-----------------
cisco-ucs:
    Patches in works for SDK update, but not posted yet, currently rebuilding third party CI infra after a disaster...
idrac:
    RFE and first several patches for adding UEFI support will be posted by Tuesday, 1/9
ilo:
    https://review.openstack.org/#/c/530838/ - OOB Raid spec for iLO5
irmc:
None

oneview:
    Remove python-oneviewclient from oneview hardware type - https://review.openstack.org/#/c/524729/ MERGED

Subproject priorities
---------------------
bifrost:
    (TheJulia): Fedora support fixes -  https://review.openstack.org/#/c/471750/
ironic-inspector (or its client):
    (dtantsur) keystoneauth adapters https://review.openstack.org/#/c/515787/ MERGED
networking-baremetal:
    neutron baremetal agent https://review.openstack.org/#/c/456235/ MERGED
sushy and the redfish driver:
    (dtantsur) implement redfish sessions: https://review.openstack.org/#/c/471942/ MERGED

Bugs (dtantsur, vdrok, TheJulia)
--------------------------------
- Stats (diff between  08 Jan 2018 and 15 Jan 2018)
- Ironic: 216 bugs (-3) + 260 wishlist items. 1 new (-1), 156 in progress (-2), 0 critical, 33 high (-1) and 27 incomplete (-1)
- Inspector: 14 bugs (-1) + 28 wishlist items. 0 new, 10 in progress, 0 critical, 2 high (-1) and 6 incomplete (+1)
- Nova bugs with Ironic tag: 13. 1 new, 0 critical, 0 high
- via http://dashboard-ironic.7e14.starter-us-west-2.openshiftapps.com/
    - the dashboard was abruptly deleted and needs a new home :(
- HIGH bugs with patches to review:
- Clean steps are not tested in gate https://bugs.launchpad.net/ironic/+bug/1523640: Add manual clean step ironic standalone test https://review.openstack.org/#/c/429770/15
    - Needs to be reproposed to the ironic tempest plugin repository.
- prepare_instance() is not called for whole disk images with 'agent' deploy interface https://bugs.launchpad.net/ironic/+bug/1713916:
    - Fix ``agent`` deploy interface to call ``boot.prepare_instance`` https://review.openstack.org/#/c/499050/
        - (TheJulia) Currently WF-1, as revision is required for deprecation.
- If provisioning network is changed, Ironic conductor does not behave correctly https://bugs.launchpad.net/ironic/+bug/1679260: Ironic conductor works correctly on changes of networks: https://review.openstack.org/#/c/462931/
    - (rloo) needs some direction
    - may be fixed as part of https://review.openstack.org/#/c/460564/
- IPA may not find partition created by conductor https://bugs.launchpad.net/ironic-lib/+bug/1739421
    - Fix proposed: https://review.openstack.org/#/c/529325/ MERGED

CI refactoring and missing test coverage
----------------------------------------
- not considered a priority, it's a 'do it always' thing
- Standalone CI tests (vsaienk0)
    - next patch to be reviewed, needed for 3rd party CI: https://review.openstack.org/#/c/429770/
    - localboot with partitioned image patches:
        - Ironic - add localboot partitioned image test: https://review.openstack.org/#/c/502886/
        - when previous are merged TODO (vsaienko)
            - Upload tinycore partitioned image to tarbals.openstack.org
            - Switch ironic to use tinyipa partitioned image by default
- Missing test coverage (all)
    - portgroups and attach/detach tempest tests: https://review.openstack.org/382476
    - adoption: https://review.openstack.org/#/c/344975/
        - should probably be changed to use standalone tests
    - root device hints: TODO
    - node take over
    - resource classes integration tests: https://review.openstack.org/#/c/443628/
    - radosgw (https://bugs.launchpad.net/ironic/+bug/1737957)

Essential Priorities
====================

Ironic client API version negotiation (TheJulia, dtantsur)
----------------------------------------------------------
- RFE https://bugs.launchpad.net/python-ironicclient/+bug/1671145
- Nova bug https://bugs.launchpad.net/nova/+bug/1739440
- gerrit topic: https://review.openstack.org/#/q/topic:bug/1671145
- status as of 29 Jan 2017:
    - Nova bug: https://bugs.launchpad.net/nova/+bug/1739440
    - TODO:
        - easier access to versions in ironicclient
            - see https://etherpad.openstack.org/p/ironic-api-version-negotiation
                - discussion of various ways to implement it happened on the midcycle
                - dtantsur wants to have an API-SIG guideline on consuming versions in SDKs
                    - ready for review https://review.openstack.org/532814
                - patches for ironicclient by TheJulia:
                    - expose negotiated latest: https://review.openstack.org/531029 MERGED
                    - accept list of versions: https://review.openstack.org/#/c/531271/ MERGED
        - establish foundation for using version negotiation in nova
                - (rloo) nova would not approve it for valid reasons, and grenade started working again...
    - nothing more for Queens. Stay tuned...
    - need to make sure that we discuss/agree with nova about how to do this

External project authentication rework (pas-ha, TheJulia)
---------------------------------------------------------
- gerrit topic: https://review.openstack.org/#/q/topic:bug/1699547
- status as of 29 Jan 2017:
    - 0 inspector patch left
        - https://review.openstack.org/#/c/515786/ MERGED
        - https://review.openstack.org/#/c/515787 MERGED
- This is DONE!

Classic drivers deprecation (dtantsur)
--------------------------------------
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/classic-drivers-future.html
- status as of 29 Jan 2017:
    - dev documentation for hardware types: TODO
    - switch documentation to hardware types:
        - need help from vendors updating their pages
    - migration of classic drivers to hardware types:
        - updating spec based on actual code: https://review.openstack.org/#/c/536298/ MERGED
            - see the commit message for explanation
        - support options for migrations: https://review.openstack.org/535772 MERGED
        - upgrade (for IPMI, SNMP and fake): https://review.openstack.org/#/c/534373/ MERGED
        - other drivers TODO
    - migration of CI to hardware types
        - switch all jobs from -_ipmitool to ipmi: https://review.openstack.org/#/c/536875/
        - switch inspector CI: https://review.openstack.org/#/c/537415/
        - clean up job playbooks: https://review.openstack.org/#/c/535896/
    - actual deprecation: https://review.openstack.org/#/c/536928/
    - there is an FFE for this; trying to get the above landed by Feb 2

Traits support planning (mgoddard, johnthetubaguy, dtantsur)
------------------------------------------------------------
- http://specs.openstack.org/openstack/ironic-specs/specs/approved/node-traits.html
- Nova patches: https://review.openstack.org/#/q/topic:bp/ironic-driver-traits+(status:open+OR+status:merged)
    - have been approved, waiting to merge
- status as of 29 Jan 2018:
    - deploy templates spec: https://review.openstack.org/504952 needs reviews
        - depends on deploy-steps spec: https://review.openstack.org/#/c/412523
    - patches for traits API
        - DB model & DB API
            - https://review.openstack.org/#/c/528238 (MERGED)
            - https://review.openstack.org/#/c/530723 (MERGED)
        - Add version to DB object
            - https://review.openstack.org/#/c/535482 (MERGED)
        - RPC objects
            - https://review.openstack.org/#/c/532268 MERGED
        - RPC API & conductor
            - https://review.openstack.org/#/c/535296 MERGED
        - API
            - https://review.openstack.org/#/c/532269 MERGED
        - API ref
            - https://review.openstack.org/#/c/536384 MERGED
        - Client
            - https://review.openstack.org/#/c/532622/ MERGED
    - There is an FFE for this; most of the code, including client has landed, trying to get rest landed by Feb 2.

Reference architecture guide (dtantsur, sambetts)
-------------------------------------------------
- status as of 22 Jan 2017:
    - dtantsur needs volunteers to help move this forward
    - list of cases from https://etherpad.openstack.org/p/ironic-queens-ptg-open-discussion
        - Admin-only provisioner
            - small and/or rare: TODO
            - large and/or frequent: TODO
        - Bare metal cloud for end users
            - smaller single-site: TODO
            - larger single-site: TODO
            - larger multi-site: TODO

High Priorities
===============

Neutron event processing (vdrok, vsaienk0, sambetts)
----------------------------------------------------
- status as of 27 Sep 2017:
    - spec at https://review.openstack.org/343684, ready for reviews, replies from authors
    - WIP code at https://review.openstack.org/440778

Routed network support (sambetts, vsaienk0, bfournie, hjensas)
--------------------------------------------------------------
- status as of 29 Jan 2018:
    - The first couple of patches merged ... we need some more landing before we have something of use. (e.g this one to actually use the agent_db data https://review.openstack.org/#/c/521838/ )
    - Need reviews ... https://review.openstack.org/#/q/topic:bug/1658964+(status:open+OR+status:merged)
    - With neutron fixed; patch below; the dsvm job seems stable.
    - Fix for neutron issue https://review.openstack.org/#/c/534449/ (Merged).
    - hjensas taken over as main contributor from sambetts
    - There is challenges with integration to Placement due to the way the integration was done in neutron.
    Neutron will create a resource provider for network segments in Placement, then it creates an os-aggregate
    in Nova for the segment, adds nova compute hosts to this aggregate. Ironic nodes cannot be added to host-aggregates.
    I (hjensas) had a short discussion with neutron devs (mlavalle) on the issue:
       http://eavesdrop.openstack.org/irclogs/%23openstack-neutron/%23openstack-neutron.2018-01-12.log.html#t2018-01-12T17:05:38
    There are patches in Nova to add support for ironic nodes in host-aggregates:
        - https://review.openstack.org/#/c/526753/ allow compute nodes to be associated with host agg
        - https://review.openstack.org/#/c/529135/ (Spec)
    - Patches:
        - https://review.openstack.org/456235 Add baremetal neutron agent (Merged)
        - https://review.openstack.org/#/c/533707/ start_flag = True, only first time, or conf change (Merged)
        - https://review.openstack.org/521838 Switch from MechanismDriver to SimpleAgentMechanismDriverBase
        - https://review.openstack.org/#/c/536040/ Flat networks use node.uuid when binding ports.
        - https://review.openstack.org/#/c/537353 Add documentation for baremetal mech
        - https://review.openstack.org/#/c/532349/7 Add support to bind type vlan networks
        - https://review.openstack.org/524709 Make the agent distributed using hashring and notifications
    - CI Patches:
        - https://review.openstack.org/#/c/531275/ Devstack - use neutron segments (routed provider networks)
        - https://review.openstack.org/#/c/531637/ Wait for ironic-neutron-agent to report state
        - https://review.openstack.org/#/c/530117/ Devstack - Add ironic-neutron-agent
        - https://review.openstack.org/#/c/530409/ Add dsvm job
        - https://review.openstack.org/#/c/392959/ Rework Ironic devstack baremetal network simulation

Rescue mode (rloo, stendulker, aparnav)
---------------------------------------
- Status as on 29 Jan 2018
    - spec: http://specs.openstack.org/openstack/ironic-specs/specs/approved/implement-rescue-mode.html
    - code: https://review.openstack.org/#/q/topic:bug/1526449+status:open
    - ironic side:
        - All patches are up-to-date, being actively reviewed and updated
        - Tempest tests based on standalone ironic is WIP.
        - Tempest tests with nova is also WIP: https://review.openstack.org/#/c/528699/
        - Add documentation for rescue interface https://review.openstack.org/419606
        - Follow-up for agent rescue implementation https://review.openstack.org/538252
    - nova side:
        - https://blueprints.launchpad.net/nova/+spec/ironic-rescue-mode: approved for Queens; waiting for ironic part to be done first. Queens feature freeze is week of Jan 22. (TheJulia) Nova has indicated that this is deferred until Rocky.
        - To get the nova patch merged, we need:
            - release new python-ironicclient
            - update ironicclient version in upper-constraints (this patch will be posted automatically)
            - update ironicclient version in global-requirement (this patch needs to be posted manually)
        - code patch: https://review.openstack.org/#/c/416487/
        - There is a FFE for this. However, the client has been released without the rescue code, so this won't all land. (Can't land anything that needs the client code).
        - CI is needed for nova part to land
            - tiendc is working for CI

Clean up deploy interfaces (vdrok)
----------------------------------
- status as of 9 Jan 2017:
    - patch https://review.openstack.org/524433 ready for reviews

Zuul v3 jobs in-tree (sambetts, derekh, jlvillal, rloo)
-------------------------------------------------------
- etherpad tracking zuul v3 -> intree: https://etherpad.openstack.org/p/ironic-zuulv3-intree-tracking
- cleaning up/centralizing job descriptions (eg 'irrelevant-files'): DONE
- Next TODO is to convert jobs on master, to proper ansible. NOT a high priority though.
    - (pas-ha) DNM experimental patch with "devstack-tempest" as base job https://review.openstack.org/#/c/520167/

Graphical console interface (pas-ha, vdrok, rpioso)
---------------------------------------------------
- status as of 8 Jan 2017:
    - spec on review: https://review.openstack.org/#/c/306074/
    - there is nova part here, which has to be approved too
    - dtantsur is worried by absence of progress here
        - (TheJulia) I think for rocky, it might be worth making it a prime focus, or making it a background goal.

BIOS config framework (dtantsur, yolanda, rpioso)
-------------------------------------------------
- status as of 8 Jan 2017:
    - spec under active review: https://review.openstack.org/#/c/496481/

Ansible deploy interface (pas-ha)
---------------------------------
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/ansible-deploy-driver.html
- status as of 22 Jan 2017:
    - code merged
    - TODO
        - CI job
            - https://review.openstack.org/529640 MERGED
            - https://review.openstack.org/#/c/529383/ MERGED
            - done?
        - docs: https://review.openstack.org/#/c/525501/

OpenStack Priorities
====================

Python 3.5 compatibility (Nisha, Ankit)
---------------------------------------
- Topic: https://review.openstack.org/#/q/topic:goal-python35+NOT+project:openstack/governance+NOT+project:openstack/releases
    - this include all projects, not only ironic
    - please tag all reviews with topic "goal-python35"
- TODO submit the python3 job for IPA
- for ironic and ironic-inspector job enabled by disabling swift as swift is still lacking py3.5 support.
- anupn to update the python3 job to build tinyipa with python3
    - (anupn): Talked with swift folks and there is a bug upstream opened  https://review.openstack.org/#/c/401397 for py3 support in swift. But this is not on their priority
    - Right now patch pass all gate jobs except agent_- drivers.
- we need to make the ironic job voting eventually. but we need to check that nova, glance and neutron already have voting python 3 jobs, otherwise they may break us.
    - nova seems to have python 3 jobs voting, here are our patches:
        - ironic https://review.openstack.org/#/c/531398/
        - ironic-inspector https://review.openstack.org/#/c/531400/ MERGED

Deploying with Apache and WSGI in CI (pas-ha, vsaienk0)
-------------------------------------------------------
- ironic is mostly finished
    - (pas-ha) needs to be rewritten for uWSGI, patches on review:
        - https://review.openstack.org/#/c/507011/ +A
        - https://review.openstack.org/#/c/507067 Needs revision
- inspector is TODO and depends on https://review.openstack.org/#/q/topic:bug/1525218
    - may be delayed to after Queens, as the HA work seems to take a different direction

Split away the tempest plugin (jlvillal)
----------------------------------------
- https://etherpad.openstack.org/p/ironic-tempest-plugin-migration
- Current (8-Jan-2018) (jlvillal): All projects now using tempest plugin code from openstack/ironic-tempest-plugin
    - Need to remove plugin code from master branch of openstack/ironic and openstack/ironic-inspector
        - Plugin code will NOT be removed from the stable branches of openstack/ironic and openstack/ironic-inspector
        - (jlvillal) 3rd Party CI has had over 3 weeks to prepare for removal. We should now move forward
    - README, setup.cfg and docs cleanup: https://review.openstack.org/#/c/529538/ MERGED
    - ironic-tempest-plugin 1.0.0 released

Subprojects
===========

Inspector (dtantsur)
--------------------
- trying to flip dsvm-discovery to use the new dnsmasq pxe filter and failing because of bash :Dhttps://review.openstack.org/#/c/525685/6/devstack/plugin.sh@202
- follow-ups being merged/reviewed; working on state consistency enhancements https://review.openstack.org/#/c/510928/ too (HA demo follow-up)

Bifrost (TheJulia)
------------------
- Also seems a recent authentication change in keystoneauth1 has broken processing of the clouds.yaml files, i.e. `openstack` command does not work.
    - TheJulia will try to look at this this week.

Drivers:
--------

DRAC (rpioso, dtantsur)
~~~~~~~~~~~~~~~~~~~~~~~
- Dell Ironic CI is being rebuilt, its back and running now (10/17/2017)


OneView (ricardoas, nicodemos, gmonteiro)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
- Re-submitting reverted patches for migration from python-oneviewclient to python-hpOneView + python-ilorest-library [MERGED]
    - Check weekly priorities for most import patch to review


Cisco UCS (sambetts)
~~~~~~~~~~~~~~~~~~~~
- Currently rebuilding third party CI from the ground up after it bit the dust
- Patches for updating the UCS python SDKs are in the works and should be posted soon
.........

Until next week,
--Rama

[0] https://etherpad.openstack.org/p/IronicWhiteBoard




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20180129/c84d64b9/attachment.html>


More information about the OpenStack-dev mailing list