Open Stack

Hi,

We are glad to present this week's priorities and subteam report for Ironic. As usual, this is pulled directly from the Ironic whiteboard[0] and formatted.

This Week's Priorities (as of the weekly ironic meeting)
========================================================
1. Refactoring of the way we access clients: https://review.openstack.org/#/q/topic:bug/1699547
2. Rolling upgrades missing bit: https://review.openstack.org/#/c/497666/
    2.1. disallow upgrades from ocata: https://review.openstack.org/#/c/497685/
    2.2. check object versions in dbsync tool: https://review.openstack.org/#/c/497703/
3. Switch to none auth for standalone mode: https://review.openstack.org/#/c/359061/
4. Review specs in preparation for the PTG


Bugs (dtantsur, vdrok, TheJulia)
--------------------------------
- Stats (diff between 21 Aug 2017 and 28 Aug 2017)
- Ironic: 250 bugs (+4) + 256 wishlist items (-3). 23 new, 190 in progress (+3), 0 critical, 30 high (-2) and 33 incomplete (+2)
- Inspector: 12 bugs + 29 wishlist items. 2 new, 10 in progress, 0 critical, 2 high and 3 incomplete
- Nova bugs with Ironic tag: 14 (-3). 0 new, 0 critical, 1 high

CI refactoring and missing test coverage
----------------------------------------
- not considered a priority, it's a 'do it always' thing
- Standalone CI tests (vsaienk0)
    - next patch to be reviewed, needed for 3rd party CI: https://review.openstack.org/#/c/429770/
- Missing test coverage (all)
    - portgroups and attach/detach tempest tests: https://review.openstack.org/382476
    - local boot with partition images: TODO https://bugs.launchpad.net/ironic/+bug/1531149
    - adoption: https://review.openstack.org/#/c/344975/
        - should probably be changed to use standalone tests
    - root device hints: TODO
    - node take over?
    - resource classes integration tests: https://review.openstack.org/#/c/443628/

Essential Priorities
====================

Nova resource class based scheduling changes (dtantsur)
-------------------------------------------------------
- I have to add this, as there are things to finish by end of Pike to avoid problems in Queens
- TODO as of 28 Aug 2017:
    - all done
- Optionally:
    - integration tests: https://review.openstack.org/#/c/443628/

Generic boot-from-volume (TheJulia, dtantsur)
---------------------------------------------
- BFV Meetings on hold until September.
- specs and blueprints:
    - http://specs.openstack.org/openstack/ironic-specs/specs/approved/volume-connection-information.html
        - code: https://review.openstack.org/#/q/topic:bug/1526231
    - http://specs.openstack.org/openstack/ironic-specs/specs/approved/boot-from-volume-reference-drivers.html
        - code: https://review.openstack.org/#/q/topic:bug/1559691
    - https://blueprints.launchpad.net/nova/+spec/ironic-boot-from-volume
        - code: https://review.openstack.org/#/q/topic:bp/ironic-boot-from-volume
- status as of 21 Aug 2017:
    - Pike stuff is done and released, including also the iRMC implementation
    - Queens ideas/thoughts should be posted to the BFV etherpad: https://etherpad.openstack.org/p/Ironic-BFV
    - Not required for Pike:
        - Nova:
            https://review.openstack.org/#/c/468353 - Ironic: Get IP address for volume connector

Rolling upgrades and grenade-partial (rloo, jlvillal)
-----------------------------------------------------
- spec approved; code patches: https://review.openstack.org/#/q/topic:bug/1526283
- status as of most recent weekly meeting:
    - add 'ironic-dbsync online_data_migrations' call to regular grenade test (not multinode test because grenade multinode test doesn't upgrade all services) https://review.openstack.org/497949 - APPROVED
    - to address restarting services after unpinning, spec: 'SIGHUP restarts services with updated configs': https://review.openstack.org/474309. APPROVED
        - code needs rebasing: https://review.openstack.org/#/c/474331/3
    - outstanding: dev documentation needs updating: https://review.openstack.org/#/c/419439/
    - we forgot to set the conductor version in the database :-( So that rolling upgrades will work without having to cut another Pike release, 2 patches starting with:
        - conductor saves version in db: https://review.openstack.org/#/c/497593/. (Not needed, but would be good to backport so less data migration in Rocky)
    - patches to switch over/disallow ocata -> queens upgrade, they depend on above patch, and start with:
        - Add online data migrations for conductor version (https://review.openstack.org/#/c/497666/1)

Driver composition (dtantsur)
-----------------------------
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/approved/driver-composition-reform.html
- gerrit topic: https://review.openstack.org/#/q/status:open+topic:bug/1524745
- status as of 28 Aug 2017:
    - documentation
        - upgrade guide for the remaining drivers: TODO
            - ilo: https://review.openstack.org/#/c/496480/
            - snmp: https://review.openstack.org/#/c/498541/
        - dev docs on writing hardware types: TODO
    - new hardware types:
        - apparently all merged in Pike
    - API for hardware interface properties:
        - proposed spec: https://review.openstack.org/#/c/471174/
    - spec on the classic drivers deprecation: http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/classic-drivers-future.html to be continued in Queens

High Priorities
===============

Physical network awareness (sambetts, vsaienk0)
-----------------------------------------------
- Etherpad tracking networking work: https://etherpad.openstack.org/p/Ironic-networking
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/physical-network-awareness.html
- Physical network awareness implementation
    - Related:
        - Refactor VIFPortIDMixin 2: https://review.openstack.org/#/c/486125/ MERGED
        - Refactor VIFPortIDMixin 3: https://review.openstack.org/#/c/486126/
        - Refactor VIFPortIDMixin 4: https://review.openstack.org/#/c/486127/
        - Create a fake network interface for tempest testing: https://review.openstack.org/#/c/486128/
        - Use fake network interface in VIF attach tempest tests: https://review.openstack.org/#/c/486129/
        - Assume neutron port exists in VIFPortIDMixin: https://review.openstack.org/#/c/476949
- networking-baremetal initial patches merged
- Routed networks support (sambetts, vsaienk0)
    - Dependent on physnet awareness
    - networking-baremetal initial patches
        - https://review.openstack.org/#/c/456235/ needs updating
    - RFE: https://bugs.launchpad.net/ironic/+bug/1658964
        - No RFE right now as all planned work is in networking-baremetal, but going to keep this around in case we need to make unexpected changes to ironic

Optional Priorities
===================

Python 3.5 compatibility (Nisha, Ankit)
---------------------------------------
- Topic: https://review.openstack.org/#/q/topic:goal-python35+NOT+project:openstack/governance+NOT+project:openstack/releases
    - this include all projects, not only ironic
    - please tag all reviews with topic "goal-python35"
other patches for experimental gates are not merging as core reviewers are asking to add the python3 builder in running gates instead of duplicating them in project-config project. https://review.openstack.org/462487,
https://review.openstack.org/462695, https://review.openstack.org/462701 and https://review.openstack.org/462706
- Two ironic patches in review:
    - https://review.openstack.org/473888 - MERGED
    - https://review.openstack.org/#/c/473913/ - MERGED
    - Raised the patch to move the experimental job to non-voting https://review.openstack.org/489278 MERGED
    - Raised https://review.openstack.org/495766 for testing ironic-inspector without swift functionality
- anupn to update the python3 job to build tinyipa with python3

Supported power states API (dtantsur)
-------------------------------------
- topic: https://review.openstack.org/#/q/topic:bug/1526226
    - note: the same topic as for soft power and NMI is used, as it's covered by the same spec
- status as of Aug 21st:
    - API patch: https://review.openstack.org/#/c/382194/


Moved to later releases
=======================

These are the things we had on priorities, but they are not making it in Pike.

Deploying with Apache and WSGI in CI (vsaienk0)
-----------------------------------------------
- ironic part seems finished (needs double-checking)
    - do we have install-guide bits on how to do it?
- inspector is TODO and depends on https://review.openstack.org/#/q/topic:bug/1525218
    - ironic is done, inspector will be bumped to Queens

Split away the tempest plugin (jlvillal)
----------------------------------------
- Proposed patch to create all the patches: https://review.openstack.org/489762
- jlvillal talked to infra and they suggested we do a batch upload as there are about 70 patches to merge in.
- patches waiting for review https://review.openstack.org/#/q/project:openstack/ironic-tempest-plugin
- need to port new patches in ironic/ironic-tempest-plugin (jlvillal)
- need to migrate ironic-inspector/ironic-tempest-plugin (jlvillal)

Reference architecture guide (dtantsur)
---------------------------------------
- status as of 14 Aug 2017:
    - Common bits: https://review.openstack.org/487410 needs a revision
    - I guess this moves to Queens

Rescue mode (stendulker/aparnav)
--------------------------------
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/approved/implement-rescue-mode.html
- code: https://review.openstack.org/#/q/topic:bug/1526449+status:open
- Status: 24 Jul 2017
- Patches in merge conflict. Need to rebase. The nova patch for Rescue is abandoned and rescue tempest patch(https://review.openstack.org/#/c/452308/) which is dependent on the nova patch is in merge conflict.
    - any plans to revive the nova patch soon(ish)?

Neutron event processing (vdrok, vsaienk0)
------------------------------------------
- spec at https://review.openstack.org/343684, ready for reviews
- WIP code at https://review.openstack.org/440778

Refactoring of code accessing other services (pas-ha)
-----------------------------------------------------
- gerrit topic: https://review.openstack.org/#/q/topic:bug/1699547
- status as of 1 Aug 2017: ready for review
- discussed in ironic meeting; -2'd until Queens

ironic-python-agent's REST API versioning (sambetts)
------------------------------------------------------
- RFE: https://bugs.launchpad.net/ironic-python-agent/+bug/1602265
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/ipa_api_versioning.html
- gerrit topic: https://review.openstack.org/#/q/topic:bug/1602265
- status as of 14 Aug 2017:
    - ironic part: https://review.openstack.org/#/c/364861/
    - IPA part: https://review.openstack.org/#/c/364834/ needs a revision
        - blocked by the ironic part per recent discussions
    - discussed in ironic meeting; most likely will not land in Pike

node tags (zhenguo, vdrok)
--------------------------
- spec: http://specs.openstack.org/openstack/ironic-specs/specs/approved/nodes-tagging.html
- topic: https://review.openstack.org/#/q/topic:bug/1526266
- status as of 19 Jun 2017:
    - next on review: https://review.openstack.org/#/c/233357/ needs rebase

Available clean steps API (rloo)
--------------------------------
- spec had been approved in mitaka: http://specs.openstack.org/openstack/ironic-specs/specs/5.0/manual-cleaning.html#get-nodes-node-ident-cleaning-steps
- status as of most recent weekly meeting:
    - patch has been rebased and updated, but reviewer comments still need to be addressed and it needs testing: https://review.openstack.org/#/c/278566/
    - this needs update to spec and possibly discussion at PTG. jroll and lucasagomes (with cdent + sdague) proposed a different API. IRC discussions:
        - http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2016-03-16.log.html#t2016-03-16T11:51:47
        - http://eavesdrop.openstack.org/irclogs/%23openstack-dev/%23openstack-dev.2016-03-16.log.html#t2016-03-16T13:55:43
        - move to Queens

deploy steps (rloo, mat128, yolanda)
------------------------------------
- Ocata summit design session etherpad: https://etherpad.openstack.org/p/ironic-ocata-summit-deploy-time-raid
- RFE: https://bugs.launchpad.net/ironic/+bug/1630376
- status as of most recent weekly meeting:
    - spec needs updating: https://review.openstack.org/#/c/412523/

etags in the REST API (pas-ha)
------------------------------
- RFE: https://bugs.launchpad.net/ironic/+bug/1605728
- topic: https://review.openstack.org/#/q/topic:bug/1605728
- Spec has merged: http://specs.openstack.org/openstack/ironic-specs/specs/approved/evolve-etags.html
- status as of Jul 17th:
    - The first patch is for adding etags for nodes endpoint, needs rebasing: https://review.openstack.org/392213
        - everything needs a rebase
    - (galyna) Patches-POC are up. Demo: https://asciinema.org/a/103604

Subprojects
===========

ironic-ui (ppiela, TheJulia)
----------------------------
- Meetings resume next week.
- Feature comparison spreadsheet https://docs.google.com/spreadsheets/d/1petifqVxOT70H2Krz7igV2m9YqgXaAiCHR8CXgoi9a0/edit#gid=0

.........

Until next week,
--Rama

[0] https://etherpad.openstack.org/p/IronicWhiteBoard