[neutron] Averaga number of rechecks in Neutron comparing to other projects
Hi neutrinos, As we discussed during the last PTG, I spent some time today to get average number of rechecks which we need to do in the last PS of the change before it's merged. In theory that number should be close to 0 as patch should be merged with first CI run when it's approved by reviewers :) All data are only from the master branch. I didn't check the same for stable branches. File with graph and raw data in csv format are in the attachments. Basically my conclusion is that Neutron's CI is really bad in that. We have to recheck many, many times before patches will be merged. We really need to think about how to improve that in Neutron. -- Slawek Kaplonski Principal Software Engineer Red Hat
Hi Slawek, A bit tangentially: did you use any sort of a script to collect the recheck numbers? I'd love to do the same kind of analysis for Ironic. Dmitry On Fri, Nov 12, 2021 at 6:21 PM Slawek Kaplonski <skaplons@redhat.com> wrote:
Hi neutrinos,
As we discussed during the last PTG, I spent some time today to get average number of rechecks which we need to do in the last PS of the change before it's merged. In theory that number should be close to 0 as patch should be merged with first CI run when it's approved by reviewers :) All data are only from the master branch. I didn't check the same for stable branches.
File with graph and raw data in csv format are in the attachments.
Basically my conclusion is that Neutron's CI is really bad in that. We have to recheck many, many times before patches will be merged. We really need to think about how to improve that in Neutron.
-- Slawek Kaplonski Principal Software Engineer Red Hat
-- Red Hat GmbH, https://de.redhat.com/ , Registered seat: Grasbrunn, Commercial register: Amtsgericht Muenchen, HRB 153243, Managing Directors: Charles Cachera, Brian Klemm, Laurie Krebs, Michael O'Neill
Hi, On czwartek, 25 listopada 2021 12:06:08 CET Dmitry Tantsur wrote:
Hi Slawek,
A bit tangentially: did you use any sort of a script to collect the recheck numbers? I'd love to do the same kind of analysis for Ironic.
I used script https://github.com/slawqo/tools/tree/master/rechecks
Dmitry
On Fri, Nov 12, 2021 at 6:21 PM Slawek Kaplonski <skaplons@redhat.com>
wrote:
Hi neutrinos,
As we discussed during the last PTG, I spent some time today to get average number of rechecks which we need to do in the last PS of the change before it's merged. In theory that number should be close to 0 as patch should be merged with first CI run when it's approved by reviewers :) All data are only from the master branch. I didn't check the same for stable branches.
File with graph and raw data in csv format are in the attachments.
Basically my conclusion is that Neutron's CI is really bad in that. We have to recheck many, many times before patches will be merged. We really need to think about how to improve that in Neutron.
-- Slawek Kaplonski Principal Software Engineer Red Hat
-- Slawek Kaplonski Principal Software Engineer Red Hat
participants (2)
-
Dmitry Tantsur
-
Slawek Kaplonski