[openstack-dev] [cinder] The Absurdity of the Milestone-1 Deadline for Drivers

Ben Swartzlander ben at swartzlander.org
Mon Sep 28 19:11:04 UTC 2015


On 09/28/2015 02:42 PM, Walter A. Boring IV wrote:
> On 09/28/2015 10:29 AM, Ben Swartzlander wrote:
>> I've always thought it was a bit strange to require new drivers to 
>> merge by milestone 1. I think I understand the motivations of the 
>> policy. The main motivation was to free up reviewers to review "other 
>> things" and this policy guarantees that for 75% of the release 
>> reviewers don't have to review new drivers. The other motivation was 
>> to prevent vendors from turning up at the last minute with crappy 
>> drivers that needed a ton of work, by encouraging them to get started 
>> earlier, or forcing them to wait until the next cycle.
>>
>> I believe that the deadline actually does more harm than good.
> But harm to whom?   It certainly puts the pressure on driver 
> developers to make sure they get involved in the Cinder community and 
> get aware of when the deadlines are.
> I believe it simply shifts the time in which drivers get into tree. My 
> $0.02 of opinion is, that if a new driver developer misses the 
> milestone, then they have the rest of the release to work on getting 
> CI up and running and ready to go for the next release.   I'm not sure 
> I see the harm to the Cinder community or the project.   It's a 
> deadline that a driver developer has to be aware of and compensate 
> for.  We've had how many drivers land in the last 2 releases using 
> this requirement?  I believe it's somewhere of 20+ drivers?
>

Walt I think you missed the point of my suggestion. I don't actually 
care when drivers go in. What I care about is that features land early 
so they can get appropriate review time and testing time, and so that 
merge conflicts can be dealt with. It seems to me that many people 
review nothing but drivers during milestone-1 so I suggest moving the 
deadline so those reviews can happen later. The 3rd milestone is when 
there should be no big architectural changes going on and is IMO the 
safest time to merge drivers. So the harm of the milestone-1 deadline is 
that is sucks all the oxygen out of the room, delaying features to 
milestone-2.

-Ben


>>
>> First of all, to those that don't want to spend time on driver 
>> reviews, there are other solutions to that problem. Some people do 
>> want to review the drivers, and those who don't can simply ignore 
>> them and spend time on what they care about. I've heard people who 
>> spend time on driver reviews say that the milestone-1 deadline 
>> doesn't mean they spend less time reviewing drivers overall, it just 
>> all gets crammed into the beginning of each release. It should be 
>> obvious that setting a deadline doesn't actually affect the amount of 
>> reviewer effort, it just concentrates that effort.
>>
>> The argument about crappy code is also a lot weaker now that there 
>> are CI requirements which force vendors to spend much more time up 
>> front and clear a much higher quality bar before the driver is even 
>> considered for merging. Drivers that aren't ready for merge can 
>> always be deferred to a later release, but it seems weird to defer 
>> drivers that are high quality just because they're submitted during 
>> milestones 2 or 3.
> I disagree here.  CI doesn't prevent you from having a crappy driver.  
> Your driver just needs to pass CI tests.  CI ensures that your driver 
> works, but doesn't ensure that it
> really meats the core reviewers standards for code.  Do we care? I 
> think we do.  Having drivers talk directly to the db, or FC drivers 
> missing the FCZM decorators for auto zoning, etc.
>
>>
>> All the the above is just my opinion though, and you shouldn't care 
>> about my opinions, as I don't do much coding and reviewing in Cinder. 
>> There is a real reason I'm writing this email...
>>
>> In Manila we added some major new features during Liberty. All of the 
>> new features merged in the last week of L-3. It was a nightmare of 
>> merge conflicts and angry core reviewers, and many contributors 
>> worked through a holiday weekend to bring the release together. While 
>> asking myself how we can avoid such a situation in the future, it 
>> became clear to me that bigger features need to merge earlier -- the 
>> earlier the better.
>>
>> When I look at the release timeline, and ask myself when is the best 
>> time to merge new major features, and when is the best time to merge 
>> new drivers, it seems obvious that *features* need to happen early 
>> and drivers should come *later*. New major features require FAR more 
>> review time than new drivers, and they require testing, and even 
>> after they merge they cause merge conflicts that everyone else has to 
>> deal with. Better that that works happens in milestones 1 and 2 than 
>> right before feature freeze. New drivers can come in right before 
>> feature freeze as far as I'm concerned. Drivers don't cause merge 
>> conflicts, and drivers don't need huge amounts of testing (presumably 
>> the CI system ensure some level of quality).
>>
>> It also occurs to me that new features which require driver 
>> implementation (hello replication!) *really* should go in during the 
>> first milestone so that drivers have time to implement the feature 
>> during the same release.
>>
>> So I'm asking the Cinder core team to reconsider the milestone-1 
>> deadline for drivers, and to change it to a deadline for new major 
>> features (in milestone-1 or milestone-2), and to allow drivers to 
>> merge whenever*. This is the same pitch I'll be making to the Manila 
>> core team. I've been considering this idea for a few weeks now but I 
>> wanted to wait until after PTL elections to suggest it here.
>>
>> -Ben Swartzlander
>>
>>
>> * I don't actually care if/when there is a driver deadline, what I 
>> care about is that reviewers are free during M-1 to work on 
>> reviewing/testing of features. The easiest way to achieve that seems 
>> to be moving the driver deadline.
> I'm not opposed to M-2 for new drivers, but I think it simply shifts 
> the headache of 3000+ line driver reviews to M-2 instead of M-1, 
> reviewers will spend their time reviewing core features and not look 
> at drivers until the M-2 deadline.  Is that better or worse?  I think 
> part of this is why we've raised the discussion of pulling drivers out 
> of Cinder tree.
> I'm not clear how that helps the community and quality of drivers though.
>
> Walt
>
>
>
> __________________________________________________________________________ 
>
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: 
> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




More information about the OpenStack-dev mailing list