[openstack-dev] [oslo] usage patterns for oslo.config
Doug Hellmann
doug at doughellmann.com
Tue Aug 26 14:00:52 UTC 2014
On Aug 26, 2014, at 6:30 AM, Mark McLoughlin <markmc at redhat.com> wrote:
> On Mon, 2014-08-11 at 15:06 -0400, Doug Hellmann wrote:
>> On Aug 8, 2014, at 7:22 PM, Devananda van der Veen <devananda.vdv at gmail.com> wrote:
>>
>>> On Fri, Aug 8, 2014 at 12:41 PM, Doug Hellmann <doug at doughellmann.com> wrote:
>>>>
>>>> That’s right. The preferred approach is to put the register_opt() in
>>>> *runtime* code somewhere before the option will be used. That might be in
>>>> the constructor for a class that uses an option, for example, as described
>>>> in
>>>> http://docs.openstack.org/developer/oslo.config/cfg.html#registering-options
>>>>
>>>> Doug
>>>
>>> Interesting.
>>>
>>> I've been following the prevailing example in Nova, which is to
>>> register opts at the top of a module, immediately after defining them.
>>> Is there a situation in which one approach is better than the other?
>>
>> The approach used in Nova is the “old” way of doing it. It works, but
>> assumes that all of the application code is modifying a global
>> configuration object. The runtime approach allows you to pass a
>> configuration object to a library, which makes it easier to mock the
>> configuration for testing and avoids having the configuration options
>> bleed into the public API of the library. We’ve started using the
>> runtime approach in new Oslo libraries that have configuration
>> options, but changing the implementation in existing application code
>> isn’t strictly necessary.
>
> I've been meaning to dig up some of the old threads and reviews to
> document how we got here.
>
> But briefly:
>
> * this global CONF variable originates from the gflags FLAGS variable
> in Nova before oslo.config
>
> * I was initially determined to get rid of any global variable use
> and did a lot of work to allow glance use oslo.config without a
> global variable
>
> * one example detail of this work - when you use paste.deploy to
> load an app, you have no ability to pass a config object
> through paste.deploy to the app. I wrote a little helper that
> used a thread-local variable to mimic this pass-through.
>
> * with glance done, I moved on to making keystone use oslo.config and
> initially didn't use the global variable. Then I ran into a veto
> from termie who felt very strongly that a global variable should be
> used.
>
> * in the end, I bought the argument that the use of a global variable
> was pretty deeply ingrained (especially in Nova) and that we should
> aim for consistent coding patterns across projects (i.e. Oslo
> shouldn't be just about shared code, but also shared patterns). The
> only realistic "standard pattern" we could hope for was the use of
> the global variable.
>
> * with that agreed, we reverted glance back to using a global
> variable and all projects followed suit
>
> * the case of libraries is different IMO - we'd be foolish to design
> APIs which lock us into using the global object
>
> So ... I wouldn't quite agree that this is "the new way" vs "the old
> way", but I think it would be reasonable to re-open the discussion about
> using the global object in our applications. Perhaps, at least, we could
> reduce our dependence on it.
The aspect I was calling “old” was the “register options at import time” pattern, not the use of a global. Whether we use a global or not, registering options at runtime in a code path that will be using them is better than relying on import ordering to ensure options are registered before they are used.
Doug
>
> Oh look, we have a FAQ on this:
>
> https://wiki.openstack.org/wiki/Oslo#Why_does_oslo.config_have_a_CONF_object.3F_Global_object_SUCK.21
>
> Mark.
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
More information about the OpenStack-dev
mailing list