[openstack-qa] Tempest Boto S3/EC2 tests

Dan Prince dprince at redhat.com
Mon Nov 12 17:17:57 UTC 2012



----- Original Message -----
> From: "Jay Pipes" <jaypipes at gmail.com>
> To: "Attila Fazekas" <afazekas at redhat.com>
> Cc: "All Things QA." <openstack-qa at lists.openstack.org>
> Sent: Monday, November 12, 2012 11:27:20 AM
> Subject: Re: [openstack-qa] Tempest Boto S3/EC2 tests
> 
> Attila, after reading through your proposed patches again, I'm still
> concerned that we're not on the same page.
> 
> Specifically, OpenStack does *not* have a public S3 API to test. At
> all.

I think maybe the intent here was to test nova-objectstore. See here:

  https://github.com/openstack/nova/blob/master/nova/objectstore/s3server.py#L20

Objectstore is essentially a small S3 like API backed by local file storage. Its primary purpose was to satisfy the need to test the EC2 API where things like registering images occur (euca-publish-tarball, etc.) It isn't meant to be used in production however so I wouldn't put too much effort into testing it specifically for S3 compatibility... the primary purpose is just to allow us to test the EC2 API for functional completeness. I'd stick to tests for things like registering images and leave specific S3 API testing out of Tempest for now.

We actually have some Smoke tests in Nova (written in Python, using Boto) which do something very similar:

https://github.com/openstack/nova/blob/master/smoketests/test_sysadmin.py#L55

When I run those via SmokeStack I usually use nova-objectstore to provide the S3 storage.

Another option would be to use Swift with this middleware installed https://github.com/fujita/swift3.git. I haven't tried this recently so I'm not sure it works as a drop in for these tests at the moment.

Hope this helps.

Dan

> 
> The EC2 tests we were hoping to add to Tempest were supposed to be
> tests
> of the EC2 API, not the S3 API, since Nova supplies an EC2 API
> endpoint.
> 
> We are not interested in adding tests for S3 to Tempest -- these
> tests
> exist already in Boto and other places. Since Nova has an EC2
> compatibility API endpoint, we're interested in testing that.
> 
> I'm not sure how better I can describe this... please find me on IRC
> if
> you need to discuss further.
> 
> Best,
> -jay
> 
> On 11/12/2012 10:00 AM, Attila Fazekas wrote:
> > Hi Jay,
> > 
> > Can you add some environment variables for configuration creation
> > in order to get working the
> > https://review.openstack.org/#/c/14689/ ?
> > Based on the bash debug output I see in the jenkins logs I created
> > small script. Probably the parts of the attached scripts can be
> > merged or at least can help.
> > 
> > The expected output when it has the s3-materailas:
> > EC2 run, stop and terminate instance ... ok
> > EC2 run, terminate immediately ... ok
> > EC2 create KeyPair ... ok
> > EC2 delete KeyPair ... SKIP: Skipped until the Bug #1072318 is
> > resolved
> > EC2 duplicate KeyPair ... SKIP: Skipped until the Bug #1072762 is
> > resolved
> > EC2 get KeyPair ... ok
> > EC2 Create, get, delete Volume ... SKIP: Skipped until the Bug
> > #1074901 is resolved
> > S3 Create, get and delete bucket ... SKIP: Skipped until the Bug
> > #1076965 is resolved
> > Register and deregister aki image ... SKIP: Skipped until the Bug
> > #1074904 is resolved
> > Register and deregister ami image ... ok
> > Register and deregister ari image ... SKIP: Skipped until the Bug
> > #1074908 and #1074904 is resolved
> > S3 Create, get and delete object ... SKIP: Skipped until the Bug
> > #1076534 is resolved
> > 
> > 
> > Best Regards,
> > Attila
> > 
> > ----- Original Message -----
> > From: "Attila Fazekas" <afazekas at redhat.com>
> > To: "Jay Pipes" <jaypipes at gmail.com>
> > Cc: "Yaniv Kaul" <ykaul at redhat.com>, "daryl walleck"
> > <daryl.walleck at rackspace.com>, "Jaroslav Henner"
> > <jhenner at redhat.com>, openstack-qa at lists.openstack.org
> > Sent: Wednesday, November 7, 2012 7:06:47 PM
> > Subject: Re: [openstack-qa] Tempest Boto S3/EC2 tests
> > 
> > OK. Some projects push back patches when they are too large.
> > I will submit the full patch to the refers Gerrint link.
> > 
> > ----- Original Message -----
> > From: "Jay Pipes" <jaypipes at gmail.com>
> > To: "Attila Fazekas" <afazekas at redhat.com>
> > Cc: "Jaroslav Henner" <jhenner at redhat.com>, "Yaniv Kaul"
> > <ykaul at redhat.com>, "daryl walleck" <daryl.walleck at rackspace.com>,
> > openstack-qa at lists.openstack.org
> > Sent: Wednesday, November 7, 2012 6:19:37 PM
> > Subject: Re: Tempest Boto S3/EC2 tests
> > 
> > You won't be sending anything... you just need to git review and
> > your
> > changes should be pushed to Gerrit.
> > 
> > Best,
> > -jay
> > 
> > On 11/07/2012 12:08 PM, Attila Fazekas wrote:
> >> Hi Jay,
> >>
> >> My patch is more than 1000 line changes, now.
> >> Can I send it in one commit ?
> >>
> >> Regards,
> >> Attila
> >>
> >> ----- Original Message -----
> >> From: "Jay Pipes" <jaypipes at gmail.com>
> >> To: "Attila Fazekas" <afazekas at redhat.com>
> >> Cc: "Jaroslav Henner" <jhenner at redhat.com>, "Yaniv Kaul"
> >> <ykaul at redhat.com>, "daryl walleck"
> >> <daryl.walleck at rackspace.com>, openstack-qa at lists.openstack.org
> >> Sent: Wednesday, November 7, 2012 4:18:21 PM
> >> Subject: Re: Tempest Boto S3/EC2 tests
> >>
> >> On 11/07/2012 07:50 AM, Attila Fazekas wrote:
> >>> Hi Jay,
> >>>
> >>> Is is ok if just send the full patch once?
> >>> Am I need to split it first ?
> >>
> >> I'm sorry Attila, I don't understand your question... are you
> >> asking
> >> about how to push updates to your code to Gerrit?
> >>
> >> -jay
> >>
> >>> ----- Original Message -----
> >>> From: "Jay Pipes" <jaypipes at gmail.com>
> >>> To: "Attila Fazekas" <afazekas at redhat.com>
> >>> Cc: "Jaroslav Henner" <jhenner at redhat.com>, "Yaniv Kaul"
> >>> <ykaul at redhat.com>, "daryl walleck"
> >>> <daryl.walleck at rackspace.com>, openstack-qa at lists.openstack.org
> >>> Sent: Tuesday, November 6, 2012 3:48:07 PM
> >>> Subject: Re: Tempest Boto S3/EC2 tests
> >>>
> >>> Hi again Attila,
> >>>
> >>> So, I'm still having major issues running Tempest due to
> >>> https://bugs.launchpad.net/tempest/+bug/1072841 which is being
> >>> held up
> >>> because of https://bugs.launchpad.net/glance/+bug/1074132. That
> >>> latter
> >>> bug is actually preventing me from even getting devstack to
> >>> complete :(
> >>>
> >>> I will work with Brian Waldon to try and get this resolved today.
> >>> Thanks
> >>> for your patience.
> >>>
> >>> Could you please mark your review
> >>> (https://review.openstack.org/#/c/14689/) back to Open status --
> >>> just
> >>> click the Unabandon button.
> >>>
> >>> Thanks!
> >>> -jay
> >>>
> >>> On 11/05/2012 01:36 AM, Attila Fazekas wrote:
> >>>> Jay,
> >>>>
> >>>> I have made many modification on the previous version.
> >>>> I would really appreciate a little feedback and review.
> >>>>
> >>>> You can see the current version of this patch here:
> >>>> https://github.com/afazekas/tempest/commit/95b09c992bff9143e7808e95b2aac192ce202557
> >>>>
> >>>> I really need to know at least the base is acceptable, before
> >>>> creating more test cases.
> >>>>
> >>>> Regards,
> >>>> Attila
> >>>>
> > 
> > _______________________________________________
> > openstack-qa mailing list
> > openstack-qa at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-qa
> > 
> 
> _______________________________________________
> openstack-qa mailing list
> openstack-qa at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-qa
> 



More information about the openstack-qa mailing list