[openstack-qa] Documentation of tempest

Kashyap Chamarthy kchamart at redhat.com
Fri May 17 12:26:56 UTC 2013


On 05/17/2013 04:31 PM, Attila Fazekas wrote:
> I like the ACC model, but it looks like too high level overview for starting,
>  but it can be a good continuation.
> 
> A simple model for mainly API testing can be good for now.
> 
> Initial considerations:
> * We have services or components and and sub-part of this at API level. 
>   (3D matrix mapped to 2D)
> * We have operations to test
> * We have things to verify
> * I would like to know is something missing or not covered properly
> 
> I have constructed a matrix, than I simplified it.
> 
> Something like below as a colored HTML table seams OK.
> 
> ------------------------------------------------------------------------
> | component    | CRUD | list | associations | quota | security |  misc |
> ------------------------------------------------------------------------
> | nova-server  |      |      |              |       |          |       |
> ------------------------------------------------------------------------
> | swift-object |      |      |              |       |          |       |
> ------------------------------------------------------------------------
> | keystone-user|      |      |              |       |          |       |
> ------------------------------------------------------------------------
> | misc         |      |      |              |       |          |       |
> ------------------------------------------------------------------------
> 
> CRUD: create, read, update, get
> list: list, list detailed, filtering, pagination
> misc: action , bulk-action
> security: tenant-isolates, admin-denied
> association: member, attach, assign
> 
> 
> * In every intersection we should have multiple links to the source 
>   (github, automatically generated link).
> * One test case can be in multiple intersection
> * every line and row should have a short description
> * every intersection should have a short description
> * based on the description anyone can color the intersections
>   1. Black: Does not makes sense in this context
>   2. Red: completely missing
>   3. yellow: partially completed
>   4. light green: good progress
>   5. green: OK
>   6. white: unknown
> 
> We could have tables for different API versions or CLI ..  
> 
> In theory if we add enough meta-data (attribute) on test cases to be map able
>  into this kind of table. The only paper work will be:
> 
> * create short description about what we need to verify 
>  (likely the columns will tell it alone)
> * Color the table
> 
> 
> Possible addition:
> * Links to additional resources like blueprints, bugs..
> 
> 


All great ideas, can you please, please write them on a wiki, just so they're aren't lost
in this maze ?

I'm really in supportive of using plain text for these (in combination with git) as
excellently pointed by Anne in other areas as well. I see others agree as well.

Thanks for your email, Attila.


Thanks.

-- 
/kashyap



More information about the openstack-qa mailing list