[openstack-dev] [swift] a way of checking replicate completion on swift cluster

Matsuda, Kenichiro matsuda_kenichi at jp.fujitsu.com
Fri Nov 21 05:32:56 UTC 2014


Hi,

Thank you for the info.

I was able to get replication info easily by swift-recon API.
But, I wasn't able to judge whether no failure from recon info of object-replicator.

Could you please advise me for a way of get object-replicator's failure info?

[replication info from recon]
* account
------------------------------------------------------------------------------
# curl http://192.168.1.11:6002/recon/replication/account | python -mjson.tool
{
    "replication_last": 1416354262.7157061,
    "replication_stats": {
        "attempted": 20,
        "diff": 0,
        "diff_capped": 0,
        "empty": 0,
        "failure": 20,
        "hashmatch": 0,
        "no_change": 40,
        "remote_merge": 0,
        "remove": 0,
        "rsync": 0,
        "start": 1416354240.9761429,
        "success": 40,
        "ts_repl": 0
    },
    "replication_time": 21.739563226699829
}
------------------------------------------------------------------------------

* container
------------------------------------------------------------------------------
# curl http://192.168.1.11:6002/recon/replication/container | python -mjson.tool
{
    "replication_last": 1416353436.9448521,
    "replication_stats": {
        "attempted": 13346,
        "diff": 0,
        "diff_capped": 0,
        "empty": 0,
        "failure": 870,
        "hashmatch": 0,
        "no_change": 1908,
        "remote_merge": 0,
        "remove": 0,
        "rsync": 0,
        "start": 1416349377.3627851,
        "success": 1908,
        "ts_repl": 0
    },
    "replication_time": 4059.5820670127869
}
------------------------------------------------------------------------------

* object
------------------------------------------------------------------------------
# curl http://192.168.1.11:6002/recon/replication | python -mjson.tool
{
    "object_replication_last": 1416334368.60865,
    "object_replication_time": 2316.5563162644703 
} 
# curl http://192.168.1.11:6002/recon/replication/object | python -mjson.tool
{
    "object_replication_last": 1416334368.60865,
    "object_replication_time": 2316.5563162644703 
}
------------------------------------------------------------------------------

Best Regards,
Kenichiro Matsuda.


From: Clay Gerrard [mailto:clay.gerrard at gmail.com] 
Sent: Friday, November 21, 2014 4:22 AM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster

You might check if the swift-recon tool has the data you're looking for.  It can report the last completed replication pass time across nodes in the ring.

On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro <matsuda_kenichi at jp.fujitsu.com> wrote:
Hi,

I would like to know about a way of checking replicate completion on swift cluster.
(e.g. after rebalanced Ring)

I found the way of using swift-dispersion-report from Administrator's Guide.
But, this way is not enough, because swift-dispersion-report can't checking
replicate completion for other data that made by not swift-dispersion-populate.

And also, I found the way of using replicator's logs from Q&A.
But, I would like to more easy way, because check of below logs is very heavy.

  (account/container/object)-replicator * All storage node on swift cluster

Could you please advise me for it?

Findings:
  Administrator's Guide  Cluster Health
    http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health
  how to check replicator work complete
    https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/

Best Regards,
Kenichiro Matsuda.


_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



More information about the OpenStack-dev mailing list