<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>This is a Trove question but including Heat as they seem to have solved this problem.</div>
<div><br>
</div>
<div>Summary: Today, it seems that Trove is not capable of creating a cluster spanning multiple regions. Is that the case and, if so, are there any plans to work on that? Also, are we aware of any precedent solutions (e.g. remote stacks in Heat) or even partially
completed spec/code in Trove?</div>
<div><br>
</div>
<div>More details:</div>
<div><br>
</div>
<div>I found this <a href="https://wiki.openstack.org/wiki/Heat/Blueprints/Multi_Region_Support_for_Heat/The_Missing_Diagram">
nice diagram</a> created for Heat. As far as I understand it, #1 is the absence of multi-region support (i.e. what we have today). #2 seems to be a 100% client-based solution. In other words, the Heat services never know about the other stacks. In fact, there
is nothing tying these stacks together at all. #3 seems to show a "master" Heat server that understands "remote stacks" and simply converts those "remote stacks" into calls on regional Heats. I assume here the master stack record is stored by the master Heat.
Because the "remote stacks" are full-fledged stacks, they can be managed by their regional Heats if availability of master or other regional Heats is lost. #4, the diagram doesn't seem to match the description (instead of one global Heat, it seems the diagram
should show two regional Heats). In this one, a single arbitrary region becomes the owner of the stack and remote (low-level not stack) resources are created as needed. One problem is the manageability is lost if the Heat in the owning region is lost. Finally,
#5. In #5, it's just #4 but with one and only one Heat.</div>
<div><br>
</div>
<div>It seems like Heat <a href="https://review.openstack.org/#/c/53313/">solved this</a> using #3 (Master Orchestrator) but where there isn't necessarily a separate master Heat. Remote stacks can be created by any regional stack.</div>
<div><br>
</div>
<div>Trove questions:</div>
<ol>
<li>Having sub-clusters (aka remote clusters aka nested clusters) seems to be useful (i.e. manageability isn't lost when a region is lost). But then again, does it make sense to perform a cluster operation on a sub-cluster?</li><li>You could forego sub-clusters and just create full-fledged remote standalone Trove instances.</li><li>If you don't create full-fledged remote Trove instances (but instead just call remote Nova), then you cannot do simple things like getting logs from a node without going through the owning region's Trove. This is an extra hop and a single point of failure.</li><li>Even with sub-clusters, the only record of them being related lives only in the "owning" region. Then again, some ID tying them all together could be passed to the remote regions.</li><li>Do we want to allow the piecing together of clusters (sort of like Heat's "adopt")?</li></ol>
<div>These are some questions floating around my head and I'm sure there are plenty more. Any thoughts on any of this?</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Mat</div>
</body>
</html>