<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; ">
<div>Hi Tim,</div>
<div><br>
</div>
<div>I'd also like to know what happens above 1000 hypervisors that u think needs cells?</div>
<div><br>
</div>
<div>From experience at y! we actually start to see the nova-scheduler (and the filter scheduler mainly) be the problem (at around ~400 hypervisors) and that seems addressable without cells (yes it requires some smart/fast coding that the current scheduler
is not designed for, but that seems manageable and achievable) via reviews like <a href="https://review.openstack.org/#/c/46588">
https://review.openstack.org/#/c/46588</a>, <a href="https://review.openstack.org/#/c/45867">
https://review.openstack.org/#/c/45867</a> (and others that are popping up). The filter scheduler appears to scale linearly with the number of hypervisors, and this is problematic since the filter-scheduler is also single-CPU bound (due to eventlet) so that
overall, makes for some nice suckage. We haven't seen the RPC layer be a problem at our current scale, but maybe u guys have hit this. The other issue that starts to happen around ~400 is the nova service group code, which is not exactly performant when using
the DB backend (we haven't tried the ZK backend yet, WIP!) due to frequent and repeated DB calls. </div>
<div><br>
</div>
<div>It'd be interesting to hear the kind of limitations u guys hit that cells resolved, instead of just fixing the underlying code itself to scale better.</div>
<div><br>
</div>
<div>-Josh</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Subbu Allamaraju <<a href="mailto:subbu@subbu.org">subbu@subbu.org</a>><br>
<span style="font-weight:bold">Date: </span>Thursday, October 3, 2013 10:23 AM<br>
<span style="font-weight:bold">To: </span>Tim Bell <<a href="mailto:Tim.Bell@cern.ch">Tim.Bell@cern.ch</a>><br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>" <<a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [Openstack] Cells use cases<br>
</div>
<div><br>
</div>
<div>
<div dir="auto">
<div>Hi Tim,</div>
<div><br>
</div>
<div>Can you comment on scalability more? Are you referring to just the RPC layer in the control plane?<br>
<br>
<div>Subbu</div>
<div><br>
</div>
</div>
<div><br>
On Oct 3, 2013, at 8:53 AM, Tim Bell <<a href="mailto:Tim.Bell@cern.ch">Tim.Bell@cern.ch</a>> wrote:<br>
<br>
</div>
<blockquote type="cite">
<div>
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; "><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; ">At CERN, we’re running cells for scalability. When you go over 1000 hypervisors or so, the general recommendation is to be in a cells configuration.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; "><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; ">Cells are quite complex and the full functionality is not there yet so some parts will need to wait for Havana.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; "><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; ">Tim<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; color: rgb(31, 73, 125); font-family: Calibri, sans-serif; "><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif; ">From:</span></b><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif; "> Dmitry Ukov [<a href="mailto:dukov@mirantis.com">mailto:dukov@mirantis.com</a>]
<br>
<b>Sent:</b> 03 October 2013 16:38<br>
<b>To:</b> <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
<b>Subject:</b> [Openstack] Cells use cases<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; ">Hello all,</span><o:p></o:p></p>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; ">I've really interested in cells but unfortunately i can't find any useful use cases of them.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; ">For instance I have 4 DCs and I need single entry point for them. In this case cells are a bit complicated solution. It's better to use multiple regions in keystone instead<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; "><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; ">The only one good reason for cells, which I've found, is to organize so-called failure domains, i.e. scheduling on another DCs in case of failures.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; "><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; ">Does anyone have different use cases or vision on cells usage?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size: 10pt; font-family: Arial, sans-serif; ">Thanks in advance.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <br>
Kind regards<o:p></o:p></p>
<div>
<p class="MsoNormal">Dmitry Ukov<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">IT Engineer<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Mirantis, Inc.<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<blockquote type="cite">
<div><span>_______________________________________________</span><br>
<span>Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br>
<span>Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a></span><br>
<span>Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br>
</div>
</blockquote>
</div>
</div>
</span>
</body>
</html>