答复: [largescale-sig]scaling story

27 Jun 2024


      0	*H÷
 010	+0	*H÷
 $Content-Type: text/plain;
    charset="utf-8"
Content-Transfer-Encoding: 8bit
Hi Mohammed,
    The max number of conns for RabbitMQ is estimated through cacluating the 
conns of nova and cinder components. We have 3000 compute nodes, 3 control 
nodes and 15 cinder-volume nodes, We deploy rabbitmq on control nodes and use 
master-slave mode, the totally conns of RabbitMQ is almost 2w, so we set 2w 
for RabbitMQ configuration.
    Before deploying the SB relay, each ovn SB process needed to manage an 
average of 600+connections, the CPU usage is often 100% and the requests is 
slow processing. After adding the relay, each relay process handles about 60 
connections, the total relay process is set to 10. After testing, each relay 
process has a low CPU usage and can process information quickly.
-----é®ä»¶åä»¶-----
åä»¶äºº: Thierry Carrez [mailto:thierry@openinfra.dev]
åéæ¶éŽ: 2024å¹Ž6æ19æ¥ 17:29
æ¶ä»¶äºº: Alex Song (å®æå¹³) songwenping@inspur.com
äž»é¢: Re: [largescale-sig]scaling story
Hi Alex,
Thanks for the great write up!  I would love to see more of this.
How did you adjust the max number of conns for RabbitMQ and for the relay I
assume you used https://docs.ovn.org/en/latest/tutorials/ovn-ovsdb-relay.html
https://docs.ovn.org/en/latest/tutorials/ovn-ovsdb-relay.html ?
Thanks
Mohammed
*From: *Alex Song (å®æå¹³) songwenping@inspur.com
*Date: *Wednesday, June 12, 2024 at 4:43â¯AM
*To: *openstack-discuss@lists.openstack.org
openstack-discuss@lists.openstack.org
*Subject: *[largescale-sig]scaling story
Hi everyone,
we want to share our scaling story.
Please refer the link:
https://etherpad.opendev.org/p/large-scale-inspur
https://etherpad.opendev.org/p/large-scale-inspur
Thanks,
Alex Song
0É0± xðáwIÊèë`{0
	*H÷
0Y10
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10U	INSPUR-CA0
170109092830Z
340511122004Z0Y10
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10U	INSPUR-CA0"0
	*H÷
0
«ä5ïc$Œ©æ'µ¯Þ6>úUKÛdÔ²Áe9Î~{BîÒLgD÷*wvVÊŠ/DýUj_xá\m/
óž=kÐ·éGÙœQ€ýx~Wùgk ÛÜøãÔ7É6NçÏ*?n°Ê²mhùè{Ã¯ôÌÆ	7üF-Î<@ÃÓÍ¬WçÅyåLZrF
 6~føÈ×T~$0d¡ýL|zšøW=ötÚ%ýq,¥Ã~Ÿ"ÀýŸÑö2T,QÕÔ,dºÂÅ^§ÈôïåJ)ëVvp
Ó£00	+7CA0U0Uÿ0ÿ0U^YŠŽLX`Nöµ¥9Š2Á5j0	+70#	+7&a°$öz(¶o§K0
	*H÷
daòYÙ~×ì×NÑ3ŽËlP±i!¿ýÅòsÝLºP;I4hžØþ¡L¶äŠJêà·Õ:1àEÕs®9UÛ:8Mh{Ä²ìºŒ£·ÚŒó×÷C_ŸhoÏúÆËYM&UØ³?9êèr·ìgP_÷mÇ#YÖpîw0º¹«0$p³jºnº¥¯/Ôä¬÷Ú
ŠÖ5uþQÝ¶h(y¶ènnã%E,øú&Zâ"dKØ³ãi5VúP9±œ/ñ
õkØŸsá/Xðï»¯€µ³O÷Í-ó¿Mè³3Óž{G(ªŸßŒG0C0+ ~+mçbí++0
	*H÷
0Y10
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10U	INSPUR-CA0
191128064731Z
241126064731Z010
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10Uæµªæœ®ä¿¡æ¯10U	å®æå¹³1%0#	*H÷
	songwenping@inspur.com0"0
	*H÷
0
ã4ÒEd$i÷18#,åH~èyµþJRáLêg¡$@6vÔ<sâelPO4ýooXZç1¢iéÁ IòKjÚO§h;Rfùê7Ÿp¬ŒæäÝPòüÿ~æ
E}é{có»
(ù'+zÞ	s ,!K£;û¥¶DEu1+ðÏ»õØÛähJjŸj']a¥Î·7¡õòhõßHŒ8QzÆ{ËÍ73>,		ªí|gœ0y€Xv'ÚÊ
¬ÀO#)³°øÕM^œ¢VñóŸ¯ìFñ;µ5HŽù£Ã0¿0=	+700.&+7ò©×z©=÷Ø\Jý&§Md\0)U%"0 ++
+7
0U 05	+7
(0&0
+0
+0
+7
0D	*H÷
	7050*H÷
0*H÷
0+0
*H÷
0UW	0²^qûìÇUã¡b[]s0U#0^YŠŽLX`Nöµ¥9Š2Á5j0U00ÿ ü ùºldap:///CN=INSPUR-CA,CN=JTCA2012,CN=CDP,CN=Public%20Key%20Services,CN=Services,CN=Configuration,DC=home,DC=langchao,DC=com?certificateRevocationList?base?objectClass=cRLDistributionPoint:http://JTCA2012.home.langchao.com/CertEnroll/INSPUR-CA.crl0%C2%82%01)%06%08+...
+7 songwenping@inspur.comsongwenping@inspur.com0
	*H÷
§öãý+·>³â¿Xíe-÷¯[ÂÎ©É\ÃAæMà.U'ù||Wø$Šn' `9Ýµ¯éÉM^mz0Äð -AÒ¯×Tï+£§¡RbfzÆX#ùkY<ØDþxólõA%ÑøN¬×grÛÚ·ãF!GþóüVœÍ±Ð[ÏL®GÅ3€$ /DžÃiú_h|cI}DôþyªÉñ Ç}³W$_Äáy]ò±DÄ1(tr)6gêäÑæÄLd$!t{x±Z±·þÏeqmkþÒÒ÷r³ßxõ%lUÉÒ4d100p0Y10
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10U	INSPUR-CA~+mçbí++0	+ ø0	*H÷
	1	*H÷
0	*H÷
	1
240627081404Z0#	*H÷
	1ŠÒ5KCuâ|!:¶!~ÏÚ/Ý0	+71r0p0Y10
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10U	INSPUR-CA~+mçbí++0*H÷
	1r p0Y10
    &ò,dcom10
    &ò,dlangchao10
    &ò,dhome10U	INSPUR-CA~+mçbí++0	*H÷
	100	`He*0	`He0
*H÷
0	`He0*H÷
0
*H÷
@0+0	`He0	`He0	`He0
	*H÷
Jû¡ûäž«$]ŽíijO
yªLMÑ¢ÅúŸC±_U¶[1Jnl~/Aò¢\E
gTŽ ENºÁ
óª
už6ÄµÕ/Ô/j/,ltµ~O¥Æù]Î0È9§DAªªC'8µG*9ÄíËüÛâèÔðHmá3ŽYËù*Ý'Ÿ¯ù§Ý,â9iâÙ2±×Á·ÞÌøtüoÙ wýÂ!7e&ß	ëFÃ®T¢é3.k-îgøvc«nŠ*(G> óóFK°"óx aÙ
Æ&?ûæxNJº~'Øü¯L

答复: [largescale-sig]scaling story

Alex Song (宋文平)