<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Ok, thanks. That looks more clear now.<div class=""><br class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class="">Renat Akhmerov</div><div class="">@Nokia</div></div>
</div>
<br class=""><div style=""><blockquote type="cite" class=""><div class="">On 24 Jan 2017, at 14:15, lương hữu tuấn <<a href="mailto:tuantuluong@gmail.com" class="">tuantuluong@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi Renat,<div class=""><br class=""></div><div class="">In short, it is the expression: <span style="font-size:12.8px" class="">output: <% $.data %></span></div><div class=""><span style="font-size:12.8px" class=""><br class=""></span></div><div class=""><span style="font-size:12.8px" class="">I would like to post the workflow too since it would make more sense to understand the whole picture(IMHO :)). In this case, it would be that the data is too big, AFAIK is around 2MB. Therefore i would just wanna know more information about the performance of YAQL (if we have), i myself do not judge YAQL in this case.</span></div><div class=""><span style="font-size:12.8px" class=""><br class=""></span></div><div class=""><span style="font-size:12.8px" class="">Br,</span></div><div class=""><span style="font-size:12.8px" class=""><br class=""></span></div><div class=""><span style="font-size:12.8px" class="">Tuan</span></div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Tue, Jan 24, 2017 at 6:09 AM, Renat Akhmerov <span dir="ltr" class=""><<a href="mailto:renat.akhmerov@gmail.com" target="_blank" class="">renat.akhmerov@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class="">While I’m in the loop regarding how this workflow works others may not be. Could please just post your expression and data that you use to evaluate this expression? And times. Workflow itself has nothing to do with what we’re discussing.<div class=""><span class="HOEnZb"><font color="#888888" class=""><br class=""><div class="">
<div style="letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; word-wrap: break-word;" class=""><div class="">Renat Akhmerov</div><div class="">@Nokia</div></div>
</div></font></span><div class=""><div class="h5">
<br class=""><div class=""><blockquote type="cite" class=""><div class="">On 23 Jan 2017, at 21:44, lương hữu tuấn <<a href="mailto:tuantuluong@gmail.com" target="_blank" class="">tuantuluong@gmail.com</a>> wrote:</div><br class="m_7030749768473624736Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi guys,<div class=""><br class=""></div><div class="">I am provide some information about the result of testing YAQL performance on my devstack stable/newton with RAM of 6GB. The workflow i created is below:</div><div class=""><br class=""></div><div class="">##############################<wbr class="">###############</div><div class=""><div class="">input:</div><div class=""> - size</div><div class=""> - number_of_handovers</div><div class=""><br class=""></div><div class=""> tasks:</div><div class=""> generate_input:</div><div class=""> action: std.javascript</div><div class=""> input:</div><div class=""> context:</div><div class=""> size: <% $.size %></div><div class=""> script: |</div><div class=""> result = {}</div><div class=""> for(i=0; i < $.size; i++) {</div><div class=""> result["key_" + i] = {</div><div class=""> "alma": "korte"</div><div class=""> }</div><div class=""> }</div><div class=""> return result</div><div class=""> publish:</div><div class=""> data: <% task(generate_input).result %></div><div class=""> on-success:</div><div class=""> - process</div><div class=""><br class=""></div><div class=""> process:</div><div class=""> action: std.echo</div><div class=""> input:</div><div class=""> output: <% $.data %></div><div class=""> publish:</div><div class=""> data: <% task(process).result %></div><div class=""> number_of_handovers: <% $.number_of_handovers - 1 %></div><div class=""> on-success:</div><div class=""> - process: <% $.number_of_handovers > 0 %></div></div><div class=""><br class=""></div><div class="">##############################<wbr class="">####################</div><div class=""><br class=""></div><div class="">I test with the size is 10000 and the number_of_handover is 50. The result shows out that time for validating the <% $.data %> is quite long. I do not know this time is acceptable but imagine that in our use case, the value of $.data could be a large size. Couple of log file is below:</div><div class=""><br class=""></div><div class=""><div class="">INFO mistral.expressions.yaql_<wbr class="">expression.InlineYAQLEvaluator [-] Function evaluate finished in 11262.710 ms</div></div><div class=""><br class=""></div><div class=""><div class="">INFO mistral.expressions.yaql_<wbr class="">expression.InlineYAQLEvaluator [-] Function evaluate finished in 8146.324 ms</div></div><div class=""><br class=""></div><div class="">......</div><div class=""><br class=""></div><div class="">The average value is around 10s each time of valuating.</div><div class=""><br class=""></div><div class="">Br,</div><div class=""><br class=""></div><div class="">Tuan</div><div class=""><br class=""></div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Mon, Jan 23, 2017 at 11:48 AM, lương hữu tuấn <span dir="ltr" class=""><<a href="mailto:tuantuluong@gmail.com" target="_blank" class="">tuantuluong@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="">Hi Renat,<div class=""><br class=""></div><div class="">For more details, i will go to check on the CBAM machine and hope it is not deleted yet since we have done it for around a week.</div><div class="">Another thing is Jinja2 showed us that it run 2-3 times faster with the same test with YAQL. More information i will also provide it later.</div><div class=""><br class=""></div><div class="">Br,</div><div class=""><br class=""></div><div class="">Tuan</div></div><div class="m_7030749768473624736HOEnZb"><div class="m_7030749768473624736h5"><div class="gmail_extra"><br class=""><div class="gmail_quote">On Mon, Jan 23, 2017 at 8:32 AM, Renat Akhmerov <span dir="ltr" class=""><<a href="mailto:renat.akhmerov@gmail.com" target="_blank" class="">renat.akhmerov@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class=""><div style="word-wrap:break-word" class="">Tuan,<div class=""><br class=""></div><div class="">I don’t think that Jinja is something that Kirill is responsible for. It’s just a coincidence that we in Mistral support both YAQL and Jinja. The latter has been requested by many people so we finally did it.</div><div class=""><br class=""></div><div class="">As far as performance, could you please provide some numbers? When you say “takes a lot of time” how much time is it? For what kind of input? Why do you think it is slow? What are your expectations?Provide as much info as possible. After that we can ask YAQL authors to comment and help if we realize that the problem really exists.</div><div class=""><br class=""></div><div class="">I’m interested in this too since I’m always looking for ways to speed Mistral up.</div><div class=""><br class=""></div><div class="">Thanks</div><div class=""><span class="m_7030749768473624736m_-1874260049415543479HOEnZb"><font color="#888888" class=""><br class=""><div class="">
<div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word" class=""><div class="">Renat Akhmerov</div><div class="">@Nokia</div></div>
</div></font></span><div class=""><div class="m_7030749768473624736m_-1874260049415543479h5">
<br class=""><div class=""><blockquote type="cite" class=""><div class="">On 18 Jan 2017, at 16:25, lương hữu tuấn <<a href="mailto:tuantuluong@gmail.com" target="_blank" class="">tuantuluong@gmail.com</a>> wrote:</div><br class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi Kirill,<div class=""><br class=""></div><div class="">Do you have any information related to the performance of Jinja and Yaql validating. With the big size of input, yaql runs quite so slow in our case therefore we have plan to switch to jinja.</div><div class=""><br class=""></div><div class="">Br,</div><div class=""><br class=""></div><div class="">@Nokia/Tuan</div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Tue, Jan 17, 2017 at 3:02 PM, lương hữu tuấn <span dir="ltr" class=""><<a href="mailto:tuantuluong@gmail.com" target="_blank" class="">tuantuluong@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="">Hi Kirill,<div class=""><br class=""></div><div class="">Thank you for you information. I hope we will have more information about it. Just keep in touch when you guys in Mirantis have some performance results about Yaql.</div><div class=""><br class=""></div><div class="">Br,</div><div class=""><br class=""></div><div class="">@Nokia/Tuan </div></div><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332HOEnZb"><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332h5"><div class="gmail_extra"><br class=""><div class="gmail_quote">On Tue, Jan 17, 2017 at 2:32 PM, Kirill Zaitsev <span dir="ltr" class=""><<a href="mailto:kzaitsev@mirantis.com" target="_blank" class="">kzaitsev@mirantis.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class=""><div id="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;margin:0px" class="">I think fuel team encountered similar problems, I’d advice asking them around. Also Stan (author of yaql) might shed some light on the problem =)</div> <br class=""> <div id="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322bloop_sign_1484659788248437760" class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322bloop_sign"><div style="font-family:helvetica,arial;font-size:13px" class="">-- <br class="">Kirill Zaitsev</div><div style="font-family:helvetica,arial;font-size:13px" class="">Murano Project Tech Lead</div><div style="font-family:helvetica,arial;font-size:13px" class="">Software Engineer at</div><div style="font-family:helvetica,arial;font-size:13px" class="">Mirantis, Inc</div></div><div class=""><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773h5"> <br class=""><p class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322airmail_on">On 17 January 2017 at 15:11:52, lương hữu tuấn (<a href="mailto:tuantuluong@gmail.com" target="_blank" class="">tuantuluong@gmail.com</a>) wrote:</p> </div></div><blockquote type="cite" class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322clean_bq"><span class=""><div class=""><div class=""></div><div class=""><div class=""><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773h5">
<div dir="ltr" class=""><p class="">Hi,</p><p class="">We are now using yaql in mistral and what we see that the
process of validating yaql expression of input takes a lot of time,
especially with the big size input. Do you guys have any
information about performance of yaql? </p><p class="">Br,</p><p class="">@Nokia/Tuan<br class=""></p>
</div></div></div>
______________________________<wbr class="">______________________________<wbr class="">______________
<br class="">OpenStack Development Mailing List (not for usage questions)
<br class="">Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org/?subject:unsubscribe" target="_blank" class="">OpenStack-dev-request@lists.op<wbr class="">enstack.org?subject:unsubscrib<wbr class="">e</a>
<br class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank" class="">http://lists.openstack.org/cgi<wbr class="">-bin/mailman/listinfo/openstac<wbr class="">k-dev</a>
<br class=""></div></div></span></blockquote></div>
</blockquote></div><br class=""></div>
</div></div></blockquote></div><br class=""></div>
______________________________<wbr class="">______________________________<wbr class="">______________<br class="">OpenStack Development Mailing List (not for usage questions)<br class="">Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org" target="_blank" class="">OpenStack-dev-request@lists.op<wbr class="">enstack.org</a>?subject:unsubscrib<wbr class="">e<br class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank" class="">http://lists.openstack.org/cgi<wbr class="">-bin/mailman/listinfo/openstac<wbr class="">k-dev</a><br class=""></div></blockquote></div><br class=""></div></div></div></div></div><br class="">______________________________<wbr class="">______________________________<wbr class="">______________<br class="">
OpenStack Development Mailing List (not for usage questions)<br class="">
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org/?subject:unsubscribe" rel="noreferrer" target="_blank" class="">OpenStack-dev-request@lists.op<wbr class="">enstack.org?subject:unsubscrib<wbr class="">e</a><br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank" class="">http://lists.openstack.org/cgi<wbr class="">-bin/mailman/listinfo/openstac<wbr class="">k-dev</a><br class="">
<br class=""></blockquote></div><br class=""></div>
</div></div></blockquote></div><br class=""></div>
______________________________<wbr class="">______________________________<wbr class="">______________<br class="">OpenStack Development Mailing List (not for usage questions)<br class="">Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org" target="_blank" class="">OpenStack-dev-request@lists.<wbr class="">openstack.org</a>?subject:<wbr class="">unsubscribe<br class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank" class="">http://lists.openstack.org/<wbr class="">cgi-bin/mailman/listinfo/<wbr class="">openstack-dev</a><br class=""></div></blockquote></div><br class=""></div></div></div></div><br class="">______________________________<wbr class="">______________________________<wbr class="">______________<br class="">
OpenStack Development Mailing List (not for usage questions)<br class="">
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org/?subject:unsubscribe" rel="noreferrer" target="_blank" class="">OpenStack-dev-request@lists.<wbr class="">openstack.org?subject:<wbr class="">unsubscribe</a><br class="">
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank" class="">http://lists.openstack.org/<wbr class="">cgi-bin/mailman/listinfo/<wbr class="">openstack-dev</a><br class="">
<br class=""></blockquote></div><br class=""></div>
__________________________________________________________________________<br class="">OpenStack Development Mailing List (not for usage questions)<br class="">Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org" class="">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<br class=""><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" class="">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br class=""></div></blockquote></div><br class=""></div></body></html>