<div dir="ltr">Hi Renat,<div><br></div><div>In short, it is the expression: <span style="font-size:12.8px">output: <% $.data %></span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">I would like to post the workflow too since it would make more sense to understand the whole picture(IMHO :)). In this case, it would be that the data is too big, AFAIK is around 2MB. Therefore i would just wanna know more information about the performance of YAQL (if we have), i myself do not judge YAQL in this case.</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">Br,</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">Tuan</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 24, 2017 at 6:09 AM, Renat Akhmerov <span dir="ltr"><<a href="mailto:renat.akhmerov@gmail.com" target="_blank">renat.akhmerov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">While I’m in the loop regarding how this workflow works others may not be. Could please just post your expression and data that you use to evaluate this expression? And times. Workflow itself has nothing to do with what we’re discussing.<div><span class="HOEnZb"><font color="#888888"><br><div>
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div>Renat Akhmerov</div><div>@Nokia</div></div>
</div></font></span><div><div class="h5">
<br><div><blockquote type="cite"><div>On 23 Jan 2017, at 21:44, lương hữu tuấn <<a href="mailto:tuantuluong@gmail.com" target="_blank">tuantuluong@gmail.com</a>> wrote:</div><br class="m_7030749768473624736Apple-interchange-newline"><div><div dir="ltr">Hi guys,<div><br></div><div>I am provide some information about the result of testing YAQL performance on my devstack stable/newton with RAM of 6GB. The workflow i created is below:</div><div><br></div><div>##############################<wbr>###############</div><div><div>input:</div><div> - size</div><div> - number_of_handovers</div><div><br></div><div> tasks:</div><div> generate_input:</div><div> action: std.javascript</div><div> input:</div><div> context:</div><div> size: <% $.size %></div><div> script: |</div><div> result = {}</div><div> for(i=0; i < $.size; i++) {</div><div> result["key_" + i] = {</div><div> "alma": "korte"</div><div> }</div><div> }</div><div> return result</div><div> publish:</div><div> data: <% task(generate_input).result %></div><div> on-success:</div><div> - process</div><div><br></div><div> process:</div><div> action: std.echo</div><div> input:</div><div> output: <% $.data %></div><div> publish:</div><div> data: <% task(process).result %></div><div> number_of_handovers: <% $.number_of_handovers - 1 %></div><div> on-success:</div><div> - process: <% $.number_of_handovers > 0 %></div></div><div><br></div><div>##############################<wbr>####################</div><div><br></div><div>I test with the size is 10000 and the number_of_handover is 50. The result shows out that time for validating the <% $.data %> is quite long. I do not know this time is acceptable but imagine that in our use case, the value of $.data could be a large size. Couple of log file is below:</div><div><br></div><div><div>INFO mistral.expressions.yaql_<wbr>expression.InlineYAQLEvaluator [-] Function evaluate finished in 11262.710 ms</div></div><div><br></div><div><div>INFO mistral.expressions.yaql_<wbr>expression.InlineYAQLEvaluator [-] Function evaluate finished in 8146.324 ms</div></div><div><br></div><div>......</div><div><br></div><div>The average value is around 10s each time of valuating.</div><div><br></div><div>Br,</div><div><br></div><div>Tuan</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jan 23, 2017 at 11:48 AM, lương hữu tuấn <span dir="ltr"><<a href="mailto:tuantuluong@gmail.com" target="_blank">tuantuluong@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Renat,<div><br></div><div>For more details, i will go to check on the CBAM machine and hope it is not deleted yet since we have done it for around a week.</div><div>Another thing is Jinja2 showed us that it run 2-3 times faster with the same test with YAQL. More information i will also provide it later.</div><div><br></div><div>Br,</div><div><br></div><div>Tuan</div></div><div class="m_7030749768473624736HOEnZb"><div class="m_7030749768473624736h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jan 23, 2017 at 8:32 AM, Renat Akhmerov <span dir="ltr"><<a href="mailto:renat.akhmerov@gmail.com" target="_blank">renat.akhmerov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div style="word-wrap:break-word">Tuan,<div><br></div><div>I don’t think that Jinja is something that Kirill is responsible for. It’s just a coincidence that we in Mistral support both YAQL and Jinja. The latter has been requested by many people so we finally did it.</div><div><br></div><div>As far as performance, could you please provide some numbers? When you say “takes a lot of time” how much time is it? For what kind of input? Why do you think it is slow? What are your expectations?Provide as much info as possible. After that we can ask YAQL authors to comment and help if we realize that the problem really exists.</div><div><br></div><div>I’m interested in this too since I’m always looking for ways to speed Mistral up.</div><div><br></div><div>Thanks</div><div><span class="m_7030749768473624736m_-1874260049415543479HOEnZb"><font color="#888888"><br><div>
<div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div>Renat Akhmerov</div><div>@Nokia</div></div>
</div></font></span><div><div class="m_7030749768473624736m_-1874260049415543479h5">
<br><div><blockquote type="cite"><div>On 18 Jan 2017, at 16:25, lương hữu tuấn <<a href="mailto:tuantuluong@gmail.com" target="_blank">tuantuluong@gmail.com</a>> wrote:</div><br class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332Apple-interchange-newline"><div><div dir="ltr">Hi Kirill,<div><br></div><div>Do you have any information related to the performance of Jinja and Yaql validating. With the big size of input, yaql runs quite so slow in our case therefore we have plan to switch to jinja.</div><div><br></div><div>Br,</div><div><br></div><div>@Nokia/Tuan</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 17, 2017 at 3:02 PM, lương hữu tuấn <span dir="ltr"><<a href="mailto:tuantuluong@gmail.com" target="_blank">tuantuluong@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Kirill,<div><br></div><div>Thank you for you information. I hope we will have more information about it. Just keep in touch when you guys in Mirantis have some performance results about Yaql.</div><div><br></div><div>Br,</div><div><br></div><div>@Nokia/Tuan </div></div><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332HOEnZb"><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332h5"><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 17, 2017 at 2:32 PM, Kirill Zaitsev <span dir="ltr"><<a href="mailto:kzaitsev@mirantis.com" target="_blank">kzaitsev@mirantis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div id="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;margin:0px">I think fuel team encountered similar problems, I’d advice asking them around. Also Stan (author of yaql) might shed some light on the problem =)</div> <br> <div id="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322bloop_sign_1484659788248437760" class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322bloop_sign"><div style="font-family:helvetica,arial;font-size:13px">-- <br>Kirill Zaitsev</div><div style="font-family:helvetica,arial;font-size:13px">Murano Project Tech Lead</div><div style="font-family:helvetica,arial;font-size:13px">Software Engineer at</div><div style="font-family:helvetica,arial;font-size:13px">Mirantis, Inc</div></div><div><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773h5"> <br><p class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322airmail_on">On 17 January 2017 at 15:11:52, lương hữu tuấn (<a href="mailto:tuantuluong@gmail.com" target="_blank">tuantuluong@gmail.com</a>) wrote:</p> </div></div><blockquote type="cite" class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773m_2477249739733783322clean_bq"><span><div><div></div><div><div><div class="m_7030749768473624736m_-1874260049415543479m_4289207008475568332m_-8356562676652641773h5">
<div dir="ltr"><p>Hi,</p><p>We are now using yaql in mistral and what we see that the
process of validating yaql expression of input takes a lot of time,
especially with the big size input. Do you guys have any
information about performance of yaql? </p><p>Br,</p><p>@Nokia/Tuan<br></p>
</div></div></div>
______________________________<wbr>______________________________<wbr>______________
<br>OpenStack Development Mailing List (not for usage questions)
<br>Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org/?subject:unsubscribe" target="_blank">OpenStack-dev-request@lists.op<wbr>enstack.org?subject:unsubscrib<wbr>e</a>
<br><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k-dev</a>
<br></div></div></span></blockquote></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
______________________________<wbr>______________________________<wbr>______________<br>OpenStack Development Mailing List (not for usage questions)<br>Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org" target="_blank">OpenStack-dev-request@lists.op<wbr>enstack.org</a>?subject:unsubscrib<wbr>e<br><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k-dev</a><br></div></blockquote></div><br></div></div></div></div></div><br>______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org/?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.op<wbr>enstack.org?subject:unsubscrib<wbr>e</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k-dev</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
______________________________<wbr>______________________________<wbr>______________<br>OpenStack Development Mailing List (not for usage questions)<br>Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org" target="_blank">OpenStack-dev-request@lists.<wbr>openstack.org</a>?subject:<wbr>unsubscribe<br><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack-dev</a><br></div></blockquote></div><br></div></div></div></div><br>______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.<wbr>openstack.org?subject:<wbr>unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack-dev</a><br>
<br></blockquote></div><br></div>