Open Stack

Hello, 

Please check out /tmp/spark-edp/<id_of_job>/ directory on the master node of your cluster for additional details about job's failure.

Also, it would be helpful if you will share with us additional details about your cluster setup. I mean, plugin, version, version of OpenStack installed on your lab.

Best regards,
Vitaly Gridnev


> On Nov 23, 2016, at 2:31 PM, Reza Bakhshayeshi <reza.b2008 at gmail.com> wrote:
> 
> Hi all,
> 
> I'm going to execute Spark job with help of Sahara and Swift from here on OpenStack mitaka:
> 
> https://github.com/openstack/sahara-tests/tree/master/sahara_tests/scenario/defaults/edp-examples/edp-spark <https://github.com/openstack/sahara-tests/tree/master/sahara_tests/scenario/defaults/edp-examples/edp-spark>
> Without any error in sahara logs, job goes to Done with Error when I'm trying to use Swift. I've set swift username and password, and ...spark.adapt... in configuration and input and output file in arguments part. And I've created input file in swift. Worth to mention, there are some  authentication disabled lines in Spark log file in VM.
> 
> But, when I use HDFS instead of swift everything is OK and job is done successfully.
> 
> What am I missing?
> 
> Regards
> Reza
> 
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20161123/dcf90e34/attachment.html>