[openstack-dev] [Savanna] How to run hadoop jobs

Arindam Choudhury arindam at live.com
Sat Jul 13 23:31:32 UTC 2013


Hi Ruslan,

As the output is quite long, I am providing pastebin link. Hope it does not boter you.

 The outputs of
$ http $SAVANNA_URL/images X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/node-group-templates X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/cluster-templates X-Auth-Token:$AUTH_TOKEN
are here:

 http://pastebin.com/ngu9HNdu

I followed the quick start guide,  the outputs are here:  

http://pastebin.com/TYmnQe2G

The logs are here, its contains log after I submitted the cluster:

http://pastebin.com/LjHxmi4j


Regards,
Arindam


Date: Sat, 13 Jul 2013 22:04:26 +0400
From: rkamaldinov at mirantis.com
To: arindam at live.com
CC: openstack-dev at lists.openstack.org; savanna-all at lists.launchpad.net
Subject: Re: [Savanna-all] How to run hadoop jobs


                
                    Hi Arindam,
                
There was a validation error during cluster creation. Can you send contents of cluster_create.json ?Also, please attach output of:
$ http $SAVANNA_URL/images X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/node-group-templates X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/cluster-templates X-Auth-Token:$AUTH_TOKEN
Savanna debug logs also would be helpful. 

Please use *openstack-dev* as a mail-list for Savanna-related questions. Just prefix the subject with [Savanna].
Thanks,Ruslan
                
                 
                On Saturday, July 13, 2013 at 9:24 PM, Arindam Choudhury wrote:
                
                    


Hi,

I installed savanna from the git repository. I can create cluster but only with admin, when I try to create cluster with non-admin user it gives me an error:

(keystone_arindam)]# http $SAVANNA_URL/clusters X-Auth-Token:$AUTH_TOKEN  < cluster_create.json
HTTP/1.1 500 INTERNAL SERVER ERROR
Content-Length: 111
Content-Type: application/json
Date: Sat, 13 Jul 2013 16:47:25 GMT

{
    "error_code": 500,
    "error_message": "Error occurred during validation",
    "error_name": "INTERNAL_SERVER_ERROR"
}

The hadoop daemons are not started automatically so I could not run the test job.

hadoop at cluster-1-master-001:/usr/share/hadoop$ hadoop jar hadoop-examples.jar pi 10 100
Exception in thread "main" java.io.IOException: Error opening job jar: hadoop-examples.jar
        at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
Caused by: java.io.FileNotFoundException: hadoop-examples.jar (No such file or directory)
        at java.util.zip.ZipFile.open(Native Method)
        at java.util.zip.ZipFile.<init>(ZipFile.java:214)
        at java.util.zip.ZipFile.<init>(ZipFile.java:144)
        at java.util.jar.JarFile.<init>(JarFile.java:153)
        at java.util.jar.JarFile.<init>(JarFile.java:90)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
hadoop at cluster-1-master-001:/usr/share/hadoop$ start-all.sh
mkdir: cannot create directory `/mnt/log': Permission denied
chown: cannot access `/mnt/log/hadoop/hadoop/': No such file or directory
starting namenode, logging to /mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out
/usr/sbin/hadoop-daemon.sh: line 136: /mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out: No such file or directory
head: cannot open `/mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out' for reading: No such file or directory
hadoop at localhost's password:

when I try to start hadoop manually, it asks for a password. How to do it? Am I missing something?

Regards,
Arindam


 		 	   		  
-- Mailing list: https://launchpad.net/~savanna-allPost to     : savanna-all at lists.launchpad.netUnsubscribe : https://launchpad.net/~savanna-allMore help   : https://help.launchpad.net/ListHelp
                 
                 
                 
                 
                
                 
                
                    

                 		 	   		  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20130714/b5ed2583/attachment.html>


More information about the OpenStack-dev mailing list