[openstack-dev] [Savanna] How to run hadoop jobs
Arindam Choudhury
arindam at live.com
Sat Jul 13 23:31:32 UTC 2013
Hi Ruslan,
As the output is quite long, I am providing pastebin link. Hope it does not boter you.
The outputs of
$ http $SAVANNA_URL/images X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/node-group-templates X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/cluster-templates X-Auth-Token:$AUTH_TOKEN
are here:
http://pastebin.com/ngu9HNdu
I followed the quick start guide, the outputs are here:
http://pastebin.com/TYmnQe2G
The logs are here, its contains log after I submitted the cluster:
http://pastebin.com/LjHxmi4j
Regards,
Arindam
Date: Sat, 13 Jul 2013 22:04:26 +0400
From: rkamaldinov at mirantis.com
To: arindam at live.com
CC: openstack-dev at lists.openstack.org; savanna-all at lists.launchpad.net
Subject: Re: [Savanna-all] How to run hadoop jobs
Hi Arindam,
There was a validation error during cluster creation. Can you send contents of cluster_create.json ?Also, please attach output of:
$ http $SAVANNA_URL/images X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/node-group-templates X-Auth-Token:$AUTH_TOKEN$ http $SAVANNA_URL/cluster-templates X-Auth-Token:$AUTH_TOKEN
Savanna debug logs also would be helpful.
Please use *openstack-dev* as a mail-list for Savanna-related questions. Just prefix the subject with [Savanna].
Thanks,Ruslan
On Saturday, July 13, 2013 at 9:24 PM, Arindam Choudhury wrote:
Hi,
I installed savanna from the git repository. I can create cluster but only with admin, when I try to create cluster with non-admin user it gives me an error:
(keystone_arindam)]# http $SAVANNA_URL/clusters X-Auth-Token:$AUTH_TOKEN < cluster_create.json
HTTP/1.1 500 INTERNAL SERVER ERROR
Content-Length: 111
Content-Type: application/json
Date: Sat, 13 Jul 2013 16:47:25 GMT
{
"error_code": 500,
"error_message": "Error occurred during validation",
"error_name": "INTERNAL_SERVER_ERROR"
}
The hadoop daemons are not started automatically so I could not run the test job.
hadoop at cluster-1-master-001:/usr/share/hadoop$ hadoop jar hadoop-examples.jar pi 10 100
Exception in thread "main" java.io.IOException: Error opening job jar: hadoop-examples.jar
at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
Caused by: java.io.FileNotFoundException: hadoop-examples.jar (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:214)
at java.util.zip.ZipFile.<init>(ZipFile.java:144)
at java.util.jar.JarFile.<init>(JarFile.java:153)
at java.util.jar.JarFile.<init>(JarFile.java:90)
at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
hadoop at cluster-1-master-001:/usr/share/hadoop$ start-all.sh
mkdir: cannot create directory `/mnt/log': Permission denied
chown: cannot access `/mnt/log/hadoop/hadoop/': No such file or directory
starting namenode, logging to /mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out
/usr/sbin/hadoop-daemon.sh: line 136: /mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out: No such file or directory
head: cannot open `/mnt/log/hadoop/hadoop//hadoop-hadoop-namenode-cluster-1-master-001.out' for reading: No such file or directory
hadoop at localhost's password:
when I try to start hadoop manually, it asks for a password. How to do it? Am I missing something?
Regards,
Arindam
-- Mailing list: https://launchpad.net/~savanna-allPost to : savanna-all at lists.launchpad.netUnsubscribe : https://launchpad.net/~savanna-allMore help : https://help.launchpad.net/ListHelp
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20130714/b5ed2583/attachment.html>
More information about the OpenStack-dev
mailing list