[Openstack] [Sahara] Master-instance: Service hadoop-* not running

Dat Tran dattbbk at gmail.com
Thu Jul 17 21:10:05 UTC 2014


Thank Sergey and Matthew,

Matt, i follow the this instructions. Details step by step installation,
configuration anh create cluster at:
https://docs.google.com/document/d/1r1aYEQ-fugY8h3vbG5Wvk0FfVRUk_oDmaRDtpUiyK-0/edit

When ssh to instance-master run: sudo su hadoop; cd ~; hadoop jar
/usr/share/hadoop/hadoop-examples-1.2.1.jar pi 10 100
Seems it worked. But it's still error:

    Caused by: java.lang.OutOfMemoryError: Java heap space
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:954)
        ...
    14/07/17 19:37:25 INFO mapred.JobClient:  map 0% reduce 0%
    14/07/17 19:37:26 INFO mapred.JobClient: Job complete:
job_local1818916530_0001
    14/07/17 19:37:26 INFO mapred.JobClient: Counters: 0
    14/07/17 19:37:26 INFO mapred.JobClient: Job Failed: NA
    java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
        ...

(details log at:
https://docs.google.com/document/d/1El-kvPJumN6GOw9FTnh8CeM4RVXtS-57PlBzn3fXUI4/edit
)


First, i set flavor for a node group template is 1GB Ram and 10GB Disk.
Then i set 2GB Ram and 20GB Disk. But still this error.
Note:
 - The current, i'm setting disable Swift and MySQL.
 - I set default HDFS, MapReduce,....

I see:
 - Service hadoop-* (hadoop-namenode) still "not running"
 - Show UI Sahara: HDFS, MapReduce: No Configuratiions (
http://prntscr.com/43os8r)


2014-07-17 1:13 GMT+07:00 Matthew Farrellee <matt at redhat.com>:

> sergey, sahara specs?
>
> dat,
>
> did you follow the instructions in the current docs
>
>  http://docs.openstack.org/developer/sahara/userdoc/
> installation.guide.html
>
> ?
>
> if they're in the google doc, please include them in your next email.
>
> best,
>
>
> matt
>
>
> On 07/15/2014 09:05 AM, Sergey Lukjanov wrote:
>
>> I've CC'ed Matt Farrellee, he's the initial author of sahara specs.
>>
>> On Tue, Jul 15, 2014 at 10:28 AM, Dat Tran <dattbbk at gmail.com> wrote:
>>
>>> I install openstack icehouse, then install sahara. I create cluster, it
>>> worked!
>>> But when i login master-instance, test. Run `hadoop jar
>>> hadoop-examples-1.2.1.jar pi 10 100` ==> Message error:
>>> `java.io.IOException: Cannot create input directory
>>> PiEstimator_TMP_3_141592654/in...`
>>>
>>> I check service hadoop-namenode, it's not working. Message:
>>> `start-stop-daemon: unable to set gid to 201 (Operation not permitted)`.
>>> All
>>> service hadoop-* not working, too.
>>>
>>> Go back, i check log, have warning. Summarize:
>>>
>>>      WARNING sahara.service.engine [-] Can't start cluster '_unknown_'
>>> (reason: 'NoneType' object has no attribute 'node_groups')
>>>      WARNING sahara.service.engine [-] Presumably the operation failed
>>> because the cluster wasdeleted by a user during the process.
>>>      ERROR root [-] Original exception being dropped: ['Traceback (most
>>> recent call last):\n', '  File
>>> "/home/bkcloud/sahara-venv/local/lib/python2.7/site-
>>> packages/sahara/service/direct_engine.py",
>>> line 65, in create_cluster\n    volumes.attach(cluster)\n', '  File
>>> "/home/bkcloud/sahara-venv/local/lib/python2.7/site-
>>> packages/sahara/service/volumes.py",
>>> line 31, in attach\n    for node_group in cluster.node_groups:\n',
>>> "AttributeError: 'NoneType' object has no attribute 'node_groups'\n"]
>>>      RROR sahara.context [-] Thread
>>> 'cluster-creating-91420b4b-9e89-44ff-8ce4-6cd5740e7bdc' fails with
>>> exception: 'Cluster id 'None' not found!'
>>>
>>>
>>> I use:
>>>
>>>   - Plugin Vanilla 1.2.1
>>>   - Hadoop version 1.2.1
>>>   - Image: sahara-icehouse-vanilla-1.2.1-ubuntu-13.10.qcow2
>>>   - Download image at:
>>> http://sahara-files.mirantis.com/sahara-icehouse-vanilla-1.
>>> 2.1-ubuntu-13.10.qcow2
>>>
>>> Details steps i created cluster:
>>> https://docs.google.com/document/d/1nwAP7FJQMjzOTg1w6UGfk55hvKzbT
>>> 0OBYHMBGSgNwxU/edit
>>>
>>> I think: I failed step config sahara or create node template? Because
>>> service sahara not running, so hadoop not worked :(
>>> Can you help me? Thanks!
>>>
>>>
>>> _______________________________________________
>>> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
>>> openstack
>>> Post to     : openstack at lists.openstack.org
>>> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
>>> openstack
>>>
>>>
>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140718/92b76e7d/attachment.html>


More information about the Openstack mailing list