[Openstack] [Sahara] Master-instance: Service hadoop-* not running

Dat Tran dattbbk at gmail.com
Mon Jul 21 08:03:49 UTC 2014


Thanks a lot everyone,
I have fixed hadoop-problem :)


2014-07-18 4:10 GMT+07:00 Dat Tran <dattbbk at gmail.com>:

> Thank Sergey and Matthew,
>
> Matt, i follow the this instructions. Details step by step installation,
> configuration anh create cluster at:
>
> https://docs.google.com/document/d/1r1aYEQ-fugY8h3vbG5Wvk0FfVRUk_oDmaRDtpUiyK-0/edit
>
> When ssh to instance-master run: sudo su hadoop; cd ~; hadoop jar
> /usr/share/hadoop/hadoop-examples-1.2.1.jar pi 10 100
> Seems it worked. But it's still error:
>
>     Caused by: java.lang.OutOfMemoryError: Java heap space
> at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:954)
>         ...
>     14/07/17 19:37:25 INFO mapred.JobClient:  map 0% reduce 0%
>     14/07/17 19:37:26 INFO mapred.JobClient: Job complete:
> job_local1818916530_0001
>     14/07/17 19:37:26 INFO mapred.JobClient: Counters: 0
>     14/07/17 19:37:26 INFO mapred.JobClient: Job Failed: NA
>     java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
>         ...
>
> (details log at:
> https://docs.google.com/document/d/1El-kvPJumN6GOw9FTnh8CeM4RVXtS-57PlBzn3fXUI4/edit
> )
>
>
> First, i set flavor for a node group template is 1GB Ram and 10GB Disk.
> Then i set 2GB Ram and 20GB Disk. But still this error.
> Note:
>  - The current, i'm setting disable Swift and MySQL.
>  - I set default HDFS, MapReduce,....
>
> I see:
>  - Service hadoop-* (hadoop-namenode) still "not running"
>  - Show UI Sahara: HDFS, MapReduce: No Configuratiions (
> http://prntscr.com/43os8r)
>
>
> 2014-07-17 1:13 GMT+07:00 Matthew Farrellee <matt at redhat.com>:
>
> sergey, sahara specs?
>>
>> dat,
>>
>> did you follow the instructions in the current docs
>>
>>  http://docs.openstack.org/developer/sahara/userdoc/
>> installation.guide.html
>>
>> ?
>>
>> if they're in the google doc, please include them in your next email.
>>
>> best,
>>
>>
>> matt
>>
>>
>> On 07/15/2014 09:05 AM, Sergey Lukjanov wrote:
>>
>>> I've CC'ed Matt Farrellee, he's the initial author of sahara specs.
>>>
>>> On Tue, Jul 15, 2014 at 10:28 AM, Dat Tran <dattbbk at gmail.com> wrote:
>>>
>>>> I install openstack icehouse, then install sahara. I create cluster, it
>>>> worked!
>>>> But when i login master-instance, test. Run `hadoop jar
>>>> hadoop-examples-1.2.1.jar pi 10 100` ==> Message error:
>>>> `java.io.IOException: Cannot create input directory
>>>> PiEstimator_TMP_3_141592654/in...`
>>>>
>>>> I check service hadoop-namenode, it's not working. Message:
>>>> `start-stop-daemon: unable to set gid to 201 (Operation not
>>>> permitted)`. All
>>>> service hadoop-* not working, too.
>>>>
>>>> Go back, i check log, have warning. Summarize:
>>>>
>>>>      WARNING sahara.service.engine [-] Can't start cluster '_unknown_'
>>>> (reason: 'NoneType' object has no attribute 'node_groups')
>>>>      WARNING sahara.service.engine [-] Presumably the operation failed
>>>> because the cluster wasdeleted by a user during the process.
>>>>      ERROR root [-] Original exception being dropped: ['Traceback (most
>>>> recent call last):\n', '  File
>>>> "/home/bkcloud/sahara-venv/local/lib/python2.7/site-
>>>> packages/sahara/service/direct_engine.py",
>>>> line 65, in create_cluster\n    volumes.attach(cluster)\n', '  File
>>>> "/home/bkcloud/sahara-venv/local/lib/python2.7/site-
>>>> packages/sahara/service/volumes.py",
>>>> line 31, in attach\n    for node_group in cluster.node_groups:\n',
>>>> "AttributeError: 'NoneType' object has no attribute 'node_groups'\n"]
>>>>      RROR sahara.context [-] Thread
>>>> 'cluster-creating-91420b4b-9e89-44ff-8ce4-6cd5740e7bdc' fails with
>>>> exception: 'Cluster id 'None' not found!'
>>>>
>>>>
>>>> I use:
>>>>
>>>>   - Plugin Vanilla 1.2.1
>>>>   - Hadoop version 1.2.1
>>>>   - Image: sahara-icehouse-vanilla-1.2.1-ubuntu-13.10.qcow2
>>>>   - Download image at:
>>>> http://sahara-files.mirantis.com/sahara-icehouse-vanilla-1.
>>>> 2.1-ubuntu-13.10.qcow2
>>>>
>>>> Details steps i created cluster:
>>>> https://docs.google.com/document/d/1nwAP7FJQMjzOTg1w6UGfk55hvKzbT
>>>> 0OBYHMBGSgNwxU/edit
>>>>
>>>> I think: I failed step config sahara or create node template? Because
>>>> service sahara not running, so hadoop not worked :(
>>>> Can you help me? Thanks!
>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
>>>> openstack
>>>> Post to     : openstack at lists.openstack.org
>>>> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
>>>> openstack
>>>>
>>>>
>>>
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140721/f49f5aab/attachment.html>


More information about the Openstack mailing list