Open Stack

This way solves my problem, thanks Vitaly.
 
------------------ Original ------------------
From:  "Vitaly Gridnev"<vgridnev at mirantis.com>;
Date:  Mon, Aug 8, 2016 06:44 PM
To:  "fuguangping"<fuguangping at unitedstack.com>; 
Cc:  "openstack"<openstack at lists.openstack.org>; 
Subject:  Re: [Openstack] [Sahara]Cloudera-Manager generate empty Hadoop/HDFS configration

 
Hello. Seems like an issue around Cloudera (not sure). I faced with something like that when cluster was deployed without Oozie. Could please try to deploy cluster with Oozie server?

On Mon, Aug 8, 2016 at 11:56 AM, fuguangping <fuguangping at unitedstack.com> wrote:
Hi all,


I installed sahara on Openstack liberty version, and I succeed to deploy CDH-5.4 without any error. But When I login to the Cloudera-manager VM, I found some wrong Hadoop/HDFS configurations:


[root at int32bit-hadoop-1-cdh-master-001 hdfs]# hdfs dfs -df
Filesystem         Size        Used    Available  Use%
file:///    20061442048  5187198976  14874243072   26%


I checked the hadoop config file in /etc/hadoop/conf, it seemed that the Cloudera-manager fail to update config:


[root at int32bit-hadoop-1-cdh-master-001 hdfs]# cat /etc/hadoop/conf/core-site.xml
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> 



<configuration>
</configuration>



As showed above, the core-site.xml is empty.


Then I checked other config files, it showed the same result with empty configuration.


Here's my master role processes:


CLOUDERA_MANAGER
YARN_JOBHISTORY
YARN_RESOURCEMANAGER
HDFS_SECONDARYNAMENODE
HDFS_NAMENODE 


and slave role processes:


HBASE_REGIONSERVER
HDFS_DATANODE
YARN_NODEMANAGER



sahara.conf:


[DEFAULT]
debug=true
verbose = true
log_dir = /var/log/sahara
use_syslog = false
use_stderr = true
rpc_backend = rabbit
use_floating_ips= True
use_neutron = true
use_namespaces = true
use_rootwrap = true
rootwrap_command="sudo sahara-rootwrap /etc/sahara/rootwrap.conf"


plugins = vanilla,hdp,spark,cdh,ambari,fake,mapr,storm
infrastructure_engine = heat


...


Any help is greatly appreciated.


Regards,

Guangping Fu




_______________________________________________
 Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 Post to     : openstack at lists.openstack.org
 Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 





-- 
Best Regards,

Vitaly Gridnev,
Project Technical Lead of OpenStack DataProcessing Program (Sahara)
Mirantis, Inc
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20160809/fec21f3e/attachment.html>