<div dir="ltr">Hello. Seems like an issue around Cloudera (not sure). I faced with something like that when cluster was deployed without Oozie. Could please try to deploy cluster with Oozie server?</div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Aug 8, 2016 at 11:56 AM, fuguangping <span dir="ltr"><<a href="mailto:fuguangping@unitedstack.com" target="_blank">fuguangping@unitedstack.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:"lucida Grande",Verdana;line-height:normal">Hi all,</div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px">I installed sahara on Openstack liberty version, and I succeed to deploy CDH-5.4 without any error. But When I login to the Cloudera-manager VM, I found some wrong Hadoop/HDFS configurations:</span></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px"><br></span></div><div><div style="color:rgb(51,51,51);font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal"><b>[root@int32bit-hadoop-1-cdh-<wbr>master-001 hdfs]# hdfs dfs -df</b></div><div style="color:rgb(51,51,51);font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal"><b>Filesystem         Size        Used    Available  Use%</b></div><div style="color:rgb(51,51,51);font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal"><b>file:///    20061442048  5187198976  14874243072   26%</b></div><div style="color:rgb(51,51,51);font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal"><br></div><div style="color:rgb(51,51,51);font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal">I checked the hadoop config file in /etc/hadoop/conf, it seemed that the Cloudera-manager fail to update config:</div><div style="color:rgb(51,51,51);font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal"><br></div><div><font face="lucida Grande, Verdana"><span style="font-size:12px;line-height:normal"><b>[root@int32bit-hadoop-1-cdh-<wbr>master-001 hdfs]# cat /etc/hadoop/conf/core-site.xml</b></span></font></div><div><b><font face="lucida Grande, Verdana"><span style="font-size:12px;line-height:normal"><?xml-stylesheet type="text/xsl" href="configuration.xsl"?></span></font><span style="font-family:"lucida Grande",Verdana;font-size:12px;line-height:normal"> </span></b></div></div><div><div><font face="lucida Grande, Verdana"><span style="font-size:12px;line-height:normal"><b><br></b></span></font></div><div><font face="lucida Grande, Verdana"><span style="font-size:12px;line-height:normal"><b><configuration></b></span></font></div><div><font face="lucida Grande, Verdana"><span style="font-size:12px;line-height:normal"><b></configuration></b></span></font></div></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal">As showed above, the core-site.xml is empty.</div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal">Then I checked other config files, it showed the same result with empty configuration.</div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal">Here's my master role processes:</div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal">CLOUDERA_MANAGER</div><div style="font-family:"lucida Grande",Verdana;line-height:normal">YARN_JOBHISTORY</div><div style="font-family:"lucida Grande",Verdana;line-height:normal">YARN_RESOURCEMANAGER</div><div style="font-family:"lucida Grande",Verdana;line-height:normal">HDFS_SECONDARYNAMENODE</div><div style="font-family:"lucida Grande",Verdana;line-height:normal">HDFS_NAMENODE </div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal">and slave role processes:</div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><br></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><div style="line-height:normal">HBASE_REGIONSERVER</div><div style="line-height:normal">HDFS_DATANODE</div><div style="line-height:normal">YARN_NODEMANAGER</div></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><font color="#333333" face="monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><font color="#333333" face="monospace"><span style="font-size:12px;line-height:18px"><b>sahara.conf:</b></span></font></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><font color="#333333" face="monospace"><span style="font-size:12px;line-height:18px"><br></span></font></div><div><font color="#333333" face="monospace"><span style="font-size:12px;line-height:18px"><div>[DEFAULT]</div><div>debug=true</div><div>verbose = true</div><div>log_dir = /var/log/sahara</div><div>use_syslog = false</div><div>use_stderr = true</div><div>rpc_backend = rabbit</div><div>use_floating_ips= True</div><div>use_neutron = true</div><div>use_namespaces = true</div><div>use_rootwrap = true</div><div>rootwrap_command="sudo sahara-rootwrap /etc/sahara/rootwrap.conf"</div><div><br></div><div>plugins = vanilla,hdp,spark,cdh,ambari,<wbr>fake,mapr,storm</div><div>infrastructure_engine = heat</div><div><br></div><div>...</div><div><br></div><div><span style="color:rgb(0,0,0);font-family:"lucida Grande",Verdana;font-size:14px;line-height:normal">Any help is greatly appreciated.</span></div></span></font></div><div style="font-family:"lucida Grande",Verdana;line-height:normal"><p style="line-height:1.4"><span style="line-height:normal">Regards,</span></p><p style="line-height:21px"><span style="line-height:normal">Guangping Fu</span></p></div></div><div><u></u><u></u></div><br>______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
Post to     : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><span style="font-family:arial;font-size:small">Best Regards,</span><br></div><div><span style="font-family:arial;font-size:small">Vitaly Gridnev,</span></div><div>Project Technical Lead of OpenStack DataProcessing Program (Sahara)<br style="font-family:arial;font-size:small"><div style="font-family:arial;font-size:small">Mirantis, Inc</div></div></div></div></div></div>
</div>