Open Stack

Hi Sahara,

I'm a new bird here for both sahara & HDP.
I just installed a total fresh all-in-one Openstack environment by devstack, and want to build my first Hadoop cluster.

Limited to my knowledge about Hadoop and HDP, I  hope to build a cluster as small as I can.

All things are build based on plugin HDP  2.0.6.


1.       I created 2 node-group templates:

a.       Master

NAMENODE

ZOOKEEPER_SERVER

AMBARI_SERVER

HISTORYSERVER

RESOURCEMANAGER

b.      slave

NODEMANAGER





2.       I create a cluster template which include the above 2 node groups.

3.       I launched the cluster in Horizon, and started waiting...

4.       The cluster stalled at status "Configuring".

Anyone know why this happened ??

Thanks.
-chen


I did a little check, as "nova list" showed:
    nova list
    +--------------------------------------+-----------------------+--------+------------+-------------+--------------------------------+
    | ID                                   | Name                  | Status | Task State | Power State | Networks                       |
    +--------------------------------------+-----------------------+--------+------------+-------------+--------------------------------+
    | f2e27b00-858e-4c71-822d-abc1bd35b0d4 | kk-basic-master-001   | ACTIVE | -          | Running     | private=10.0.0.4, 192.169.14.3 |
    | e757756c-7d53-49e0-91b1-af7e67b85f03 | kk-smallest-slave-001 | ACTIVE | -          | Running     | private=10.0.0.5, 192.169.14.4 |
    +--------------------------------------+-----------------------+--------+------------+-------------+--------------------------------+

Instances were started successfully and network is working well too.

The sahara log keeps printing:
2015-02-28 16:30:27.908 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001] Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command /opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:27.909 DEBUG sahara.utils.ssh_remote [-] cached HTTP session for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450> from (pid=28144) _get_http_client /opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:27.910 DEBUG urllib3.util.retry [-] Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144) from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:27.911 INFO urllib3.connectionpool [-] Resetting dropped connection: proxy-socks.sc.intel.com
2015-02-28 16:30:28.216 DEBUG urllib3.connectionpool [-] "GET http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144) _make_request /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:28.219 INFO sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect to ambari server ...
2015-02-28 16:30:32.277 DEBUG sahara.openstack.common.periodic_task [-] Running periodic task SaharaPeriodicTasks.terminate_unneeded_transient_clusters from (pid=28144) run_periodic_tasks /opt/stack/sahara/sahara/openstack/common/periodic_task.py:219
2015-02-28 16:30:32.277 DEBUG sahara.service.periodic [-] Terminating unneeded transient clusters from (pid=28144) terminate_unneeded_transient_clusters /opt/stack/sahara/sahara/service/periodic.py:131
2015-02-28 16:30:32.316 DEBUG sahara.openstack.common.loopingcall [-] Dynamic looping call <bound method SaharaPeriodicTasks.run_periodic_tasks of <sahara.service.periodic.SaharaPeriodicTasks object at 0x7f3edb415950>> sleeping for 9.96 seconds from (pid=28144) _inner /opt/stack/sahara/sahara/openstack/common/loopingcall.py:132
2015-02-28 16:30:33.278 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001] Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command /opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:33.279 DEBUG sahara.utils.ssh_remote [-] cached HTTP session for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450> from (pid=28144) _get_http_client /opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:33.280 DEBUG urllib3.util.retry [-] Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144) from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:33.281 INFO urllib3.connectionpool [-] Resetting dropped connection: proxy-socks.sc.intel.com
2015-02-28 16:30:33.573 DEBUG urllib3.connectionpool [-] "GET http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144) _make_request /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:33.574 INFO sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect to ambari server ...
2015-02-28 16:30:38.634 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001] Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command /opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:38.634 DEBUG sahara.utils.ssh_remote [-] cached HTTP session for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450> from (pid=28144) _get_http_client /opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:38.635 DEBUG urllib3.util.retry [-] Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144) from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:38.636 INFO urllib3.connectionpool [-] Resetting dropped connection: proxy-socks.sc.intel.com
2015-02-28 16:30:38.927 DEBUG urllib3.connectionpool [-] "GET http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144) _make_request /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:38.929 INFO sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect to ambari server ...
2015-02-28 16:30:42.280 DEBUG sahara.openstack.common.periodic_task [-] Running periodic task SaharaPeriodicTasks.update_job_statuses from (pid=28144) run_periodic_tasks /opt/stack/sahara/sahara/openstack/common/periodic_task.py:219
2015-02-28 16:30:42.282 DEBUG sahara.service.periodic [-] Updating job statuses from (pid=28144) update_job_statuses /opt/stack/sahara/sahara/service/periodic.py:123
2015-02-28 16:30:42.290 DEBUG sahara.openstack.common.loopingcall [-] Dynamic looping call <bound method SaharaPeriodicTasks.run_periodic_tasks of <sahara.service.periodic.SaharaPeriodicTasks object at 0x7f3edb415950>> sleeping for 45.00 seconds from (pid=28144) _inner /opt/stack/sahara/sahara/openstack/common/loopingcall.py:132
2015-02-28 16:30:43.995 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001] Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command /opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:43.995 DEBUG sahara.utils.ssh_remote [-] cached HTTP session for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450> from (pid=28144) _get_http_client /opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:43.999 DEBUG urllib3.util.retry [-] Converted retries value: 0 -> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144) from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:44.000 INFO urllib3.connectionpool [-] Resetting dropped connection: proxy-socks.sc.intel.com
2015-02-28 16:30:44.289 DEBUG urllib3.connectionpool [-] "GET http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144) _make_request /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:44.290 INFO sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect to ambari server ...


"proxy-socks.sc.intel.com" is the proxy I'm using on the physical machine, but I didn't know why sahara would use it.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150228/d7483603/attachment.html>