<div dir="ltr">Hi Jay,<div><br></div><div>I tried the native k8s commands (in a fresh bay):</div><div><br></div><div><div><i>kubectl create -s <a href="http://192.168.1.249:8080">http://192.168.1.249:8080</a> -f ./redis-master.yaml</i></div><div><i>kubectl create -s <a href="http://192.168.1.249:8080">http://192.168.1.249:8080</a> -f ./redis-sentinel-service.yaml</i></div><div><i>kubectl create -s <a href="http://192.168.1.249:8080">http://192.168.1.249:8080</a> -f ./redis-controller.yaml</i></div><div><i>kubectl create -s <a href="http://192.168.1.249:8080">http://192.168.1.249:8080</a> -f ./redis-sentinel-controller.yaml</i></div></div><div><br></div><div>It still didn't work (same symptom as before). I cannot spot any difference between the original yaml file and the parsed yam file. Any other idea?</div><div><br></div><div>Thanks,</div><div>Hongbin</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Feb 22, 2015 at 8:38 PM, Jay Lau <span dir="ltr"><<a href="mailto:jay.lau.513@gmail.com" target="_blank">jay.lau.513@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>I suspect that there are some error after the pod/services parsed, can you please use the native k8s command have a try first then debug k8s api part to check the difference of the original json file and the parsed json file? Thanks!<br><br></div>kubectl create -f xxxx.json xxx<br><br><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">2015-02-23 1:40 GMT+08:00 Hongbin Lu <span dir="ltr"><<a href="mailto:hongbin034@gmail.com" target="_blank">hongbin034@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Jay,<div><br></div><div>I checked the <span style="font-size:12.8000001907349px">kubelet log. There are a lot of Watch closed error like below. Here is the full log <a href="http://fpaste.org/188964/46261561/" target="_blank">http://fpaste.org/188964/46261561/</a> .</span></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><div><span style="font-size:12.8000001907349px"><i>Status:"Failure", Message:"unexpected end of JSON input", Reason:""</i></span></div><div><span style="font-size:12.8000001907349px"><i>Status:"Failure", Message:"501: All the given peers are not reachable</i></span></div></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px">Please note that my environment was setup by following the quickstart guide. It seems that all the kube components were running (checked by using systemctl status command), and all nodes can ping each other. Any further suggestion?</span></div><div><span style="font-size:12.8000001907349px"><br></span></div><div><span style="font-size:12.8000001907349px">Thanks,</span></div><div><span style="font-size:12.8000001907349px">Hongbin</span></div><div><br></div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Feb 22, 2015 at 3:58 AM, Jay Lau <span dir="ltr"><<a href="mailto:jay.lau.513@gmail.com" target="_blank">jay.lau.513@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Can you check the kubelet log on your minions? Seems the container failed to start, there might be something wrong for your minions node. Thanks.<br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>2015-02-22 15:08 GMT+08:00 Hongbin Lu <span dir="ltr"><<a href="mailto:hongbin034@gmail.com" target="_blank">hongbin034@gmail.com</a>></span>:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi all,<div><br></div><div>I tried to go through the new redis example at the quickstart guide [1], but was not able to go through. I was blocked by connecting to the redis slave container:</div><div><div><br></div><div><font face="arial, helvetica, sans-serif"><i>$ docker exec -i -t $REDIS_ID redis-cli</i></font></div><div><font face="arial, helvetica, sans-serif"><i>Could not connect to Redis at <a href="http://127.0.0.1:6379" target="_blank">127.0.0.1:6379</a>: Connection refused</i></font></div><div><br></div><div>Here is the container log:</div><div><br></div><div><font face="arial, helvetica, sans-serif"><i>$ docker logs $REDIS_ID</i></font></div><div><font face="arial, helvetica, sans-serif"><i>Error: Server closed the connection</i></font></div><div><font face="arial, helvetica, sans-serif"><i>Failed to find master.</i></font></div><div><br></div><div>It looks like the redis master disappeared at some point. I tried to check the status in about every one minute. Below is the output.</div><div><br></div><div><i>$ kubectl get pod</i></div><div><i>NAME IMAGE(S) HOST LABELS STATUS</i></div><div><i>51c68981-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis-sentinel,redis-sentinel=true,role=sentinel Pending</i></div><div><i>redis-master kubernetes/redis:v1 <a href="http://10.0.0.4/" target="_blank">10.0.0.4/</a> name=redis,redis-sentinel=true,role=master Pending</i></div><div><i> kubernetes/redis:v1</i></div><div><i>512cf350-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis Pending</i></div><div><i><br></i></div><div><i>$ kubectl get pod</i></div><div><i>NAME IMAGE(S) HOST LABELS STATUS</i></div><div><i>512cf350-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis Running</i></div><div><i>51c68981-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis-sentinel,redis-sentinel=true,role=sentinel Running</i></div><div><i>redis-master kubernetes/redis:v1 <a href="http://10.0.0.4/" target="_blank">10.0.0.4/</a> name=redis,redis-sentinel=true,role=master Running</i></div><div><i> kubernetes/redis:v1</i></div><div><i><br></i></div><div><i>$ kubectl get pod</i></div><div><i>NAME IMAGE(S) HOST LABELS STATUS</i></div><div><i>redis-master kubernetes/redis:v1 <a href="http://10.0.0.4/" target="_blank">10.0.0.4/</a> name=redis,redis-sentinel=true,role=master Running</i></div><div><i> kubernetes/redis:v1</i></div><div><i>512cf350-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis Failed</i></div><div><i>51c68981-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis-sentinel,redis-sentinel=true,role=sentinel Running</i></div><div><i>233fa7d1-ba21-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis Running</i></div><div><i><br></i></div><div><i>$ kubectl get pod</i></div><div><i>NAME IMAGE(S) HOST LABELS STATUS</i></div><div><i>512cf350-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis Running</i></div><div><i>51c68981-ba20-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis-sentinel,redis-sentinel=true,role=sentinel Running</i></div><div><i>233fa7d1-ba21-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.5/" target="_blank">10.0.0.5/</a> name=redis Running</i></div><div><i>3b164230-ba21-11e4-84dc-fa163e318555 kubernetes/redis:v1 <a href="http://10.0.0.4/" target="_blank">10.0.0.4/</a> name=redis-sentinel,redis-sentinel=true,role=sentinel Pending</i></div></div><div><br></div><div>Is anyone able to reproduce the problem above? If yes, I am going to file a bug.</div><div><br></div><div>Thanks,</div><div>Hongbin</div><div><br></div><div>[1] <a href="https://github.com/stackforge/magnum/blob/master/doc/source/dev/dev-quickstart.rst#exercising-the-services-using-devstack" target="_blank">https://github.com/stackforge/magnum/blob/master/doc/source/dev/dev-quickstart.rst#exercising-the-services-using-devstack</a></div></div>
<br></div></div>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><span><font color="#888888"><br><br clear="all"><br>-- <br><div><div dir="ltr"><div><div dir="ltr"><div>Thanks,<br><br></div>Jay Lau (Guangya Liu)<br></div></div></div></div>
</font></span></div>
<br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>
</div></div><br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div><div dir="ltr"><div><div dir="ltr"><div>Thanks,<br><br></div>Jay Lau (Guangya Liu)<br></div></div></div></div>
</div>
</div></div><br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>