[kolla-ansible][mariadb] socat: Connection reset by peer
Folks, I am getting the following errors in logs constantly and continually. I have 3 node galera clusters. Everything looks good except this error making me nervous. I have deployed Zed release of kolla openstack. ==> /var/log/kolla/mariadb/mariadb-clustercheck.log <== 2023/04/12 02:42:16 socat[1574755] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574761] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574755] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574761] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:18 socat[1574767] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:18 socat[1574767] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer
Hey, I don't have too much kolla hands-on experience, but it'll be nice if you can post SOCAT configurations, specific to the MySQL health check. Also, the number 8192 is the default maximum connection value; could you check if you are hitting that limit? Cheers! On Tue, Apr 11, 2023 at 8:49 PM Satish Patel <satish.txt@gmail.com> wrote:
Folks,
I am getting the following errors in logs constantly and continually. I have 3 node galera clusters. Everything looks good except this error making me nervous. I have deployed Zed release of kolla openstack.
==> /var/log/kolla/mariadb/mariadb-clustercheck.log <== 2023/04/12 02:42:16 socat[1574755] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574761] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574755] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574761] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:18 socat[1574767] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:18 socat[1574767] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer
-- Alvaro Soto *Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you.* ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
I have checked the mysql limit and it's very high and usage is way below the limit using them. It's a very small deployment in the lab. Following is the docker container running that check (mariadb-clustercheck)[root@kolla-infra-1-2 /]# ps aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 2632 924 ? Ss Apr04 0:00 dumb-init --single-child -- kolla_start root 7 0.0 0.0 10280 4760 ? S Apr04 8:19 socat -d -lf/var/log/kolla/mariadb/mariadb-clustercheck.log tcp-l:4569,fork,reuseaddr,bind=10.30.50.2 EXEC:clustercheck root 2070140 0.0 0.0 7624 4240 pts/0 Ss 18:08 0:00 bash root 2070999 0.0 0.0 10060 1596 pts/0 R+ 18:09 0:00 ps aux When i run manually i got successful reply (mariadb-clustercheck)[root@kolla-infra-1-2 /]# clustercheck HTTP/1.1 200 OK Content-Type: text/plain Connection: close Content-Length: 32 Galera cluster node is synced. Everything looks ok so far. Not sure if I should ignore that error message or consider it bad. On Tue, Apr 11, 2023 at 11:07 PM Alvaro Soto <alsotoes@gmail.com> wrote:
Hey, I don't have too much kolla hands-on experience, but it'll be nice if you can post SOCAT configurations, specific to the MySQL health check. Also, the number 8192 is the default maximum connection value; could you check if you are hitting that limit?
Cheers!
On Tue, Apr 11, 2023 at 8:49 PM Satish Patel <satish.txt@gmail.com> wrote:
Folks,
I am getting the following errors in logs constantly and continually. I have 3 node galera clusters. Everything looks good except this error making me nervous. I have deployed Zed release of kolla openstack.
==> /var/log/kolla/mariadb/mariadb-clustercheck.log <== 2023/04/12 02:42:16 socat[1574755] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574761] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574755] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:16 socat[1574761] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:18 socat[1574767] W read(7, 0x5653c4a4c000, 8192): Connection reset by peer 2023/04/12 02:42:18 socat[1574767] W read(6, 0x5653c4a4c000, 8192): Connection reset by peer
--
Alvaro Soto
*Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you.* ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
participants (2)
-
Alvaro Soto
-
Satish Patel