2022-06-02 01:32:49.023 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1374ms for session id 0x102d9de083a00df 2022-06-02 01:32:49.230 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a00df for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1374ms for session id 0x102d9de083a00df at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 01:32:49.331 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 01:32:51.559 WARN 1 --- [Curator-ConnectionStateManager-0] o.a.c.f.state.ConnectionStateManager : Session timeout has elapsed while SUSPENDED. Injecting a session expiration. Elapsed ms: 2228. Adjusted session timeout ms: 2000 2022-06-02 01:32:51.559 INFO 1 --- [Curator-ConnectionStateManager-0] org.apache.zookeeper.ZooKeeperTestable : injectSessionExpiration() called 2022-06-02 01:32:51.559 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 01:32:51.559 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@70925b45 2022-06-02 01:32:51.560 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 01:32:51.560 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 01:32:51.561 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 01:32:51.561 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102d9de083a00df 2022-06-02 01:32:51.561 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 01:32:51.561 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 01:32:51.562 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:52750, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 01:32:51.563 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 01:32:51.563 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 01:32:51.564 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:52754, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 01:32:51.565 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102d9de083a00f2, negotiated timeout = 2000 2022-06-02 01:32:51.565 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 01:32:51.574 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 02:01:23.809 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1415ms for session id 0x102d9de083a00f2 2022-06-02 02:01:24.331 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a00f2 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1415ms for session id 0x102d9de083a00f2 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 02:01:24.459 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 02:01:26.170 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 02:01:26.170 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 02:01:26.170 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:52834, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 02:01:26.171 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Unable to reconnect to ZooKeeper service, session 0x102d9de083a00f2 has expired 2022-06-02 02:01:26.171 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a00f2 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x102d9de083a00f2 has expired at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1434) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 02:01:26.171 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 02:01:26.172 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@70925b45 2022-06-02 02:01:26.172 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 02:01:26.172 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 02:01:26.172 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 02:01:26.173 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102d9de083a00f2 2022-06-02 02:01:26.175 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 02:01:26.175 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 02:01:26.175 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:52838, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 02:01:26.179 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102d9de083a00fb, negotiated timeout = 2000 2022-06-02 02:01:26.180 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 02:01:26.192 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 02:31:29.199 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 2045ms for session id 0x102d9de083a00fb 2022-06-02 02:31:29.200 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a00fb for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 2045ms for session id 0x102d9de083a00fb at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 02:31:29.300 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 02:31:30.602 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 02:31:30.602 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 02:31:30.603 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:52910, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 02:31:30.604 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102d9de083a00fb, negotiated timeout = 2000 2022-06-02 02:31:30.604 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 02:31:30.612 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 03:01:33.504 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1371ms for session id 0x102d9de083a00fb 2022-06-02 03:01:34.012 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a00fb for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1371ms for session id 0x102d9de083a00fb at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 03:01:34.837 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 03:01:36.054 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 03:01:36.054 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 03:01:36.055 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:52998, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 03:01:36.055 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Unable to reconnect to ZooKeeper service, session 0x102d9de083a00fb has expired 2022-06-02 03:01:36.055 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 03:01:36.056 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@70925b45 2022-06-02 03:01:36.056 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a00fb for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x102d9de083a00fb has expired at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1434) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 03:01:36.056 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 03:01:36.056 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 03:01:36.056 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 03:01:36.057 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102d9de083a00fb 2022-06-02 03:01:36.059 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 03:01:36.059 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 03:01:36.059 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53002, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 03:01:36.060 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102d9de083a010e, negotiated timeout = 2000 2022-06-02 03:01:36.060 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 03:01:36.066 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 05:01:34.055 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1692ms for session id 0x102d9de083a010e 2022-06-02 05:01:34.056 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a010e for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1692ms for session id 0x102d9de083a010e at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 05:01:34.264 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 05:01:35.890 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 05:01:35.890 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 05:01:35.890 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53248, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 05:01:35.891 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 05:01:35.891 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Unable to reconnect to ZooKeeper service, session 0x102d9de083a010e has expired 2022-06-02 05:01:35.891 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@70925b45 2022-06-02 05:01:35.892 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102d9de083a010e for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x102d9de083a010e has expired at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1434) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 05:01:35.892 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 05:01:35.892 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 05:01:35.892 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 05:01:35.893 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102d9de083a010e 2022-06-02 05:01:35.895 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 05:01:35.895 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 05:01:35.895 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53252, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 05:01:35.896 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102d9de083a011b, negotiated timeout = 2000 2022-06-02 05:01:35.897 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 05:01:35.909 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 10:08:28.724 WARN 1 --- [reactor-http-epoll-4] r.netty.http.client.HttpClientConnect : [id: 0x449e4767, L:/172.21.0.4:39928 - R:10.10.220.138/10.10.220.138:8095] The connection observed an error, the request cannot be retried as the headers/body were sent io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer 2022-06-02 10:08:28.832 ERROR 1 --- [reactor-http-epoll-4] o.s.w.s.adapter.HttpWebHandlerAdapter : [e21e877f-25887] 500 Server Error for HTTP GET "/api/controller/devices/findTemper" io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): |_ checkpoint ⇢ org.springframework.web.cors.reactive.CorsWebFilter [DefaultWebFilterChain] |_ checkpoint ⇢ org.springframework.cloud.gateway.filter.WeightCalculatorWebFilter [DefaultWebFilterChain] |_ checkpoint ⇢ HTTP GET "/api/controller/devices/findTemper" [ExceptionHandlingWebHandler] Stack trace: 2022-06-02 10:08:28.836 WARN 1 --- [reactor-http-epoll-4] r.netty.http.client.HttpClientConnect : [id: 0x16a441f8, L:/172.21.0.4:39920 - R:10.10.220.138/10.10.220.138:8095] The connection observed an error, the request cannot be retried as the headers/body were sent io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer 2022-06-02 10:08:28.836 ERROR 1 --- [reactor-http-epoll-4] o.s.w.s.adapter.HttpWebHandlerAdapter : [195bce53-25885] 500 Server Error for HTTP GET "/api/controller/devices/list?page=1&pageSize=12" io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): |_ checkpoint ⇢ org.springframework.web.cors.reactive.CorsWebFilter [DefaultWebFilterChain] |_ checkpoint ⇢ org.springframework.cloud.gateway.filter.WeightCalculatorWebFilter [DefaultWebFilterChain] |_ checkpoint ⇢ HTTP GET "/api/controller/devices/list?page=1&pageSize=12" [ExceptionHandlingWebHandler] Stack trace: 2022-06-02 10:08:28.846 WARN 1 --- [reactor-http-epoll-4] r.netty.http.client.HttpClientConnect : [id: 0xc593efa8, L:/172.21.0.4:39922 - R:10.10.220.138/10.10.220.138:8095] The connection observed an error, the request cannot be retried as the headers/body were sent io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer 2022-06-02 10:08:28.847 ERROR 1 --- [reactor-http-epoll-4] o.s.w.s.adapter.HttpWebHandlerAdapter : [86360771-25886] 500 Server Error for HTTP GET "/api/controller/agents/list" io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Error has been observed at the following site(s): |_ checkpoint ⇢ org.springframework.web.cors.reactive.CorsWebFilter [DefaultWebFilterChain] |_ checkpoint ⇢ org.springframework.cloud.gateway.filter.WeightCalculatorWebFilter [DefaultWebFilterChain] |_ checkpoint ⇢ HTTP GET "/api/controller/agents/list" [ExceptionHandlingWebHandler] Stack trace: 2022-06-02 10:08:30.522 INFO 1 --- [Thread-8] c.n.l.PollingServerListUpdater : Shutting down the Executor Pool for PollingServerListUpdater 2022-06-02 10:08:30.942 INFO 1 --- [Curator-Framework-0] o.a.c.f.imps.CuratorFrameworkImpl : backgroundOperationsLoop exiting 2022-06-02 10:08:31.003 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : An exception was thrown while closing send thread for session 0x102d9de083a011b. org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x102d9de083a011b, likely server has closed socket at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 10:08:31.106 INFO 1 --- [SpringContextShutdownHook] org.apache.zookeeper.ZooKeeper : Session: 0x102d9de083a011b closed 2022-06-02 10:08:31.109 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102d9de083a011b 2022-06-02 10:08:40.551 INFO 1 --- [main] o.c.sonic.gateway.GatewayApplication : The following profiles are active: sonic-server-gateway,actuator,zookeeper,logging,user 2022-06-02 10:08:44.236 INFO 1 --- [main] o.s.cloud.context.scope.GenericScope : BeanFactory id=e9b91da1-4cd1-3edd-942c-2dbbdd7f252b 2022-06-02 10:08:45.815 WARN 1 --- [main] c.n.c.sources.URLConfigurationSource : No URLs will be polled as dynamic configuration sources. 2022-06-02 10:08:45.815 INFO 1 --- [main] c.n.c.sources.URLConfigurationSource : To enable URLs as dynamic configuration sources, define System property archaius.configurationSource.additionalUrls or make config.properties available on classpath. 2022-06-02 10:08:45.826 WARN 1 --- [main] c.n.c.sources.URLConfigurationSource : No URLs will be polled as dynamic configuration sources. 2022-06-02 10:08:45.847 INFO 1 --- [main] c.n.c.sources.URLConfigurationSource : To enable URLs as dynamic configuration sources, define System property archaius.configurationSource.additionalUrls or make config.properties available on classpath. 2022-06-02 10:08:46.545 INFO 1 --- [main] o.a.c.f.imps.CuratorFrameworkImpl : Starting 2022-06-02 10:08:46.559 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:zookeeper.version=3.6.3--6401e4ad2087061bc6b9f80dec2d69f2e3c8660a, built on 04/08/2021 16:35 GMT 2022-06-02 10:08:46.559 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:host.name=ee5f341b97a5 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.version=15.0.2 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.vendor=AdoptOpenJDK 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.home=/opt/java/openjdk 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.class.path=/sonic-server-gateway.jar 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.io.tmpdir=/tmp 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:java.compiler= 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:os.name=Linux 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:os.arch=amd64 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:os.version=3.10.0-957.el7.x86_64 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:user.name=root 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:user.home=/root 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:user.dir=/ 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:os.memory.free=45MB 2022-06-02 10:08:46.560 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:os.memory.max=1956MB 2022-06-02 10:08:46.561 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Client environment:os.memory.total=106MB 2022-06-02 10:08:46.576 INFO 1 --- [main] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@10b892d5 2022-06-02 10:08:46.590 INFO 1 --- [main] org.apache.zookeeper.common.X509Util : Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2022-06-02 10:08:46.633 INFO 1 --- [main] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 10:08:46.644 INFO 1 --- [main] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 10:08:46.663 INFO 1 --- [main] o.a.c.f.imps.CuratorFrameworkImpl : Default schema 2022-06-02 10:08:46.664 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 10:08:46.664 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 10:08:46.673 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53818, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 10:08:47.147 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x0 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 10:08:49.104 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 10:08:49.105 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 10:08:49.105 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53858, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 10:08:49.106 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x0 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x0, likely server has closed socket at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 10:08:50.488 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 10:08:50.489 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 10:08:50.489 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53870, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 10:08:50.494 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x0 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. java.net.SocketException: Connection reset at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:367) ~[na:na] at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:398) ~[na:na] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:74) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 10:08:52.163 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 10:08:52.163 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 10:08:52.164 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53886, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 10:08:52.168 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x0 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. java.net.SocketException: Connection reset at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:367) ~[na:na] at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:398) ~[na:na] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:74) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 10:08:54.198 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 10:08:54.198 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 10:08:54.198 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:53898, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 10:08:54.240 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102de511e050000, negotiated timeout = 2000 2022-06-02 10:08:54.249 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: CONNECTED 2022-06-02 10:08:54.276 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 10:08:54.276 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 10:08:55.725 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [After] 2022-06-02 10:08:55.725 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Before] 2022-06-02 10:08:55.725 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Between] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Cookie] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Header] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Host] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Method] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Path] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Query] 2022-06-02 10:08:55.726 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [ReadBody] 2022-06-02 10:08:55.739 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [RemoteAddr] 2022-06-02 10:08:55.740 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [Weight] 2022-06-02 10:08:55.740 INFO 1 --- [main] o.s.c.g.r.RouteDefinitionRouteLocator : Loaded RoutePredicateFactory [CloudFoundryRouteService] 2022-06-02 10:08:56.570 WARN 1 --- [main] ockingLoadBalancerClientRibbonWarnLogger : You already have RibbonLoadBalancerClient on your classpath. It will be used by default. As Spring Cloud Ribbon is in maintenance mode. We recommend switching to BlockingLoadBalancerClient instead. In order to use it, set the value of `spring.cloud.loadbalancer.ribbon.enabled` to `false` or remove spring-cloud-starter-netflix-ribbon from your project. 2022-06-02 10:08:56.605 WARN 1 --- [main] eactorLoadBalancerClientRibbonWarnLogger : You have RibbonLoadBalancerClient on your classpath. LoadBalancerExchangeFilterFunction that uses it under the hood will be used by default. Spring Cloud Ribbon is now in maintenance mode, so we suggest switching to ReactorLoadBalancerExchangeFilterFunction instead. In order to use it, set the value of `spring.cloud.loadbalancer.ribbon.enabled` to `false` or remove spring-cloud-starter-netflix-ribbon from your project. 2022-06-02 10:08:57.429 INFO 1 --- [main] o.s.b.web.embedded.netty.NettyWebServer : Netty started on port(s): 8094 2022-06-02 10:08:58.205 INFO 1 --- [main] o.c.sonic.gateway.GatewayApplication : Started GatewayApplication in 21.363 seconds (JVM running for 23.702) 2022-06-02 10:10:24.939 INFO 1 --- [reactor-http-epoll-4] c.netflix.config.ChainedDynamicProperty : Flipping property: sonic-server-controller.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647 2022-06-02 10:10:24.991 INFO 1 --- [reactor-http-epoll-4] c.netflix.loadbalancer.BaseLoadBalancer : Client: sonic-server-controller instantiated a LoadBalancer: DynamicServerListLoadBalancer:{NFLoadBalancer:name=sonic-server-controller,current list of Servers=[],Load balancer stats=Zone stats: {},Server stats: []}ServerList:null 2022-06-02 10:10:25.011 INFO 1 --- [reactor-http-epoll-4] c.n.l.DynamicServerListLoadBalancer : Using serverListUpdater PollingServerListUpdater 2022-06-02 10:10:25.154 INFO 1 --- [reactor-http-epoll-4] c.netflix.config.ChainedDynamicProperty : Flipping property: sonic-server-controller.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647 2022-06-02 10:10:25.161 INFO 1 --- [reactor-http-epoll-4] c.n.l.DynamicServerListLoadBalancer : DynamicServerListLoadBalancer for client sonic-server-controller initialized: DynamicServerListLoadBalancer:{NFLoadBalancer:name=sonic-server-controller,current list of Servers=[10.10.220.138:8095],Load balancer stats=Zone stats: {unknown=[Zone:unknown; Instance count:1; Active connections count: 0; Circuit breaker tripped count: 0; Active connections per server: 0.0;] },Server stats: [[Server:10.10.220.138:8095; Zone:UNKNOWN; Total Requests:0; Successive connection failure:0; Total blackout seconds:0; Last connection made:Thu Jan 01 08:00:00 CST 1970; First connection made: Thu Jan 01 08:00:00 CST 1970; Active Connections:0; total failure count in last (1000) msecs:0; average resp time:0.0; 90 percentile resp time:0.0; 95 percentile resp time:0.0; min resp time:0.0; max resp time:0.0; stddev resp time:0.0] ]}ServerList:org.springframework.cloud.zookeeper.discovery.ZookeeperServerList@3c327c29 2022-06-02 10:10:26.121 INFO 1 --- [PollingServerListUpdater-0] c.netflix.config.ChainedDynamicProperty : Flipping property: sonic-server-controller.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647 2022-06-02 10:17:14.987 INFO 1 --- [reactor-http-epoll-2] c.netflix.config.ChainedDynamicProperty : Flipping property: sonic-server-folder.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647 2022-06-02 10:17:14.989 INFO 1 --- [reactor-http-epoll-2] c.netflix.loadbalancer.BaseLoadBalancer : Client: sonic-server-folder instantiated a LoadBalancer: DynamicServerListLoadBalancer:{NFLoadBalancer:name=sonic-server-folder,current list of Servers=[],Load balancer stats=Zone stats: {},Server stats: []}ServerList:null 2022-06-02 10:17:14.990 INFO 1 --- [reactor-http-epoll-2] c.n.l.DynamicServerListLoadBalancer : Using serverListUpdater PollingServerListUpdater 2022-06-02 10:17:15.013 INFO 1 --- [reactor-http-epoll-2] c.netflix.config.ChainedDynamicProperty : Flipping property: sonic-server-folder.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647 2022-06-02 10:17:15.014 INFO 1 --- [reactor-http-epoll-2] c.n.l.DynamicServerListLoadBalancer : DynamicServerListLoadBalancer for client sonic-server-folder initialized: DynamicServerListLoadBalancer:{NFLoadBalancer:name=sonic-server-folder,current list of Servers=[10.10.220.138:8097],Load balancer stats=Zone stats: {unknown=[Zone:unknown; Instance count:1; Active connections count: 0; Circuit breaker tripped count: 0; Active connections per server: 0.0;] },Server stats: [[Server:10.10.220.138:8097; Zone:UNKNOWN; Total Requests:0; Successive connection failure:0; Total blackout seconds:0; Last connection made:Thu Jan 01 08:00:00 CST 1970; First connection made: Thu Jan 01 08:00:00 CST 1970; Active Connections:0; total failure count in last (1000) msecs:0; average resp time:0.0; 90 percentile resp time:0.0; 95 percentile resp time:0.0; min resp time:0.0; max resp time:0.0; stddev resp time:0.0] ]}ServerList:org.springframework.cloud.zookeeper.discovery.ZookeeperServerList@2a0023e7 2022-06-02 10:17:15.993 INFO 1 --- [PollingServerListUpdater-0] c.netflix.config.ChainedDynamicProperty : Flipping property: sonic-server-folder.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647 2022-06-02 11:30:54.915 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1384ms for session id 0x102de511e050000 2022-06-02 11:30:55.202 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102de511e050000 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1384ms for session id 0x102de511e050000 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 11:30:55.309 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 11:30:56.481 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 11:30:56.481 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 11:30:56.482 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:54530, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 11:30:56.484 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Unable to reconnect to ZooKeeper service, session 0x102de511e050000 has expired 2022-06-02 11:30:56.484 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 11:30:56.485 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102de511e050000 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x102de511e050000 has expired at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1434) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 11:30:56.485 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@10b892d5 2022-06-02 11:30:56.485 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 11:30:56.486 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 11:30:56.487 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 11:30:56.487 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102de511e050000 2022-06-02 11:30:56.489 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 11:30:56.489 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 11:30:56.490 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:54534, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 11:30:56.491 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102de511e05000c, negotiated timeout = 2000 2022-06-02 11:30:56.492 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 11:30:56.500 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 12:00:55.077 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1544ms for session id 0x102de511e05000c 2022-06-02 12:00:55.078 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102de511e05000c for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1544ms for session id 0x102de511e05000c at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 12:00:56.005 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 12:00:56.602 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 12:00:56.602 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 12:00:56.603 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:54620, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 12:00:56.604 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Unable to reconnect to ZooKeeper service, session 0x102de511e05000c has expired 2022-06-02 12:00:56.605 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102de511e05000c for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x102de511e05000c has expired at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1434) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 12:00:56.604 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 12:00:56.605 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@10b892d5 2022-06-02 12:00:56.606 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 12:00:56.606 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 12:00:56.606 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 12:00:56.606 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102de511e05000c 2022-06-02 12:00:56.609 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 12:00:56.609 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 12:00:56.609 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:54624, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 12:00:56.611 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102de511e050014, negotiated timeout = 2000 2022-06-02 12:00:56.612 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 12:00:56.613 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {} 2022-06-02 12:02:30.046 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Client session timed out, have not heard from server in 1367ms for session id 0x102de511e050014 2022-06-02 12:02:30.047 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102de511e050014 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionTimeoutException: Client session timed out, have not heard from server in 1367ms for session id 0x102de511e050014 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1258) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 12:02:30.166 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: SUSPENDED 2022-06-02 12:02:32.089 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 12:02:32.089 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 12:02:32.090 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:54668, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 12:02:32.096 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Unable to reconnect to ZooKeeper service, session 0x102de511e050014 has expired 2022-06-02 12:02:32.096 WARN 1 --- [main-EventThread] org.apache.curator.ConnectionState : Session expired event received 2022-06-02 12:02:32.096 INFO 1 --- [main-EventThread] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.10.220.138:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@10b892d5 2022-06-02 12:02:32.096 WARN 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session 0x102de511e050014 for sever 10.10.220.138/10.10.220.138:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x102de511e050014 has expired at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1434) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.3.jar!/:3.6.3] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1290) ~[zookeeper-3.6.3.jar!/:3.6.3] 2022-06-02 12:02:32.097 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxnSocket : jute.maxbuffer value is 1048575 Bytes 2022-06-02 12:02:32.097 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : zookeeper.request.timeout value is 0. feature enabled=false 2022-06-02 12:02:32.097 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: LOST 2022-06-02 12:02:32.098 INFO 1 --- [main-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down for session: 0x102de511e050014 2022-06-02 12:02:32.100 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.10.220.138/10.10.220.138:2181. 2022-06-02 12:02:32.100 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : SASL config status: Will not attempt to authenticate using SASL (unknown error) 2022-06-02 12:02:32.100 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established, initiating session, client: /172.21.0.4:54672, server: 10.10.220.138/10.10.220.138:2181 2022-06-02 12:02:32.102 INFO 1 --- [main-SendThread(10.10.220.138:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.10.220.138/10.10.220.138:2181, session id = 0x102de511e05001e, negotiated timeout = 2000 2022-06-02 12:02:32.102 INFO 1 --- [main-EventThread] o.a.c.f.state.ConnectionStateManager : State change: RECONNECTED 2022-06-02 12:02:32.104 INFO 1 --- [main-EventThread] o.a.c.framework.imps.EnsembleTracker : New config event received: {}