Everyday we have issue with random clients that catched in reconnect loop. After refresh page issue will temporary solve until next period. We enabled debug on client side and debug log on server side. But messages not so informative.
Centrifugo server version:
Centrifugo v1.5.1 (Go version: go1.6.2)
Centrifuog-js version:
1.3.7
How we subscribe to event on client side (part of source code):
$rootScope.centrifuge = new Centrifuge({
url: CrmSettings.centrifugoUrl + '/connection/websocket',
user: CrmSettings.centrifugo_token.userId.toString(),
timestamp: CrmSettings.centrifugo_token.timestamp.toString(),
token: CrmSettings.centrifugo_token.token
});
$rootScope.centrifuge.connect();
$rootScope.centrifuge.on('connect', function () {
$rootScope.subscription = {};
$rootScope.subscription['system-events'] = $rootScope.centrifuge.subscribe($rootScope.buildCentrifugoEventName('system-events'), function (message) {
$rootScope.handleSystemEvent(message.data);
});
});
Centrifugo config.json:
{
"secret": "REMOVED",
"web_password": "REMOVED",
"web_secret": "REMOVED",
"join_leave": true,
"anonymous": true,
"publish": true,
"watch": true,
"presence": true,
"history_size": 999999,
"history_lifetime": 1800,
"recover": true,
"history_drop_inactive": true
}
Server side log in debug level:
[I]: 2016/11/14 10:40:12 GET /connection/websocket from 178.213.225.4:51657 completed in 1.41373094s
[I]: 2016/11/14 10:40:13 New raw Websocket session established with uid a496a142-2f99-42ff-87f3-532c674df1f9
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[I]: 2016/11/14 10:40:14 GET /connection/websocket from 178.213.225.4:61754 completed in 22m32.814076042s
[I]: 2016/11/14 10:40:14 error sending to b07621ca-4365-4b1f-abce-a222c6c899bc write tcp 185.5.249.166:8000->178.213.225.4:61754: use of closed network connection
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[E]: 2016/11/14 10:40:14 client is closed
[I]: 2016/11/14 10:40:14 GET /connection/websocket from 178.213.225.4:51658 completed in 1.376436224s
[I]: 2016/11/14 10:40:15 New raw Websocket session established with uid 02bcacdf-139d-471d-8ac5-28f90d61167e
[I]: 2016/11/14 10:40:16 New raw Websocket session established with uid 785f8a4d-13c9-40b3-a358-9852b24f6936
Client side log when start reconnect loop:
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1454 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1429 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1443 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1966 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1271 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1789 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1336 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1115 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1436 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0h @ 9caf500….js:2109
9caf500….js:2109 Send Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Received Array[1]h @ 9caf500….js:2109
9caf500….js:2109 Status connecting -> connectedh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.mango-api-notification_13h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.mango-api-notification_23h @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.multiple-user-mode--clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.multiple-user-mode--servicesh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.clientsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--clients.tasksh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.clientsh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.visitsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.tasksh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.occupancyh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.sync--services.occupancy-per-weekh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--services.workloadh @ 9caf500….js:2109
9caf500….js:2109 last uid found and sent for channel production.updated--services.staffsh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.saleh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.sync--sales.sale-historyh @ 9caf500….js:2109
9caf500….js:2109 no last uid found for channel production.system-eventsh @ 9caf500….js:2109
9caf500….js:2109 Send Array[16]h @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 Received Objecth @ 9caf500….js:2109
9caf500….js:2109 disconnected: slow trueh @ 9caf500….js:2109
9caf500….js:2109 Status connected -> disconnectedh @ 9caf500….js:2109
9caf500….js:2109 reconnect after 1265 millisecondsh @ 9caf500….js:2109
9caf500….js:2109 start connectingh @ 9caf500….js:2109
9caf500….js:2109 Status disconnected -> connectingh @ 9caf500….js:2109
9caf500….js:2109 reset retries count to 0