Skip to content
This repository has been archived by the owner on Mar 28, 2024. It is now read-only.

[BUG-230592] Group chat conversations still randomly fail since update to simulator version 2021-03-31.557694 #8231

Closed
1 task
sl-service-account opened this issue Apr 16, 2021 · 7 comments

Comments

@sl-service-account
Copy link

sl-service-account commented Apr 16, 2021

What just happened?

This issue is the continuous presence of what has been described in https://jira.secondlife.com/browse/BUG-230576 However, while it has been suspected there that the issue was about "only" that "group chat subscriptions were failing due to service issues", thus those affected weren't able to receive and initiate group chat conversations, and eventually on that day group chat conversations started working properly for me, the issue returned yesterday (15 April), after one day. I ran new tests with my main (this account) and an alt, and I collected information of several aspects of the issue. Overall, the current situation is entirely random, and you might or might not happen to receive any group chat messages, related to but not depending on the aspects that could be examined (and described below).

This issue occurs in a disturbingly high volume since the introduction of simulator version 2021-03-31.557694 and "Recent updates to the group chat system" https://community.secondlife.com/forums/topic/470224-recent-updates-to-the-group-chat-system/

Previously, the same issues occurred in August 2020 https://jira.secondlife.com/browse/BUG-229219 and September 2020 https://jira.secondlife.com/browse/BUG-229371 (for a large number of user accounts at different times between August and November 2020).

Main symptoms (malfunctions):

  1. The viewer failing to subscribe to receive group chat automatically on login
  2. Being unable to manually initiate a group chat conversation by opening it and trying to send a message
  3. Two different accounts receive parts or the entire group chat conversation differently - either missing a few messages of one that the other account received, or one account didn't receive the conversation at all, even if manually opened the conversation before.
  4. The feature to block the entire group chat participant list from being sent to the viewer randomly fails. (More in detail below.)
  5. Changing region does affect whether these issues occur or not (similarly to how it has been in last August). After teleporting or crossing regions, group chat can start to fail for the agent, even if it was working quite properly before the region change.

The situation in more detail:

Since 15 April, 12:36 SLT, after relogging with this account of mine, the issue of not receiving group chat conversations started again, after less than 24 hours of working properly after the previous issues. At that point I logged in with an alt to do tests again, and the alt was unable to receive and initiate conversations as well. Initially, the common pattern in the failing group chat delivery was that, on both my main and alt, that the full participant lists got sent to the viewer (despite not being a moderator in those groups, and online group members well over 10, which is the intended limit). In group conversations where the full list got sent to me, I wasn't able to see or send chat with either account, initially, while those that showed the participant list "as intended", worked properly. I've run different scenarios, in which either my main or alt initiated a group chat session, where either or both of them got the entire participant list of the conversation, or the intended cut list, then also refreshed group profile, closed and reopened the group conversation, and started the test again, and then also relogged with both accounts and did the same tests again. The overall result is that this participant list blocking feature is entirely inconsistent now at best, and in the worst case scenario, it might be the cause of the failed group chat subscription on login. If not the blocking of the full list from being sent, then something else that was accidentally affected while implementing this feature, which is even more likely.

Other than that, I tried to examine other aspects of the problem as well, and got to the following conclusions (in accordance with the "main symptoms" I listed above):

  1. It is random whether a group chat conversation is getting sent to the account after logging in. After relogging with both accounts, my alt got a group conversation popping up, where my main is also a member, and didn't get the conversation until opening the conversation manually. So the group chat subscription on login randomly fails.

  2. There is one group (SL Aviation), where my main got the full chat participant list during all of these tests while not being a moderator. After relogging, it still shows the full list. My alt has received the full list as well, initially, and persistently after refreshing group profile and reopening the conversation, however, after relogging, unlike my main, it only gets the cut list with only moderators showing, as intended. Another person in that group chat confirmed that she also received the full participant list despite not being a moderator, and it persisted for her over closing chat, refreshing group profile, and reopening chat as well. This means the feature that is supposed to block the participant list from being sent to those that shouldn't receive them, is unreliable and only randomly works.

  3. While initially it seemed to be a consistent pattern, and a correlation that if the account got the full participant list while it shouldn't have, it would mean it is unable to receive or send messages in that group chat, it turned out within 10 minutes of testing that it isn't the case, and there is no direct correlation between these two aspects. You can get the full participant lists while you shouldn't, and be able to receive and send group chat messages at the same time.

  4. During the tests, I stayed with both accounts in the same region they were in (a different region for either of them) for the entire time. While writing point 3 above, I had to teleport out to another region with my main to check on something. Right after the teleport, my main stopped receiving group chat messages (in opened conversations as well), that my alt (still in the region it has been in the whole time) kept getting. Then I teleported to another region with my alt too, and this caused my alt from receiving chat as well, and even in my own group with only my main and alt, my main now cannot send messages in that group chat, my alt can send messages that my main gets, though. After closing the conversation with my main, refreshing the group profile, reopening the conversation, my main can send messages in the group which my alt can see but my main can't, and my alt can still send messages that only my alt can see this time, so my main cannot see anything in the conversation. This means changing simulator does correlate with the failure of group chat delivery, and after changing regions, the simulator doesn't recognize the agent being present there.

Additional findings to the failure of blocking the participant list from being sent: Today (16 April), after several logoffs and logins with my main and alt accounts, I have the same one group (SL Aviation) where I get the full participant list sent to my main account (while not being a moderator, and yes, online members are well over 10), and, on my alt it appears to be consistently blocked from being sent, and only the moderators show in the list, as intended by the Lab. On my main, however, it appears to be consistently showing the full list despite it shouldn't. It also shows the previous apparent correlation today, that my alt that is getting the list as intended, can participate in the conversation of that group, while my main, receiving the full list, cannot see any messages, either sent by her or someone else.

Additional findings to the group chat subscription failure: Continuing the pattern found yesterday, it is entirely random whether you receive a group chat conversation automatically after login. While I kept my two accounts logged in for several hours again, only 4 group chat conversations "popped up" automatically for my 2 accounts altogether, 2 for the main and 2 for the alt. 1 that popped up for my alt was the SL Aviation group's conversation, where my main is a member as well, and didn't receive the conversation at all. After manually opening the conversation while it was still ongoing, my main still didn't receive any messages and was unable to see her own messages sent as well. This means the current situation today is worse than it was yesterday.

Additional opinion regarding the role of the simulator: While most of the aspects of this issue happen apparently regardless of where the agent is located inworld, as I explained above, when eventually group chat started to work quite properly for both of my accounts yesterday during running my tests, teleporting to another region instantly affected the behavior of group chat, and the failures started again. This leads us back to August 2020, when this issue got to the surface in a very intense manner. Almost everyone had these same issues at the same time, especially after teleporting or moving into another region, but not exclusively. It happened also while staying in the same region after logging in. The same thing is happening now, but apparently in a smaller scale yet, affecting less accounts at once. It is not only about the automatic subscription to receiving group chat when logging in, since the issue persists through several logins, and starts happening again randomly either if you stay in the same region where you logged in and originally received the group conversations, or if you changed region since you logged in. The root of the issue must be within the communication between the simulator servers, the group chat servers, and the viewers, originating from some malfunction in how the simulator processes agent data, mostly whether the agent's online status is being updated to the group chat servers. I can't look into it to confirm it and show you proof. On the user end, this is the only explanation that makes sense, especially since this issue, along with others, massively resurfaced right after the changes discussed here: https://community.secondlife.com/blogs/entry/5560-whoosh-what%E2%80%99s-up-with-region-crossings/

What were you doing when it happened?

Logged out at 12:33 SLT on 15 April 2021, and logged in again at 12:36 SLT. While group chat conversations got delivered to this account quite properly before 12:33, after logging in at 12:36, the failures started again.

What were you expecting to happen instead?

Getting some nice weather in real life. Seriously, it is the middle of April, and it's still like December where I live. It's not fun. And then we have this massive issue with group chat as well, while it should work much more reliably.

Other information

Attachments

Links

Related

Original Jira Fields
Field Value
Issue BUG-230592
Summary Group chat conversations still randomly fail since update to simulator version 2021-03-31.557694
Type Bug
Priority Unset
Status Closed
Resolution Duplicate
Reporter AlettaMondragon (alettamondragon)
Created at 2021-04-16T17:25:10Z
Updated at 2021-04-19T19:22:01Z
{
  'Build Id': 'unset',
  'Business Unit': ['Platform'],
  'Date of First Response': '2021-04-16T20:15:22.999-0500',
  'ReOpened Count': 0.0,
  'Severity': 'Unset',
  'System': 'SL Simulator',
  'Target Viewer Version': 'viewer-development',
  'What just happened?': 'This issue is the continuous presence of what has been described in https://jira.secondlife.com/browse/BUG-230576 However, while it has been suspected there that the issue was about "only" that "group chat subscriptions were failing due to service issues", thus those affected weren\'t able to receive and initiate group chat conversations, and eventually on that day group chat conversations started working properly for me, the issue returned yesterday (15 April), after one day. I ran new tests with my main (this account) and an alt, and I collected information of several aspects of the issue. Overall, the current situation is entirely random, and you might or might not happen to receive any group chat messages, related to but not depending on the aspects that could be examined (and described below).\r\n\r\nThis issue occurs in a disturbingly high volume since the introduction of simulator version 2021-03-31.557694 and "Recent updates to the group chat system" https://community.secondlife.com/forums/topic/470224-recent-updates-to-the-group-chat-system/\r\n\r\nPreviously, the same issues occurred in August 2020 https://jira.secondlife.com/browse/BUG-229219 and September 2020 https://jira.secondlife.com/browse/BUG-229371 (for a large number of user accounts at different times between August and November 2020).\r\n\r\nMain symptoms (malfunctions):\r\n1) The viewer failing to subscribe to receive group chat automatically on login\r\n2) Being unable to manually initiate a group chat conversation by opening it and trying to send a message\r\n3) Two different accounts receive parts or the entire group chat conversation differently - either missing a few messages of one that the other account received, or one account didn\'t receive the conversation at all, even if manually opened the conversation before.\r\n4) The feature to block the entire group chat participant list from being sent to the viewer randomly fails. (More in detail below.)\r\n5) Changing region does affect whether these issues occur or not (similarly to how it has been in last August). After teleporting or crossing regions, group chat can start to fail for the agent, even if it was working quite properly before the region change.\r\n\r\nThe situation in more detail:\r\n\r\nSince 15 April, 12:36 SLT, after relogging with this account of mine, the issue of not receiving group chat conversations started again, after less than 24 hours of working properly after the previous issues. At that point I logged in with an alt to do tests again, and the alt was unable to receive and initiate conversations as well. Initially, the common pattern in the failing group chat delivery was that, on both my main and alt, that the full participant lists got sent to the viewer (despite not being a moderator in those groups, and online group members well over 10, which is the intended limit). In group conversations where the full list got sent to me, I wasn\'t able to see or send chat with either account, initially, while those that showed the participant list "as intended", worked properly. I\'ve run different scenarios, in which either my main or alt initiated a group chat session, where either or both of them got the entire participant list of the conversation, or the intended cut list, then also refreshed group profile, closed and reopened the group conversation, and started the test again, and then also relogged with both accounts and did the same tests again. The overall result is that this participant list blocking feature is entirely inconsistent now at best, and in the worst case scenario, it might be the cause of the failed group chat subscription on login. If not the blocking of the full list from being sent, then something else that was accidentally affected while implementing this feature, which is even more likely.\r\n\r\nOther than that, I tried to examine other aspects of the problem as well, and got to the following conclusions (in accordance with the "main symptoms" I listed above):\r\n\r\n 1) It is random whether a group chat conversation is getting sent to the account after logging in. After relogging with both accounts, my alt got a group conversation popping up, where my main is also a member, and didn\'t get the conversation until opening the conversation manually. So the group chat subscription on login randomly fails.\r\n\r\n2) There is one group (SL Aviation), where my main got the full chat participant list during all of these tests while not being a moderator. After relogging, it still shows the full list. My alt has received the full list as well, initially, and persistently after refreshing group profile and reopening the conversation, however, after relogging, unlike my main, it only gets the cut list with only moderators showing, as intended. Another person in that group chat confirmed that she also received the full participant list despite not being a moderator, and it persisted for her over closing chat, refreshing group profile, and reopening chat as well. This means the feature that is supposed to block the participant list from being sent to those that shouldn\'t receive them, is unreliable and only randomly works.\r\n\r\n3) While initially it seemed to be a consistent pattern, and a correlation that if the account got the full participant list while it shouldn\'t have, it would mean it is unable to receive or send messages in that group chat, it turned out within 10 minutes of testing that it isn\'t the case, and there is no direct correlation between these two aspects. You can get the full participant lists while you shouldn\'t, and be able to receive and send group chat messages at the same time.\r\n\r\n4) During the tests, I stayed with both accounts in the same region they were in (a different region for either of them) for the entire time. While writing point 3 above, I had to teleport out to another region with my main to check on something. Right after the teleport, my main stopped receiving group chat messages (in opened conversations as well), that my alt (still in the region it has been in the whole time) kept getting. Then I teleported to another region with my alt too, and this caused my alt from receiving chat as well, and even in my own group with only my main and alt, my main now cannot send messages in that group chat, my alt can send messages that my main gets, though. After closing the conversation with my main, refreshing the group profile, reopening the conversation, my main can send messages in the group which my alt can see but my main can\'t, and my alt can still send messages that only my alt can see this time, so my main cannot see anything in the conversation. This means changing simulator does correlate with the failure of group chat delivery, and after changing regions, the simulator doesn\'t recognize the agent being present there.\r\n\r\nAdditional findings to the failure of blocking the participant list from being sent: Today (16 April), after several logoffs and logins with my main and alt accounts, I have the same one group (SL Aviation) where I get the full participant list sent to my main account (while not being a moderator, and yes, online members are well over 10), and, on my alt it appears to be consistently blocked from being sent, and only the moderators show in the list, as intended by the Lab. On my main, however, it appears to be consistently showing the full list despite it shouldn\'t. It also shows the previous apparent correlation today, that my alt that is getting the list as intended, can participate in the conversation of that group, while my main, receiving the full list, cannot see any messages, either sent by her or someone else.\r\n\r\nAdditional findings to the group chat subscription failure: Continuing the pattern found yesterday, it is entirely random whether you receive a group chat conversation automatically after login. While I kept my two accounts logged in for several hours again, only 4 group chat conversations "popped up" automatically for my 2 accounts altogether, 2 for the main and 2 for the alt. 1 that popped up for my alt was the SL Aviation group\'s conversation, where my main is a member as well, and didn\'t receive the conversation at all. After manually opening the conversation while it was still ongoing, my main still didn\'t receive any messages and was unable to see her own messages sent as well. This means the current situation today is worse than it was yesterday.\r\n\r\nAdditional opinion regarding the role of the simulator: While most of the aspects of this issue happen apparently regardless of where the agent is located inworld, as I explained above, when eventually group chat started to work quite properly for both of my accounts yesterday during running my tests, teleporting to another region instantly affected the behavior of group chat, and the failures started again. This leads us back to August 2020, when this issue got to the surface in a very intense manner. Almost everyone had these same issues at the same time, especially after teleporting or moving into another region, but not exclusively. It happened also while staying in the same region after logging in. The same thing is happening now, but apparently in a smaller scale yet, affecting less accounts at once. It is not only about the automatic subscription to receiving group chat when logging in, since the issue persists through several logins, and starts happening again randomly either if you stay in the same region where you logged in and originally received the group conversations, or if you changed region since you logged in. The root of the issue must be within the communication between the simulator servers, the group chat servers, and the viewers, originating from some malfunction in how the simulator processes agent data, mostly whether the agent\'s online status is being updated to the group chat servers. I can\'t look into it to confirm it and show you proof. On the user end, this is the only explanation that makes sense, especially since this issue, along with others, massively resurfaced right after the changes discussed here: https://community.secondlife.com/blogs/entry/5560-whoosh-what%E2%80%99s-up-with-region-crossings/ ',
  'What were you doing when it happened?': 'Logged out at 12:33 SLT on 14 April 2021, and logged in again at 12:36 SLT. While group chat conversations got delivered to this account quite properly before 12:33, after logging in at 12:36, the failures started again.',
  'What were you expecting to happen instead?': "Getting some nice weather in real life. Seriously, it is the middle of April, and it's still like December where I live. It's not fun. And then we have this massive issue with group chat as well, while it should work much more reliably.",
  'Where': 'Everywhere, as all regions are now running on Second Life Server 2021-03-31.557694',
}
@sl-service-account
Copy link
Author

Lucia Nightfire commented at 2021-04-17T01:15:23Z

Every single day now I have problems with many of my groups not opening when people are chatting or not seeing my own chat, particularly with these NSFW groups:

secondlife:///app/group/edce068e-47bd-e76d-a43d-4d8bde07c6d6/about and secondlife:///app/group/9736cd29-3b5f-7e65-866d-a4c422ad7697/about

which are chatty groups with activity at all hours of the day or night.

@sl-service-account
Copy link
Author

Desirae Beaumont commented at 2021-04-18T10:35:43Z

I have the same problem since Thursday April 15.

I can't send and receive any messages in my own group for my music venue, what is not exactly helping with shows.

Group: secondlife:///app/group/191949c2-4aea-b195-b06e-5fb8b3344d02/about

 

@sl-service-account
Copy link
Author

Skell Dagger commented at 2021-04-18T21:43:14Z

Confirming that this has been happening to both me and another moderator in the Catwa Head Friends group - secondlife:///app/group/29c5ca14-7e13-fdf0-c531-2507844a1eef/about

The last chat that I have in my history is from 14th April at approximately 4:30pm SLT. Since then it's been radio silence, and this is a very busy group. We have five moderators, three of whom are able to see the chat and the participants list, whereas the other two of us are unable to see any chat (even our own) or anyone except ourselves in the participant list.

Testing performed thus far by me with an alt who is also a group member but not a moderator as follows.

Test 1, carried out on 17th April:

Skell:

  • Relog

  • On login, group chat does not pop up automatically

  • Does not initiate an IM to the group

    Alt:

  • Alt initiates a new IM to the group after Skell has relogged, and checks the sidebar listing of people.

  • Expected behaviour: alt should see listing of self, plus all moderators who currently have the group chat window actively open (this should be all moderators except Skell and one other who was offline at the time, as I'd asked the online mods in advance who currently had the chat open and they all did)

  • Alt sees self and all online moderators - Skell included - in the list, even though chat did not pop up for Skell and he didn't initiate an IM with the group. Alt also saw listed the other moderator who only sees herself listed when initiating a group chat, even though she did not have chat open

  • Closes the group chat window

    Skell:

  • Initiates an IM with the group. Opens the participants list and sees only himself listed there

  • Closes the group chat window

    Alt:

  • Initiates a new IM with the group and checks the sidebar listing of people

  • Now sees self and online moderators. Skell is no longer in the list

    From this it's possible to surmise that when Skell relogs he actually does somehow join the group chat (it pops up on login but he doesn't see it), as he shows up in the listing for the alt, but that the group chat does not register with him/his account/his viewer/whatever. It is only when he initiates a chat and then manually closes it that he disappears from the list of people in the chat.

    Test 2, carried out on 18th April:

    Skell:

  • Logs in

  • No chat pops up

  • Asks fellow moderators if they see him in the participants list. They do not

  • Initiates an IM with the group, then opens participant list

  • Only sees self listed there

    I then tried to send something into the chat. My text vanished when I hit 'enter'. It did not appear in the chat window, but people who were in the chat saw it. A second message ended up the same: missing from my window, but seen by others in chat.

    Intermittent and persistent issues prior to this complete 'chat shutdown' have included:

  • me seeing responses by my fellow moderators to questions that I'm not able to see (and I don't see any text by the person they're helping) and vice versa where they see my responses to someone whose questions they are unable to see

  • customers in chat not seeing their own text and repeating their questions multiple times

  • customers seeing their questions but not seeing any responses from moderators, even though several different moderators are replying to them

@sl-service-account
Copy link
Author

Gingir Ghoststar commented at 2021-04-18T23:33:13Z

Same issue. My store alt can see and chat in every group she is in. My main though cannot. Not any group. Also sometimes I only see myself active in group when I know I'm not because I can see more people and all the chatter from my alt account. It does not matter which viewer I'm in. Both Firestorm and SL viewer are having this issue. Both are updated. I even uninstalled and reinstalled. No love. 

@sl-service-account
Copy link
Author

Mister Acacia commented at 2021-04-19T02:31:04Z

https://lindenlab.freshdesk.com/support/tickets/1683919 

@sl-service-account
Copy link
Author

MarissaOrloff commented at 2021-04-19T05:54:15Z, updated at 2021-04-19T05:56:56Z

I'm borked as well and placed a support ticket also #1705364. This outage is effecting all but one of my groups which much much more than previous group chat outages.

@sl-service-account
Copy link
Author

Maestro Linden commented at 2021-04-19T19:22:02Z

We are aware of this issue. Please see https://twitter.com/SLGridStatus/status/1384194253207662605

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant