Watson Workspace will no longer be available after February 28, 2019. Learn more.

General Discussion

double messages in slack channel

Comments

20 comments

  • Avatar
    Jason
    @Greg - We have not seen this issue on our side but we will monitor this further and see if we can't reproduce. Appreciate the info.
  • Avatar
    Asher Budik

    so since 4:30AM, do all messages appear twice? or only a single message was delivered twice?

  • Avatar
    Greg Pflaum

    All messages, still happening.

  • Avatar
    Asher Budik

    can you please provide the messageid of the last message you saw duplicating?

    And, what about messages going from Slack to WS? all good there?

  • Avatar
    Greg Pflaum

    These are the latest double message in the Slack channel:

    https://ibm-analytics.slack.com/archives/ics-scm-team/p1481731180000049

    https://ibm-analytics.slack.com/archives/ics-scm-team/p1481731180000050

    I don't know how to get a message id from Workspace.

     

    Messages in Slack posted into Workspace are fine.

  • Avatar
    Greg Pflaum

    Here's that message in Workspace:


    <div id="58516c6ce4b04411521679db" class="ic-message ic-message-delivered" data-id="58516c6ce4b04411521679db" data-date="1481731180574" tabindex="0"><div class="ic-message-img"><div class="ic-message-avatar"><div class="ic-avatar-container  ic-avatar-person ic-is-avatar-face" title="Greg Pflaum" aria-label="" data-event="mouseover" data-for="avatarTooltip" style="height: 32px; width: 32px;"><img class="ic-avatar-face" src="//api.watsonwork.ibm.com/photos/97a45340-8f0a-1028-9ece-db07163b51b2?1481724760365" alt="Greg Pflaum"><span class="ic-avatar-initials" style="font-size: 12px;">GP</span></div></div></div><div class="ic-message-data"><div class="ic-message-meta ic-message-same-day"><span class="ic-person">You</span><span class="ic-timestamp"><span>10:59 AM</span></span></div><div class="ic-message-text"><p><span class=""><span>test 2 - ignore</span></span></p></div></div></div>

  • Avatar
    Greg Pflaum

    That was the last double message today. Two new messages in Workspace at 11:17 show normally (single message for each) in Slack.

  • Avatar
    Asher Budik

    space ID can also help,  it's from the address bar when your space is open

  • Avatar
    Greg Pflaum

    space id: 575e7613b6848a087c6b0cbb

  • Avatar
    Asher Budik

    Thank you Greg, I found the message. 
    It looks like Workspace produced 2 outbound events for the same message. 

    I will ask the outbound webhooks team too have a look.

  • Avatar
    Greg Pflaum (Edited )

    More duplicate messages today. Two messages were sent in Workspace 575e7613b6848a087c6b0cbb at 9:40am and 9:41am:

    5852ab4be4b056d1fe7bcbba
    5852ab7fe4b056d1fe7bcbd8

    They appeared immediately in Slack. Then, after almost 20 minutes, they appeared four more times in Slack. These are the times the two messages appeared in Slack:

    9:40:11 & 9:41:03
    10:03:03 & 10:03:03
    10:03:46 & 10:03:47
    10:06:23 & 10:06:26
    10:08:25 & 10:08:25
  • Avatar
    Greg Pflaum

    In the last few minutes, the integration posted dozens of messages into the slack channel. It looks like it sent the entire history of our workspace.

  • Avatar
    Kirti Gani

    Hi Greg, there was an issue with the outbound service that was just resolved, as a result, during the time of the problem, messages that would have been delivered to apps listening to a Space were queued up and delivered after the problem was resolved. 

  • Avatar
    Greg Pflaum

    That doesn't quite seem to cover what we saw around 12:30 PM EST today: Workspace messages from weeks ago were posted to the Slack channel.

  • Avatar
    Asher Budik

    I also see old messages sent again today in my mapped Slack channels.

  • Avatar
    JARED WALLACE

    I can confirm this happened as late as last night with my app. Checking the retry header shows it is indeed a retry - perhaps it's not waiting long enough for the 200 OK reply? (conversely, perhaps my app is just slow to respond?)

  • Avatar
    BRANDON KUTSCH

    We're seeing similar behavior when I try and integrate with slack
    days later we see what looks like a daily digest from the IWW Bot posting back into Slack channel

    in IWW we only see the messages once but over in slack its causing considerable noise with the multiple (repeated) message posts

  • Avatar
    Greg Pflaum

    We saw a flood of old messages sent from workspace to slack yesterday at 1:50am and 2:01am EST, and today at 5:31am and 5:38am.

  • Avatar
    David Brooks

    The issue is related to failures in one of our brokers and we are actively investigating why it resulted in a replay so this doesn't repeat. 

Please sign in to leave a comment.