Details
-
Bug
-
Resolution: Fixed
-
Low
-
HCDC 3.1.2, HCDC 3.1.1
-
None
-
Severity 1 - Critical
Description
Summary
A message with a @mention of an offline/away user (or @all when at least one room participant is away/offline) is not delivered to the room members when Gearman is not running.
Environment
Hipchat Data Center
Steps to Reproduce
- Stop monit and gearman
sudo dont-blame-hipchat service monit stop service gearman-job-server stop
- Mention an offline user in a room
Expected Results
Other room members should see the message
Actual Results
- The message is not delivered to the other room users, it's not visible at all in the client.
- The message is visible to the sender
- Hard refresh the browser tab or logout/login and the message will be gone from the client
- The Tetra request fails with the following errors in /var/log/hipchat/tetra.log:
2017-12-28T17:09:17.832726+00:00 hipchat1 tetra-app-1: [tetra.controllers.muc_controller.handle_message_stanza#b5041d60-6f20-4ea8-8720-fb1019e048ce] Gearman - adding curler job: method=handle_room_mention_notification 2017-12-28T17:09:17.868648+00:00 hipchat1 tetra-app-1: [tetra.controllers.muc_controller.handle_message_stanza#b5041d60-6f20-4ea8-8720-fb1019e048ce] ALERT: Request failed: b5041d60-6f20-4ea8-8720-fb1019e048ce, func=tetra.controllers.muc_controller.handle_message_stanza, from=uid-216:web||proxy|172.16.116.156|5232, time=94ms, error=global name 'hostname' is not defined ... 2017-12-28T17:09:17.890550+00:00 hipchat1 tetra-app-1: [tetra.controllers.muc_controller.handle_message_stanza#b5041d60-6f20-4ea8-8720-fb1019e048ce] =====> Request failed: b5041d60-6f20-4ea8-8720-fb1019e048ce, in-progress=0, from=uid-216:web||proxy|172.16.116.156|5232, time=94ms, stanza=<message xmlns='jabber:client' proxy_received='2017-12-28T17:09:17Z 765873' to='1_eas@conf.btf.hipchat.com' type='groupchat' id='0'><body>@Mention </body></message>
Notes
- Gearman only handles offline notifications and any issues with it should not impact message delivery.
- Issue doesn't occur when the message doesn't contain an @mention or when all users mentioned are online.
Workaround
- Follow steps in Users are not receiving emails or push notifications on Data Center to start up Gearman.
- Reach out the support team for instructions on how to patch Tetra to not fail to deliver the message when Gearman is down.
Attachments
Issue Links
- is caused by
-
-
- Closed
-