tag:status-canada.sendbird.com,2005:/historySendbird Canada Status - Incident History2024-03-27T21:49:57-05:00Sendbird Canadatag:status-canada.sendbird.com,2005:Incident/200020702024-03-21T04:05:56-05:002024-03-21T04:05:56-05:00Major version upgrade of the database (bi-yearly)<p><small>Mar <var data-var='date'>21</var>, <var data-var='time'>04:05</var> CDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>21</var>, <var data-var='time'>04:00</var> CDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>13:17</var> CST</small><br><strong>Scheduled</strong> - Date and Time:<br />- Mar 21st 09:00 - 09:15 UTC<br />- Mar 21st 04:00 - 04:15 Central Time<br />- Mar 21st 18:00 - 18:15 KST<br /><br />Duration of downtime: 15 minutes<br /><br />Purpose: major version upgrade of the database (bi-yearly)<br /><br />Service impact:<br />- Full outage (APIs will get 5xx errors) during the downtime<br />- Announcements, GDPR will be stopped for an hour beforehand<br /><br />Affected product: Chat, Desk</p>tag:status-canada.sendbird.com,2005:Incident/201856282024-03-07T09:03:05-06:002024-03-07T09:03:05-06:00Elevated API Errors<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>09:03</var> CST</small><br><strong>Resolved</strong> - The servers have returned operational.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>09:01</var> CST</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>tag:status-canada.sendbird.com,2005:Incident/198660712024-01-30T06:00:51-06:002024-01-30T06:00:52-06:00Elevated API Errors<p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>06:00</var> CST</small><br><strong>Resolved</strong> - The servers have returned operational.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>05:59</var> CST</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>tag:status-canada.sendbird.com,2005:Incident/191774802023-11-20T02:56:34-06:002023-11-20T02:56:34-06:00Elevated API Errors<p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>02:56</var> CST</small><br><strong>Resolved</strong> - The servers have returned operational.</p><p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>02:55</var> CST</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>tag:status-canada.sendbird.com,2005:Incident/181368322023-08-13T21:54:41-05:002023-08-14T11:59:45-05:00Increase in 500 error responses to API requests<p><small>Aug <var data-var='date'>13</var>, <var data-var='time'>21:54</var> CDT</small><br><strong>Resolved</strong> - The servers have returned operational.<br /><br />[Incident Report]<br />When: 21:45 - 21:54 CDT August 13 (11:45 - 11:54 KST August 14; 02:45 - 02:54 GMT August 14)<br />Impact: Majority of API requests received 500 error responses.<br />Root cause: A backend service was restarted to enable new functionality, and did not properly authenticate to necessary resources on startup due to invalid logic.<br />Remediation:<br />- Immediately addressed authentication issue to successfully restore normal operations.<br />- Remove unnecessary logic that caused the error situation since it is not necessary<br />- Implement further validation and error condition handling.</p><p><small>Aug <var data-var='date'>13</var>, <var data-var='time'>21:45</var> CDT</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>tag:status-canada.sendbird.com,2005:Incident/180443332023-08-03T14:16:34-05:002023-08-03T14:16:34-05:00Elevated API Errors<p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>14:16</var> CDT</small><br><strong>Resolved</strong> - The servers have returned operational.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>14:14</var> CDT</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>tag:status-canada.sendbird.com,2005:Incident/92083362022-01-31T23:52:45-06:002022-01-31T23:52:45-06:00Elevated API Errors<p><small>Jan <var data-var='date'>31</var>, <var data-var='time'>23:52</var> CST</small><br><strong>Resolved</strong> - The servers have returned operational.</p><p><small>Jan <var data-var='date'>31</var>, <var data-var='time'>23:51</var> CST</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>tag:status-canada.sendbird.com,2005:Incident/86955612021-11-26T06:50:40-06:002021-11-26T06:50:41-06:00Elevated API Errors<p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>06:50</var> CST</small><br><strong>Resolved</strong> - The servers have returned operational.</p><p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>06:49</var> CST</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors and are currently looking into the issue.</p>