tag:notificare.statuspage.io,2005:/historyNotificare Status - Incident History2023-09-03T14:52:32+02:00Notificaretag:notificare.statuspage.io,2005:Incident/159902582023-02-01T01:26:00+01:002023-02-01T01:26:00+01:00Database connectivity issues<p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>01:26</var> CET</small><br><strong>Resolved</strong> - Database connection was restored and all systems are working normal again</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>01:11</var> CET</small><br><strong>Monitoring</strong> - Database connection was restored and systems are working normal again, we are currently monitoring for any residual issues.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>01:09</var> CET</small><br><strong>Investigating</strong> - At 23:55 UTC, we've experienced a brief interruption in database connection, leading to increased response times.<br />We are investigating.</p>tag:notificare.statuspage.io,2005:Incident/110068472022-08-29T00:20:05+02:002022-08-29T00:20:14+02:00Timeouts on API calls<p><small>Aug <var data-var='date'>29</var>, <var data-var='time'>00:20</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>29</var>, <var data-var='time'>00:09</var> CEST</small><br><strong>Monitoring</strong> - API requests seem to be stable, we are continuing to keep monitoring</p><p><small>Aug <var data-var='date'>29</var>, <var data-var='time'>00:08</var> CEST</small><br><strong>Identified</strong> - We are seeing improvements in load times and will keep monitoring.</p><p><small>Aug <var data-var='date'>29</var>, <var data-var='time'>00:08</var> CEST</small><br><strong>Investigating</strong> - Since 22:45 tonight, we are experiencing timeouts on image loads. We are investigating.</p>tag:notificare.statuspage.io,2005:Incident/86788682021-11-24T11:15:29+01:002021-11-24T11:15:34+01:00Exports failing<p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>11:15</var> CET</small><br><strong>Resolved</strong> - Still some exports are failing, there was one worker that experienced file creation errors. This has been resolved and all exports are working as expected again.<br />Root cause of the failure has been identified and improvements have been made to prevent this type of failures in the future.</p>tag:notificare.statuspage.io,2005:Incident/86788222021-11-23T23:00:00+01:002021-11-24T11:11:18+01:00Exports failing<p><small>Nov <var data-var='date'>23</var>, <var data-var='time'>23:00</var> CET</small><br><strong>Resolved</strong> - Some clients are experiencing failed exports. The exports fail with an error when creating the export file.<br /><br />This turned out to be caused by a failing filesystem in one of the export workers, this has been resolved and all exports should be working as expected again.</p>tag:notificare.statuspage.io,2005:Incident/82795672021-10-21T04:30:00+02:002021-10-21T08:45:38+02:00Delayed exports<p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>04:30</var> CEST</small><br><strong>Resolved</strong> - We currently experience delayed processing of export jobs. Export jobs that use a short relative date span should be checked for having a different result than expected.</p>tag:notificare.statuspage.io,2005:Incident/71375682021-06-01T13:27:09+02:002021-06-01T13:27:09+02:00Import Jobs delayed<p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>13:27</var> CEST</small><br><strong>Resolved</strong> - Scheduled import jobs are running normal again. Root cause of the delay has been identified and improvements have been made to prevent this type of delays in the future.</p><p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>12:54</var> CEST</small><br><strong>Monitoring</strong> - All delayed scheduled import jobs have been processed, we are monitoring for any anomalies in upcoming schedules</p><p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>12:30</var> CEST</small><br><strong>Identified</strong> - We are investigating a couple of delayed scheduled import jobs, current import jobs are running nominal</p><p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>12:13</var> CEST</small><br><strong>Investigating</strong> - We are currently seeing a delayed processing of import jobs.</p>tag:notificare.statuspage.io,2005:Incident/63954752021-02-25T15:33:59+01:002021-02-25T15:33:59+01:00Cloud API Errors<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>15:33</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>13:24</var> CET</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>12:07</var> CET</small><br><strong>Monitoring</strong> - CloudAPI is working for all users, we are monitoring the situation</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>11:44</var> CET</small><br><strong>Update</strong> - CloudAPI request should be fixed for all users now, we are continuing to investigate the problem.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>10:26</var> CET</small><br><strong>Investigating</strong> - We're experiencing an elevated level of API errors in the Notificare Cloud API and are currently looking into the issue. This prevents a part of WebPush users in correctly registering their devices.</p>tag:notificare.statuspage.io,2005:Incident/45195042020-07-03T03:55:57+02:002020-07-03T03:55:57+02:00Demo app build delayed<p><small>Jul <var data-var='date'> 3</var>, <var data-var='time'>03:55</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'> 3</var>, <var data-var='time'>03:55</var> CEST</small><br><strong>Update</strong> - Demo app builds are up and running again.</p><p><small>Jul <var data-var='date'> 3</var>, <var data-var='time'>03:22</var> CEST</small><br><strong>Update</strong> - Demo app builds will resume shortly</p><p><small>Jul <var data-var='date'> 3</var>, <var data-var='time'>03:21</var> CEST</small><br><strong>Investigating</strong> - At the moment demo app builds are delayed. They will be picked up soon.</p>tag:notificare.statuspage.io,2005:Incident/35939452020-02-21T17:44:57+01:002020-02-21T17:44:57+01:00Import Jobs Delayed<p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>17:44</var> CET</small><br><strong>Resolved</strong> - Import jobs are running normal again.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>16:05</var> CET</small><br><strong>Monitoring</strong> - A fix as been implemented as we are currently monitoring the situation. More information will follow as soon as possible.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>15:51</var> CET</small><br><strong>Identified</strong> - We have identified the problem and we are currently working to fix the issue. We will update this thread as soon as we have more information.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>15:22</var> CET</small><br><strong>Investigating</strong> - We are currently investigating an issue with import jobs that is causing overall delays for all clients. We will come back with more info as soon as possible.</p>tag:notificare.statuspage.io,2005:Incident/32041052019-11-11T18:41:37+01:002019-11-11T18:41:37+01:00Automation delay<p><small>Nov <var data-var='date'>11</var>, <var data-var='time'>18:41</var> CET</small><br><strong>Resolved</strong> - Automations running normal again.</p><p><small>Nov <var data-var='date'>11</var>, <var data-var='time'>17:56</var> CET</small><br><strong>Monitoring</strong> - Automations have caught up again and we are currently monitoring the situation.</p><p><small>Nov <var data-var='date'>11</var>, <var data-var='time'>17:38</var> CET</small><br><strong>Investigating</strong> - We are currently experiencing a lag in the processing of automations, we have identified the problem and automations are expected to be up to date again soon</p>tag:notificare.statuspage.io,2005:Incident/30759822019-10-07T14:21:38+02:002019-10-07T14:21:38+02:00Stats lagging<p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>14:21</var> CEST</small><br><strong>Resolved</strong> - Stats have caught up and are running normal again.</p><p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>11:44</var> CEST</small><br><strong>Monitoring</strong> - Stats have caught up again and we are currently monitoring the situation.</p><p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>11:27</var> CEST</small><br><strong>Identified</strong> - We are currently experiencing slower reporting of statistics, we have identified the problem and stats are expected to be up to date again soon</p>tag:notificare.statuspage.io,2005:Incident/22439182019-03-06T19:54:00+01:002019-03-06T19:54:00+01:00Account creation problems<p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>19:54</var> CET</small><br><strong>Resolved</strong> - We have identified the problem with account creation and deployed a fix that corrects this issue. You should now be able to create accounts without any other hiccups.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>13:07</var> CET</small><br><strong>Investigating</strong> - We are currently investigating this issue, we will provide more information as soon as possible.</p>tag:notificare.statuspage.io,2005:Incident/16866472018-04-13T13:17:46+02:002018-04-13T13:17:46+02:00Data Processing Delays - Import Jobs Affected<p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>13:17</var> CEST</small><br><strong>Resolved</strong> - Due to an abnormal amount of jobs created, we are experiencing some delays while processing of import tasks. We have increased capacity to account for this demand and it should resume to normal waiting times shortly.</p><p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>12:15</var> CEST</small><br><strong>Investigating</strong> - Our data processing infrastructure is running behind which is causing delays in our job queues. No data has been lost and the system should be caught up shortly.</p>tag:notificare.statuspage.io,2005:Incident/16548722018-03-22T13:00:00+01:002018-03-22T13:00:00+01:00Data Processing Delays - Device Data Reports Affected<p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>13:00</var> CET</small><br><strong>Resolved</strong> - Our data processing infrastructure is running behind which is causing inaccuracies in the reporting tools. No data has been lost and the system should be caught up shortly.</p>