Live Status\Incident History

October 23, 2022

Failed Execution

Minor Outage

Opened: Oct 23, 2022, 3:27 PM UTC

Duration: 56min 17sec


  • Opened
    Oct 23, 2022, 3:27 PM UTC

    Incident opened on monitor failure.

  • Identified
    Oct 23, 2022, 3:31 PM UTC

    Issue with Azure VM detected. Working on resolving. ~Kyle S.

  • Resolved
    Oct 23, 2022, 4:23 PM UTC

    Incident resolved on monitor recovery.

September 14, 2022

Auth Engine Transaction Processing Offline

Minor Outage

Opened: Sep 14, 2022, 8:41 AM UTC

Duration: 1hr 13min 18sec


  • Identified
    Sep 14, 2022, 8:40 AM UTC

    Currently working on resolving issues with Auth Engine not responding. ~Kyle S. USIO

  • Resolved
    Sep 14, 2022, 9:54 AM UTC

    After rebooting host server, we were able to diagnose the issue and bring services back online. Thank you, ~Kyle S. USIO

July 16, 2022

Auth Engine Transaction Processing Offline

Minor Outage

Opened: Jul 16, 2022, 6:47 AM UTC

Duration: 7hrs 7min 1sec


  • Opened
    Jul 16, 2022, 6:47 AM UTC

    Incident opened on monitor failure.

  • Identified
    Jul 16, 2022, 1:24 PM UTC

    Our processor Fiserv is under a maintenance window that is preventing them from sending transactions to our Authorization Engine for approval or denial on our system. However, they are processing transactions in stand-in based on balance updates that send to Fiserv every 30 minutes, and previously defined stand-in rules. Debit cards will work and follow previously configured stand in instructions from Fiserv side. I have verified that there are active transactions being processed. I have also verified that there are multiple teams working on this issue from Fiserv's end. ~Kyle S.

  • Resolved
    Jul 16, 2022, 1:54 PM UTC

    It would appear that Fiserv has corrected the issues, we are now receiving transactions for processing again. ~Kyle S.

June 21, 2022

System Database Connectivity Issue

Outage

Opened: Jun 21, 2022, 7:22 PM UTC

Duration: 12hrs 43min


  • Opened
    Jun 21, 2022, 7:22 PM UTC

    Incident opened on monitor failure.

  • Monitoring
    Jun 21, 2022, 8:37 PM UTC

    Systems have been restored and are functioning normally again. We are monitoring all services manually as well as via automated means. Kyle S. USIO

  • Resolved
    Jun 22, 2022, 8:05 AM UTC

    Incident resolved on monitor recovery.

Response Assertion Failed

Outage

Opened: Jun 21, 2022, 6:16 PM UTC

Duration: 2hrs 9min 9sec


  • Opened
    Jun 21, 2022, 6:16 PM UTC

    Incident opened on monitor failure.

  • Investigating
    Jun 21, 2022, 7:07 PM UTC

    We are currently experiencing an outage have and have engaged Azure Support. Kyle S. USIO

  • Resolved
    Jun 21, 2022, 8:25 PM UTC

    Incident resolved on monitor recovery.

Site Unreachable

Outage

Opened: Jun 21, 2022, 6:30 AM UTC

Duration: 50min 51sec


  • Opened
    Jun 21, 2022, 6:30 AM UTC

    Incident opened on monitor failure.

  • Resolved
    Jun 21, 2022, 7:12 AM UTC

    Incident resolved on monitor recovery.

  • Unresolved
    Jun 21, 2022, 7:13 AM UTC

    Incident re-opened on monitor failure.

  • Monitoring
    Jun 21, 2022, 7:16 AM UTC

    Our 3rd-party DNS and firewall provider, CloudFlare, is currently experiencing an outage that is impacted our services. Because of this outage you may experience intermittent connectivity issues while accessing the following services: Akimbo Apps API, Card Services API, Debit Card Portal. CloudFlare is aware of the issue and has identified the root cause. They are currently implementing a fix for this issue. You can monitor their progress here: https://www.cloudflarestatus.com/

  • Resolved
    Jun 21, 2022, 7:22 AM UTC

    CloudFlare has resolved the issue and it does appear all of our services are accessible at this time. We will continue to monitor.

June 20, 2022

Failed Execution

Outage

Opened: Jun 20, 2022, 3:46 PM UTC

Duration: 5hrs 48min 4sec


  • Opened
    Jun 20, 2022, 3:46 PM UTC

    Incident opened on monitor failure.

  • Investigating
    Jun 20, 2022, 3:58 PM UTC
  • Identified
    Jun 20, 2022, 4:04 PM UTC

    VPN issue has come back up. Our MSP and Fiserv support have been engaged. Kyle S. USIO

  • Monitoring
    Jun 20, 2022, 4:22 PM UTC

    VPN is now back online and we are processing transactions. Following through with Fiserv and MSP to verify logs to see if we can determine cause. Kyle S. USIO.

  • Resolved
    Jun 20, 2022, 9:34 PM UTC

    Incident resolved on monitor recovery.

June 17, 2022

Fiserv VPN Connection Offline

Outage

Opened: Jun 17, 2022, 3:51 AM UTC

Duration: 10hrs 55min 27sec


  • Opened
    Jun 17, 2022, 3:51 AM UTC

    Incident opened on monitor failure.

  • Investigating
    Jun 17, 2022, 4:19 AM UTC

    Initial call has come in from Fiserv and Active Alert monitoring has alerted to Networking issue. Investigating currently. ~Kyle S. USIO

  • Identified
    Jun 17, 2022, 5:10 AM UTC

    Identified outage with third party processor. Investigation is occurring on their end, they are in the middle of restoring service to a large number of customers, we appear to be affected by this service outage. ~Kyle S.

  • Identified
    Jun 17, 2022, 5:55 AM UTC

    Update from Fiserv, we are not part of their global outage issues. Our VPN Client appears to be unresponsive. I have also engaged our MSP and will follow up with more updates soon. ~Kyle S. USIO.

  • Identified
    Jun 17, 2022, 9:28 AM UTC

    Fiserv Network Engineering has escalated this issue to both their advanced networking team and their firewall team. They are currently investigating from their end. ~Kyle S. USIO

  • Identified
    Jun 17, 2022, 12:34 PM UTC

    Usio and Fiserv network engineers are continuing to troubleshoot the VPN connection. - Jeff F.

  • Monitoring
    Jun 17, 2022, 2:36 PM UTC

    Usio and Fiserv engineers have restored the VPN connection and are monitoring the Auth Engine's processing of transactions. - Jeff F.

  • Resolved
    Jun 17, 2022, 2:46 PM UTC