9:24 AM - 9:29 AM UTC (5min duration)
The issue was resolved by our infrastructure provider. Everything should be back to normal.
3:27 PM - May 19 6:06 AM UTC (3d 14h 39min duration)
This incident has been resolved by our infrastructure provider. We haven't seen any networking issues since then.
12:59 PM - 1:19 PM UTC (20min duration)
API failing to return market data
The release was reverted. We have updated the registry and released an updated API version.
4:15 PM - 6:01 PM UTC (1h 46min duration)
The issue was fully resolved, and API is fully operational again.
3:02 PM - 3:08 PM UTC (6min duration)
Resolved by reverting the previous changes.
4:22 PM - 4:31 PM UTC (9min duration)
The issue was resolved, and API is fully operational again.
What happened? We released a significant change to our script registry in the development environment, which should not have affected the production environment. However, we inadvertently relied on the development instance of the script registry within the production environment of our API. This dependency caused a crash, which we identified through our incident response system. We quickly remedied the situation by reverting the changes to our development instance of the script registry. Next week, we will implement a permanent solution by removing any reliance on the development environment of the script registry in our production API. This issue was introduced unintentionally in a recent pull request.
2:48 PM - 4:42 PM UTC (1h 54min duration)
We've just finished upgrading our Governance Forum. https://gov.liqwid.finance/ is fully operational.