Resolved
This incident has been resolved.
Monitoring
We've confirmed the issue with our cloud provider and have put in place our own mitigations.
Systems are healthy and we'll resolve incident when our underlying provider indicates resolution.
Identified
We see an ongoing issues with underlying worker nodes and despite limited customer impact are updating to degraded state until this is recolved.
Identified
We saw degradation from approximately 14:22 PM Pacific to 14:32 PM Pacific, then partial recovery.
We've identified an underlying issue in one availability zone we utilize in the cloud and are working on further mitigations.
Expect potential delay in webhooks while they catch up.
Investigating
We are currently investigating this issue.