Elevated deployment latency

Resolved

Partial outage

Started about 1 year agoJuly 15, 2025Lasted about 2 hoursJuly 15, 20254:265:55 PMUTC

Affected

Deployments (Railway Metal)

US West (Metal / California, USA)

US East (Metal / Virginia, USA)

EU West (Metal / Amsterdam, Netherlands)

Southeast Asia (Metal / SIngapore)

Updates

Resolved
July 15, 2025 at 5:55 PMUTC
Resolved
July 15, 2025 at 5:55 PMUTC
Our deployment pipeline throughput was impacted by a resource constraint on the database backing our Temporal cluster. We have increased cluster resources and upgraded the database; we have seen deployment throughput restored.
Monitoring
July 15, 2025 at 5:42 PMUTC
Monitoring
July 15, 2025 at 5:42 PMUTC
Queue backpresssure has significantly reduced, we have re-enabled non-pro deployments and are monitoring
Identified
July 15, 2025 at 5:15 PMUTC
Identified
July 15, 2025 at 5:15 PMUTC
Deployments are now processing as we're reducing the queue backpressure. We have halted some background operations to relieve deployment delays.
Update
July 15, 2025 at 5:00 PMUTC
Update
July 15, 2025 at 5:00 PMUTC
We continue to investigate the issue and have halted some active background operations to relieve the deployment delays
Investigating
July 15, 2025 at 4:26 PMUTC
Investigating
July 15, 2025 at 4:26 PMUTC
We are investigating a number of deploys that are stuck initializing. Non-Pro deployments have been temporarily paused.

Railway - Elevated deployment latency – Incident details