Postmortem
Summary
On September 9, 2025, between approximately 12:10 pm ET and 12:40 pm ET, some multi-tenant administrators were unable to access the admin panel or use accounts API due to a configuration change that inadvertently disrupted traffic requests.
Duo engineering promptly reverted the change to restore service and resolve the issue.
Details
On September 9, Duo engineering executed a planned integration of two services related to the admin panel and billing. This integration aimed to reduce database load and address infrequent internal errors. Although the change was tested in lower environments, it was incompatible with the production region it targeted, causing issues when deployed in production.
Duo engineering promptly began reverting the change to address the errors and minimize customer impact. On the same day, the team implemented a fix to resolve the configuration incompatibilities.
Moving forward, Duo is enhancing our testing processes to identify incompatibilities before implementing approved changes and to reduce downtime for our customers.
We apologize for any disruption this may have caused.
Posted Sep 10, 2025 - 17:31 EDT
Resolved
The issue regarding login failures on cross deployment logins to the Duo Admin Panel has been resolved and functionality has been fully restored.
An RCA will be provided as soon as it is available.
Posted Sep 09, 2025 - 13:09 EDT
Monitoring
A fix has been deployed for the issue causing login failures on cross deployment logins to the Duo Admin Panel and we are monitoring the results.
Posted Sep 09, 2025 - 12:54 EDT
Identified
We have identified an issue causing login failures on cross deployment logins to the Duo Admin Panel on multiple deployments. We are working to correct the issue as soon as possible.
Posted Sep 09, 2025 - 12:44 EDT
This incident affected: DUO6 (Admin Panel), DUO1 (Admin Panel), DUO2 (Admin Panel), DUO3 (Admin Panel), DUO4 (Admin Panel), DUO5 (Admin Panel), DUO7 (Admin Panel), DUO8 (Admin Panel), DUO47 (Admin Panel), DUO10 (Admin Panel), DUO11 (Admin Panel), DUO12 (Admin Panel), DUO13 (Admin Panel), DUO14 (Admin Panel), DUO15 (Admin Panel), DUO16 (Admin Panel), DUO17 (Admin Panel), DUO18 (Admin Panel), DUO19 (Admin Panel), DUO20 (Admin Panel), DUO21 (Admin Panel), DUO22 (Admin Panel), DUO23 (Admin Panel), DUO24 (Admin Panel), DUO25 (Admin Panel), DUO26 (Admin Panel), DUO27 (Admin Panel), DUO28 (Admin Panel), DUO29 (Admin Panel), DUO30 (Admin Panel), DUO31 (Admin Panel), DUO32 (Admin Panel), DUO33 (Admin Panel), DUO34 (Admin Panel), DUO36 (Admin Panel), DUO37 (Admin Panel), DUO38 (Admin Panel), DUO39 (Admin Panel), DUO40 (Admin Panel), DUO41 (Admin Panel), DUO42 (Admin Panel), DUO43 (Admin Panel), DUO44 (Admin Panel), DUO45 (Admin Panel), DUO46 (Admin Panel), DUO48 (Admin Panel), DUO9 (Admin Panel), DUO49 (Admin Panel), DUO50 (Admin Panel), DUO51 (Admin Panel), DUO52 (Admin Panel), DUO53 (Admin Panel), DUO54 (Admin Panel), DUO55 (Admin Panel), DUO56 (Admin Panel), DUO57 (Admin Panel), DUO58 (Admin Panel), DUO59 (Admin Panel), DUO60 (Admin Panel), DUO62 (Admin Panel), DUO63 (Admin Panel), DUO64 (Admin Panel), DUO65 (Admin Panel), DUO66 (Admin Panel), DUO67 (Admin Panel), DUO68 (Admin Panel), DUO69 (Admin Panel), DUO70 (Admin Panel), DUO71 (Admin Panel), DUO72 (Admin Panel), DUO73 (Admin Panel), DUO74 (Admin Panel), DUO75 (Admin Panel), DUO76 (Admin Panel), DUO77 (Admin Panel), DUO78 (Admin Panel), DUO79 (Admin Panel), DUO80 (Admin Panel), DUO81 (Admin Panel), and DUO35 (Admin Panel).