Service Disruption - Traffic Insights did not render protocol/services data in the UI in the AU1 cluster

Root Cause Analysis

Duration of incident

Discovered: Oct 21, 2024 15:03- UTC
Resolved: Oct 21, 2024 16:15- UTC

Cause

The recent refactoring of Traffic Insight Services inadvertently altered the offset management behavior.

Effect

This caused traffic identification to not render properly in the UI for clients in the AU1 cluster,

Action taken

All times in UTC

10/15/2024

15:01-15:35 Engineering is alerted to an issue involving traffic insight data for clients in the AU1 cluster not rendering correctly. Engineering begins its investigation. It is noted that traffic has not been rendered correctly since October 19 at approximately 10:00.

15:41-15:55 A solution to fix the problem is designed and implemented. Traffic insights data is appropriately rendered in the UI.

16:15 Traffic for data classification is confirmed flowing as it should over in the UI.

Future consideration(s)

• Timing of changes and a more thorough review process of results will be implemented for any future work performed on the affected services.