Incident Report: 20200304: Difference between revisions
| Line 29: | Line 29: | ||
= Analysis = | = Analysis = | ||
A number of related and unrelated issues all happened at the same time: | |||
* Dolby CPU issues - potentially related, potentially not | |||
:* Caused by | |||
::* Bug in MyRadio causing the sso_session to grow quite a bit with lots of empty sessions | |||
::* Bug in Campus Playout putting it into a loop | |||
::* Other things? | |||
* Initial dead air - UNKNOWN CAUSE, thonking in progress (probably rednet) | |||
* RedNet 3 failure | |||
:* Known hardware/firmware issue, has happened before | |||
* About 9 minutes later, the grandmaster starts cycling - for, as far as we know so far, no good reason | |||
* Scarlett go fucky | |||
:* Probably caused by ADAT clock switch and double-clocking | |||
::* Caused by human error - mis-understanding of clocking | |||
* Hot coax | |||
:* Potential short or other electrical fault in the RedNet or Scarlett | |||
* Full recovery delayed due to issues with SelectorListener | |||
= Actions = | = Actions = | ||