Incident Report: 20200304: Difference between revisions

No edit summary
No edit summary
Line 23: Line 23:
* Took us a while to realise that the RedNet had failed (especially since the error is layer 7 it wouldn't trigger monitoring as that does layer 4)
* Took us a while to realise that the RedNet had failed (especially since the error is layer 7 it wouldn't trigger monitoring as that does layer 4)
* Switching clock input to ADAT was a mistake and delayed recovery quite substantially
* Switching clock input to ADAT was a mistake and delayed recovery quite substantially
* Little insight into what happened with the Scarlett, we saw some Jack errors, diagnosed probably hardware/driver error, and made call to reboot system in order to get back on air
:* journald is not set to persistent, so the only post-hoc logs we have are from after the reboot


== How We Got Lucky ==
== How We Got Lucky ==