Incident Report: 20200511: Difference between revisions

No edit summary
 
Line 7: Line 7:
   |mitigation=Reduce dependency on uplink
   |mitigation=Reduce dependency on uplink
   |leader=Connor Sanders (CS)
   |leader=Connor Sanders (CS)
   |others=Isaac Lowe (IL)
   |others=Isaac Lowe (IL), Marks Polakovs (MP)
}}
}}


Line 22: Line 22:
* Reduce dependency on upstream services
* Reduce dependency on upstream services
:* Investigate a local caching DNS resolver?
:* Investigate a local caching DNS resolver?
:* '''MP - done-ish, running unbound on uryfw0 and many (but not all boxes use it)'''
* Ask ITS nicely to tell us when they take down our campus uplink
* Ask ITS nicely to tell us when they take down our campus uplink
:* '''MP - done'''
* Ask ITS nicely to make it reboot at xx:30 instead of xx:00
* Ask ITS nicely to make it reboot at xx:30 instead of xx:00
:* '''MP - done'''
* Improve documentation and logging of the new WebStudio services, to make future troubleshooting easier
* Improve documentation and logging of the new WebStudio services, to make future troubleshooting easier
* Figure out why Dearie-Me didn't fire - possibly needs a recalibrate
* Figure out why Dearie-Me didn't fire - possibly needs a recalibrate