9
edits
Changes
Jump to navigation
Jump to search
Line 1:
Line 1: − {{Incident+ − |brief=Switch reboot took down DNS, which brooke'd selector − |severity=Moderate − |impact=High (Dead air for around 45 minutes) − |start=2020-05-11 05:00 − |end=2020-05-11 05:46 − |mitigation=Reduce dependency on uplink − |leader=Connor Sanders (CS) − |others=Isaac Lowe (IL), Marks Polakovs (MP) − }} − + − At 05:00:00, our IT Services uplink switch, urysw4, rebooted for a regularly scheduled update (that nobody was aware of because we weren't on the ITS comms list).+ + + − AutoSwitcher had started dutifully doing the news at 04:59:45, and was preparing to finish doing the news at 05:02:00. It tried to switch back from WebStudio (the news is layered over a silent WebStudio source... don't ask) to Jukebox, but it found that, since our uplink was down, it couldn't reach the campus DNS servers, thus couldn't resolve ''selector.york.ac.uk'', and thus couldn't switch back.+ − That left us with an empty WebStudio source broadcasting. Liquidsoap detected the silence (and sent a rather beautiful "Source 0 was on air" silence email), but couldn't switch back to Jukebox for the same reason. The switch finished rebooting at 05:04:30, but we were stuck on dead air. Dearie-Me, for some inexplicable reason, didn't fire until 5:10 (presumably static was keeping it from hitting the threshold), and CS woke up and saw the alerts at 05:37, before switching back to Jukebox at 05:46 and investigating with the assistance of IL.+ − + − * Reduce dependency on upstream services+ − :* Investigate a local caching DNS resolver?+ − :* '''MP - done-ish, running unbound on uryfw0 and many (but not all boxes use it)''' − * Ask ITS nicely to tell us when they take down our campus uplink − :* '''MP - done''' − * Ask ITS nicely to make it reboot at xx:30 instead of xx:00 − :* '''MP - done''' − * Improve documentation and logging of the new WebStudio services, to make future troubleshooting easier − * Figure out why Dearie-Me didn't fire - possibly needs a recalibrate − * Reduce log spamminess of Dearie-Me, it filled up its journald buffer quite quickly − == Timings ==+ − HH:MM:SS+ − Dead air start: 05:02:06.500 − Dead air end: 05:45:42.000 − TOTAL: 00:43:35.500 − + + + + + + + + + + + + + + + + + + + +
no edit summary
This is the general '''URY timeline''', arranged by decade.
== Summary ==
== 60s ==
* ''1960: The UK's first student radio station is founded as Crush Radio (but it doesn't legally broadcast for a while)''.
* '''1967''': URY is founded as the UK's first ''legal'' independent broadcasting radio station, as Radio York under a test licence from the BBC.
* '''1969''': Radio York is refounded as University Radio York and opened with a guest broadcast by John Peel.
== 70s ==
* '''1976''': URY hosted the National Association of Students broadcasters 5th Annual College, Goodricke College, Saturday 31st of January to Sunday 1st of February.
== Reoccurrence mitigation ==
== 80s ==
== 90s ==
*'''1998''' URY celebrates its 30th birthday by a Restricted Service Licence (RSL), broadcasting on FM for four weeks to the city of York as well as campus.
*'''1999''' URY moves from an induction loop system on campus to the current Low Power AM (LPAM) transmitter, enabling a stronger signal on campus and more listeners. URY's frequency changes from 999kHz to the current 1350kHz.
*'''1999''' To celebrate the turn of the millenium URY compiles the "Ultimate Student Chart" with "Bohemian Rhapsody" named the No.1 song. The station also organised its first gig featuring local and national bands called "Spark".
[[Category:Incident Reports]]
== 00s ==
* '''2005''': URY wins the SRA Award for Best Student Station.
*'''2008''': URY celebrates its 40th birthday with a 2 week FM broadcast in May.
== 10s ==
* '''2011''': URY joins the UK Radioplayer service as one of the first stations to do so.
* '''2012''': URY moves to a larger webcaster licence. At the same time, Tom Whitehouse ends his long tenure as Honorary President and is replaced.
* '''2013''': URY wins 7 Student Radio Awards out of 9 nominations.
* '''2014''': URY wins Best Journalistic Programming at the Student Radio Awards with its coverage or river safety.
* '''2018''': URY celebrates its 50th Anniversary. (maybe don't trust the years at the top of this page)
* '''2018''': We won a grant from the alumni for £40,000 to upgrade our studios.
== 20s ==
* '''2020''': The pandemic happened, and we moved to a year of remote broadcasting from home.
* '''2020''': URY won Gold for Best Student Radio Station at the Student Radio Awards.
[[Category:URY History]]