|
|
| Line 1: |
Line 1: |
| − | '''PLEASE EVACUATE THE BUILDING SAFELY AND UPDATE SOCIAL MEDIA BEFORE ATTEMPTING TO RESTORE SERVICE''' | + | This is the general '''URY timeline''', arranged by decade. |
| | | | |
| − | ''This is a ops-critical document. A printed copy is available in the Server Cupboard and should be updated whenever this online version is.''
| + | == 60s == |
| | | | |
| − | So, you've done a full shutdown. Or, there was a power cut or zombie apocalypse that interrupted the ability of our physical servers to operate. The good news is that you now thing you're ready to turn things back on.
| + | * ''1960: The UK's first student radio station is founded as Crush Radio (but it doesn't legally broadcast for a while)''. |
| | + | * '''1967''': URY is founded as the UK's first ''legal'' independent broadcasting radio station, as Radio York under a test licence from the BBC. |
| | + | * '''1969''': Radio York is refounded as University Radio York and opened with a guest broadcast by John Peel. |
| | | | |
| − | ''Remember - during any power failure it is advised to immediately switch off the transmitter. See [[Shutting Down URY in a Hurry]].''
| + | == 70s == |
| | | | |
| − | == Before You Start - Is It Safe Checklist ==
| + | * '''1976''': URY hosted the National Association of Students broadcasters 5th Annual College, Goodricke College, Saturday 31st of January to Sunday 1st of February. |
| − | * Is power back on yet? Has it been stable for a few minutes? | |
| − | * Has the Head of Computing or Station Manager given consent to restoring service?
| |
| − | * Does information from Estates, YUSU or other relevant sources suggest all is okay?
| |
| − | * [Preferred] If you are going to re-start AM Transmission, have you got consent from the Chief Engineer to power on the transmitter audio path?
| |
| − | * [Preferred] Do you have at least two technical team members on site (ideally one engineer)?
| |
| | | | |
| − | Great - lets give this a go.
| + | == 80s == |
| | | | |
| − | == Network Infrastructure == | + | == 90s == |
| − | We got all these servers right? Well they ain't no good until there's a network. You do this stage in [[The Hub]].
| + | *'''1998''' URY celebrates its 30th birthday by a Restricted Service Licence (RSL), broadcasting on FM for four weeks to the city of York as well as campus. |
| | | | |
| − | * Power on urysw3 (The HP ProCurve 2626 [The top one]) | + | *'''1999''' URY moves from an induction loop system on campus to the current Low Power AM (LPAM) transmitter, enabling a stronger signal on campus and more listeners. URY's frequency changes from 999kHz to the current 1350kHz. |
| − | * Power on urysw1 (The Netgear GS748T [The bottom one])
| |
| | | | |
| − | Have both of these switched on? Is urysw3 blinking happily? Is urysw1 looking like nothing much is happening? Perfect.
| + | *'''1999''' To celebrate the turn of the millenium URY compiles the "Ultimate Student Chart" with "Bohemian Rhapsody" named the No.1 song. The station also organised its first gig featuring local and national bands called "Spark". |
| | | | |
| − | == Stores Power == | + | == 00s == |
| − | Our power supply gets a little upset very easily. If this outage was caused by a power cut, chances are you'll want to use this section to restore power to the [[Server Cupboard]] circuit.
| |
| | | | |
| − | * Ensure the Transmitter is switched OFF (if it wasn't already, you aren't very good at reading this guide) | + | * '''2005''': URY wins the SRA Award for Best Student Station. |
| − | * Ensure the AM compressor is switched OFF
| |
| − | * Ensure the output compressor is switched OFF
| |
| − | * Ensure the AM Receiver is switched OFF
| |
| | | | |
| − | If you don't do this, then the initial inrush of power from turning on a rack full of equipment will overload the B16 breaker. It will make a noise as things try to turn on, give you a little fright, then promptly trip again. Possibly with a bright flash of light for dramatic effect.
| + | *'''2008''': URY celebrates its 40th birthday with a 2 week FM broadcast in May. |
| | | | |
| − | * [Two People Required] Turn on the breaker labelled "metal clad sockets"
| + | == 10s == |
| − | * If it did not do so automatically, switch on the UPS
| |
| − | * Turn the AM '''Receiver''' back on and ensure it is still tuned to 1350AM
| |
| − | * Turn the lower output compressor back ON (third box from the top)
| |
| | | | |
| − | The UPS will now begin charging. If it is fully depleted, it will be around 5 minutes before it will enable output power to the servers. Depending on the BIOS configuration, some may then start to automatically boot. Avoid this, if at all possible.
| + | * '''2011''': URY joins the UK Radioplayer service as one of the first stations to do so. |
| | + | * '''2012''': URY moves to a larger webcaster licence. At the same time, Tom Whitehouse ends his long tenure as Honorary President and is replaced. |
| | + | * '''2013''': URY wins 7 Student Radio Awards out of 9 nominations. |
| | + | * '''2014''': URY wins Best Journalistic Programming at the Student Radio Awards with its coverage or river safety. |
| | + | * '''2018''': URY celebrates its 50th Anniversary. (maybe don't trust the years at the top of this page) |
| | + | * '''2018''': We won a grant from the alumni for £40,000 to upgrade our studios. |
| | | | |
| − | == Critical Servers == | + | == 20s == |
| − | We identify critical servers as those that enable us to broadcast on AM. URY Policy states that we must have '''two''' operating loggers before restoration of AM service. You'll also want the jukebox to play some noise.
| + | * '''2020''': The pandemic happened, and we moved to a year of remote broadcasting from home. |
| | + | * '''2020''': URY won Gold for Best Student Radio Station at the Student Radio Awards. |
| | | | |
| − | * Power on [[jukebox]] in [[The Hub]]
| + | [[Category:URY History]] |
| − | * Power on [[logger1]]
| |
| − | * Power on [[logger2]]
| |
| − | * Power on [[uryred]]
| |
| − | * Power on [[uryblue]]
| |
| − | * On logger1, run `/usr/local/etc/rc.d/audiolog.sh start`
| |
| − | * On logger2, run `/etc/rc3.d/S40audiolog start`. You may also need to `modprobe es1370`
| |
| − | * Power on [[uryfw0]]
| |
| − | | |
| − | If at any stage you are unhappy with the noises, smells, or LED blink patterns on logger1 or logger2, '''stop''', turn that machine back off, and come back to it. If both are not running, you will need to investigate this before you continue - uryred is not currently considered a stable logger so is not a valid substitute. Generally, they'll work when you try again a little later (they don't like being cold).
| |
| − | | |
| − | Jukebox should boot up happily, and the station will start outputting a loop of Monty Python's ''Intermission'', occasionally overlaid with a grammatically incorrect technical difficulties message from Alex Boyall.
| |
| − | | |
| − | == AM Broadcast ==
| |
| − | You can't start this section until at least 5-10 minutes after following ''Critical Servers''. It might be worth skipping to ''Core Computing Services'' and coming back in a bit. It also requires permission from the Chief Engineer.
| |
| − | | |
| − | * '''Two persons''' must '''separately check and verify''' that '''at least two''' logger services are operating correctly and have recorded the last 5 minutes of station output (or in the case of an AM logger, several minutes of static).
| |
| − | * Switch on the AM compressor (second box from the top)
| |
| − | * Switch on the AM Transmitter
| |
| − | | |
| − | If any of the following tests fail, '''switch off the transmitter immediately''' and follow [[Transmitter Troubleshooting]]
| |
| − | * Are all four power indicators on the left lit?
| |
| − | * Is the fan on the rear of the unit spinning?
| |
| − | * Is the forward power meter registering approximately 20W?
| |
| − | * Is the reflected power meter registering a negligible level (2-3W is okay, slightly more if it's damp outside)?
| |
| − | * Is the AM receiver showing 3 signal bars on its display?
| |
| − | | |
| − | * After 5 minutes, two people should then check the AM loggers.
| |
| − | | |
| − | == Core Computing Services ==
| |
| − | Core Computing Services are defined as those which must be operational for URY to broadcast anything other than [[iTones]] (or, at this point, Intermission).
| |
| − | | |
| − | * Power on [[uryfs1]] and [[themis]]
| |
| − | * '''Wait''' for uryfs1 to finish booting as most other systems are dependent on it
| |
| − | * Run `mount -t ext4 /dev/sdb1 /music` on uryfs1
| |
| − | * Power on [[ury]]
| |
| − | * Fade up jukebox in [[Studio 1]], then switch to S1 then back to S3
| |
| − | ** This ensures selector state is up to date
| |
| − | | |
| − | That's the absolute basics. Themis is also pretty much optional, but as it provides some authentication and DNS services, it's best we bring it up too. Now verify the following are accessible and functioning:
| |
| − | | |
| − | * http://ury.org.uk/
| |
| − | * https://ury.org.uk/myury/
| |
| − | * https://ury.org.uk/sis2/
| |
| − | * https://ury.org.uk/roundcube/ (including sending test emails both internally and externally)
| |
| − | ** It is possible that mta.york.ac.uk is not yet back online, or that it is but refuses to route mail. You can test this with good ol' `telnet mta.york.ac.uk 25`
| |
| − | * http://ury.org.uk/live/
| |
| − | * live-high, live-mobile, live-high-ogg, jukebox and campus-playout streams are visible at http://uryfs1.york.ac.uk:7070/
| |
| − | * iTones should now be playing music instead of intermission. If not, try remounting manually or restarting share daemons on uryfs1
| |
| − | * BAPS (studio1, studio2 and production services)
| |
| − | * Timelord (will probably need an `F5` on jukebox)
| |
| − | * myradio_daemon
| |
| − | | |
| − | We're now at a point where shows can go on and things will mostly be okay.
| |
| − | | |
| − | == Additional Servers ==
| |
| − | Power on other systems:
| |
| − | * urybsod
| |
| − | ** Use https://urybsod.york.ac.uk/xymon/ to monitor other services
| |
| − | ** https://ury.org.uk/loggerng/ should now be available
| |
| − | * copperbox
| |
| − | ** http://copperbox.york.ac.uk/ should now be available
| |
| − | ** Webcams should now be available (motion and camd may need manually restarting)
| |
| − | * urybackup0
| |
| − | ** Run `zfs mount -a`, `service nfsd restart`, `service mountd restart`
| |
| − | ** Windows and backup filestores should now be available. Mount the backup filestores on ury and uryfs1.
| |
| − | * uryrrod
| |
| − | ** Only provides mixclouder service, will have no immediate noticable impact
| |
| − | | |
| − | == Nearly Done ==
| |
| − | Everything should be bright and cheery again now. You should now complete a full incident report, making it available online in [[:Category:Incident Reports]] and sending it to computing@ury.org.uk, engineering@ury.org.uk and management@ury.org.uk.
| |
| − | | |
| − | Ideally, you'd also act on any recommendations this review brings up to make things run better in future.
| |
| − | | |
| − | [[Category:Technical How-Tos]]
| |