Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/Computing-Hardware.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ Below is a list of computing resources we have available, as well as some links
</tbody>
</table>

Checks run every 10–15 minutes. Hover a status for details. A reading older than 30 minutes is shown as `unknown` rather than as a stale green light.
Checks run automatically — the timestamp shows when each host was last reached. Hover a status for details. A reading older than 90 minutes is shown as `unknown` rather than as a stale green light.

!!! note
A green light only means the machine answered on the network. It does not mean Slurm is healthy, that there is free disk space, or that your jobs are running. For Hyak-wide outages and maintenance, check [UW-IT Hyak status](https://status.uw.edu/).
Expand Down
9 changes: 8 additions & 1 deletion docs/javascripts/server-status.js
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,14 @@
(function () {
"use strict";

var STALE_MS = 30 * 60 * 1000; // cron runs every ~10 min; 30 min = missed 3
// Sized against what the probers actually deliver, not what they ask for.
// The GitHub Action requests */15 but is scheduled best-effort: across 20
// consecutive runs the observed gaps were 30-71 min (median 46), so every
// single interval blew through the original 30 min threshold and the lights
// sat at "unknown" most of each cycle. 90 min clears the worst observed gap
// with headroom. Once the in-network cron is running every 10 min it becomes
// the freshest source and this ceiling stops mattering in practice.
var STALE_MS = 90 * 60 * 1000;
var SOURCES = ["internal.json", "external.json"];

function fetchSource(base, name) {
Expand Down
6 changes: 5 additions & 1 deletion scripts/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -100,7 +100,11 @@ and that the lights on the handbook page go green within a few minutes.
- GitHub's scheduled workflows are best-effort: delayed under load, minimum
5-minute interval, and disabled automatically after 60 days without repo
activity. That is why the in-network cron is primary and the Action is only a
backstop.
backstop. Measured on this repo, the Action asks for `*/15` but lands every
30-71 minutes (median 46). The 90-minute stale threshold in
`docs/javascripts/server-status.js` is sized around that; if you tighten it,
make sure the in-network cron is actually running first, or the lights will
spend most of each cycle showing `unknown`.
- To add a host: add a probe in `check_servers.py` and a `<tr data-host="...">`
row in `docs/Computing-Hardware.md`. The JavaScript matches the two by name
and needs no change.
Loading