Alerts › rules. Kinds sit under the tags. Custom metric is one tick. None ticked still means every kind.
Open Alerts › rules and press + rule. Under kinds, tick custom metric and leave the others clear. That kind is a POST that reported down, or a post that never arrived inside the grace. None ticked still means every kind. The address is typed and not added yet. Type and tags left empty cover every machine.
Press add contact. The grey sentence reads: tell email ops@example.com when a warning or worse (custom metric) opens on 6 machines in Example Co, and again when it resolves. Press add rule when that sentence is the one you want. This shot stops before that. A later edit of the same rule is Change an alert rule.
A rule for every kind is Tell someone when a machine needs attention. A failing check is Only tell them about a failing check. A reboot is Only tell them about a reboot. Creating the URL a command posts to is Add a custom metric. A yes or no status is Add a yes or no custom metric. A script that starts when a metric goes down is Run a script only when a custom metric goes down.