You can add alerts on summary metrics - and you can have up to five summary metrics on a plugin.
If you are consuming a published plugin, you get alerts on whatever summary metrics the plugin author selected. If you are authoring a plugin, you can pick up to five metrics to be your summary metrics, then you can create alert thresholds on those metrics.
