This will be a big enhancement requirement here. But in my experience, I also have another bash script to set up the alerts. It is reasonable that this tool provide alerts setting up feature at the same time we push the metrics.