Right now, there is no option for setting alerts for high CPU/Memory/Disk usage on Apps. Only basic monitoring is available. We should be able to set Alert policies for Apps as well, not only Droplets.