This looks like it could be useful: https://github.com/Yelp/elastalert
This looks like it could be useful: https://github.com/Yelp/elastalert