Don't forget about about Sentry (https://getsentry.com/welcome/) which is also open source (https://github.com/getsentry/sentry) and can be self hosted. I've only used it with Python, but it has so far been infinitely better than the alternatives I've tried (probably because it's written in python). Integration with Flask is a 3-minute affair.
