Add New Relic heroku addon

[zbynekwinkler]

Would it make sense to get something like New Relics heroku addon?

https://newrelic.com/docs/python/python-agent-and-heroku
https://devcenter.heroku.com/articles/newrelic
https://addons.heroku.com/newrelic

Even with the free version it could provide us interesting data regarding the performance of the python and db parts.

[chadwhitacre]

We looked at this in #486. Do you have experience with New Relic in production?

[zbynekwinkler]

I don't :(. Actually I have no experience with heroku, just appengine. I just thought it might be less work than #1497 and get us something that informs us about the health of the site (like depth of the request queue). We have only Sentry for exceptions in this regard, right?

[zbynekwinkler]

I've added one more link to docs at the newrelic site - they seem to be the easiest to follow.
https://newrelic.com/docs/python/python-agent-and-heroku

[chadwhitacre]

@zwn I agree we need something for performance monitoring (#1497 is actually about analytics, which is different). If you want to give New Relic a shot I say go for it. :-)

[zbynekwinkler]

@whit537 It will not be right away but I will (we do need it). Do you know of a way how to test drive changes to the heroku setup? Like trying if adding the addon takes the site down and things like that. But don't worry, I let the honor be yours to do the final deploy 😄

[chadwhitacre]

@zwn Heroku recently added the ability to fork an app: https://devcenter.heroku.com/articles/fork-app. Maybe we can use that?

[chadwhitacre]

@zwn I am inclined to close this in favor of Librato (see #1569):

• It's much easier to integrate Librato (print to stdout) than New Relic (complex Python-level integration).
• Librato is prettier than New Relic.
• Librato gives us public dashboards.
• Librato gives us more control over what we're monitoring and the dashboards we produce.

Thoughts?

[zbynekwinkler]

Sure, sounds good. I just thought we need something.