How to stream log output to response

[mjallday]

Trying to figure out the easiest way to stream log output to the response since building is a slow process.

I'm thinking of

1. Spin up a process and write data to a log file on disk and then read the file back as it's written.
2. Spin up a background thread via gevent and run the builder there and pass a logger to it. Kind like https://stackoverflow.com/questions/24892418/background-thread-logging-to-a-server-sent-event-stream-in-a-flask-app

        messages_to_yield = []

        if result['build']:
            builder = forms.background_build(
                result['organization'], result['name'], result['commit'],
                log_stream=logger
            )

        class Handler(logging.Handler):

            def emit(self, record):
                msg = self.format(record)
                messages_to_yield.append(msg)

        logger.addHandler(Handler())

        def iterate_response():
            import time
            builder.start_build()
            while builder.building:
                time.sleep(1)
                for msg in messages_to_yield.pop():
                    yield msg

        return api.Response(app_iter=iterate_response())

Any opinions about the simplest way to do this?

[mjallday]

currently implemented via gevent thread. probably better served as a worker task running in the background.