hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Emmanuel Espina <espinaemman...@gmail.com>
Subject Re: Can Yarn AppMaster move Container logs to hdfs?
Date Mon, 10 Feb 2014 19:53:44 GMT
Sorry when I said log running I meant LONG running, that is, a service, not
a batch job


2014-02-10 16:49 GMT-03:00 Emmanuel Espina <espinaemmanuel@gmail.com>:

> I'm building a custom YARN app where the App Master is a log running
> service that can start jobs in containers.
>
> The ideal situation for us would be to be able to move all the logs
> produced by each container to hdfs. The aggregation options that yarn
> provides does this but only after the app master finishes (and in our case
> it never finishes).
>
> Is there any way of doing this?
>
> Thanks
> Emmanuel
>

Mime
View raw message