hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dino Kečo <dino.k...@gmail.com>
Subject Re: MapReduce logs
Date Wed, 21 Nov 2012 19:31:16 GMT

We had similar requirement and we built small Java application which gets
information about task nodes from Job Tracker and download logs into one
file using URLs of each task tracker.

For huge logs this becomes slow and time consuming.

Hope this helps.

Dino Kečo
msn: xdinno@hotmail.com
mail: dino.keco@gmail.com
skype: dino.keco
phone: +387 61 507 851

On Wed, Nov 21, 2012 at 7:55 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi,
> When we run a MapReduce job, the logs are stored on all the tasktracker
> nodes.
> Is there an easy way to agregate all those logs together and see them
> in a single place instead of going to the tasks one by one and open
> the file?
> Thanks,
> JM

View raw message