hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Binglin Chang <decst...@gmail.com>
Subject Re: MapReduce: Read the logs
Date Thu, 08 Nov 2012 01:57:37 GMT
Just watch logs in jobtracker & history UI isn't enough for you?


On Thu, Nov 8, 2012 at 9:44 AM, Jean-Marc Spaggiari <jean-marc@spaggiari.org
> wrote:

> Hi,
>
> When I run a MapReduce job, the userlogs are stored on each Datanode.
>
> Like: ~/hadoop_drive/hadoop/mapred/local/userlogs/job_201211011005_0018
>
> Under this directory I have on subdirectory per job, like:
> drwx------ 2 hadoop hadoop 4096 nov  5 12:46
> attempt_201211011005_0018_m_000010_0
> drwx------ 2 hadoop hadoop 4096 nov  5 12:46
> attempt_201211011005_0018_m_000016_0
> drwx------ 2 hadoop hadoop 4096 nov  5 12:46
> attempt_201211011005_0018_m_000017_0
> drwx------ 2 hadoop hadoop 4096 nov  5 12:46
> attempt_201211011005_0018_m_000021_0
>
> Now, I want to take a look at all the logs. Is there an easy way to
> retrieve them? Or do I need to log in each single node and look at
> each directory of each task?
>
> I would like to put all the logs into a single file.
>
> Thanks,
>
> JM
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message