hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Loddengaard" <a...@cloudera.com>
Subject Re: Debugging / Logging in Hadoop?
Date Thu, 30 Oct 2008 17:34:51 GMT
Arun gave a great talk about debugging and tuning at the Rapleaf event.
 Take a look:
<http://www.vimeo.com/2085477>

Alex

On Thu, Oct 30, 2008 at 6:20 AM, Malcolm Matalka <
mmatalka@millennialmedia.com> wrote:

> I'm not sure of the correct way, but when I need to log a job I have it
> print out with some unique identifier and then just do:
>
> for i in list of each box; do ssh $i 'grep -R PREFIX path/to/logs'; done
> > results
>
> It works well in a pinch
>
> -----Original Message-----
> From: Scott Whitecross [mailto:scott@dataxu.com]
> Sent: Wednesday, October 29, 2008 22:14
> To: core-user@hadoop.apache.org
> Subject: Debugging / Logging in Hadoop?
>
> I'm curious to what the best method for debugging and logging in
> Hadoop?  I put together a small cluster today and a simple application
> to process log files.  While it worked well, I had trouble trying to
> get logging information out.  Is there any way to attach a debugger,
> or get log4j to write a log file?  I tried setting up a Logger in the
> class I used for the map/reduce, but I had no luck.
>
> Thanks.
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message