Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: Aaron Baff <Aaron.Baff@telescope.tv>
To: "common-user@hadoop.apache.org" <common-user@hadoop.apache.org>
Date: Thu, 18 Aug 2011 09:26:37 -0700
Subject: RE: NPE in TaskLogAppender
Thread-Topic: NPE in TaskLogAppender
Thread-Index: Acxdqwv4kATbm71fTZqpgp6XWWDmvAADENYAAAL94XA=
Message-ID: 
 <DEC9971F0504A54784C9664B469E53F1032A81977C7C@valkyrie.telescope.local>
References: <4E370C97-1541-4FDA-8456-1067DDDC4D77@thelastpickle.com>
 <2D6932E0-4008-4830-B244-06B4EBA46CEF@thelastpickle.com>
 <90277DA4E50D484288A46526AFBD1AE9E7B8FE3A@msxaoa7.twosigma.com>
In-Reply-To: <90277DA4E50D484288A46526AFBD1AE9E7B8FE3A@msxaoa7.twosigma.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Yes, we had this issue, we simply grabbed the latest log4j jar file, and co=
pied it over on top of the existing one. See https://issues.apache.org/jira=
/browse/MAPREDUCE-2378


-----Original Message-----
From: Isaac Dooley [mailto:Isaac.Dooley@twosigma.com]
Sent: Thursday, August 18, 2011 8:00 AM
To: common-user@hadoop.apache.org
Subject: RE: NPE in TaskLogAppender

I've had this problem on linux with 20.203. It occured when a map or reduce=
 task would mess around with log4j configurations. Basically, I had to crea=
te a modified TaskManager that would set some environment variables that wo=
uld keep my code's static blocks from reconfiguring log4j.


-----Original Message-----
From: aaron morton [mailto:aaron@thelastpickle.com]
Sent: Thursday, August 18, 2011 9:30 AM
To: common-user@hadoop.apache.org
Subject: Re: NPE in TaskLogAppender

An update incase anyone else has this problem. It looks like an issue with =
competing log4j configurations that could be resolved by using Logger Repos=
itories. I've updated a thread in the brisk user group http://groups.google=
.com/group/brisk-users/msg/619b5ebba2fb0e89

Has anyone else had this problem ?

Cheers

-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com

On 15/08/2011, at 2:04 PM, aaron morton wrote:

> I'm running the Cassandra Brisk server with Haddop core 20.203 on OSX, ev=
erything is local.
>
> I keep running into this problem for Hive jobs
>
> INFO 13:52:39,923 Error from attempt_201108151342_0001_m_000001_1: java.l=
ang.NullPointerException
>       at org.apache.hadoop.mapred.TaskLogAppender.flush(TaskLogAppender.j=
ava:67)
>       at org.apache.hadoop.mapred.TaskLog.syncLogs(TaskLog.java:264)
>       at org.apache.hadoop.mapred.Child$4.run(Child.java:261)
>       at java.security.AccessController.doPrivileged(Native Method)
>       at javax.security.auth.Subject.doAs(Subject.java:396)
>       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupIn=
formation.java:1059)
>       at org.apache.hadoop.mapred.Child.main(Child.java:253)
>
> The only info I've found online was http://www.mail-archive.com/common-us=
er@hadoop.apache.org/msg12829.html
>
> Just for fun I tried...
> * setting mapred.acls.enabled to true
> * setting mapred.queue.default.acl-submit-job and mapred.queue.default.ac=
l-administer-jobs to *
>
> There was no discernible increase in joy though.
>
> Any thoughts ?
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Cassandra Developer
> @aaronmorton
> http://www.thelastpickle.com
>