Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4D609173CA for ; Tue, 11 Nov 2014 20:43:35 +0000 (UTC) Received: (qmail 45748 invoked by uid 500); 11 Nov 2014 20:43:35 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 45676 invoked by uid 500); 11 Nov 2014 20:43:35 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 45662 invoked by uid 99); 11 Nov 2014 20:43:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Nov 2014 20:43:34 +0000 Date: Tue, 11 Nov 2014 20:43:34 +0000 (UTC) From: "Hadoop QA (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (MAPREDUCE-6139) ConcurrentModificationException in ContainerLogAppender MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207018#comment-14207018 ] Hadoop QA commented on MAPREDUCE-6139: -------------------------------------- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12680864/MAPREDUCE-6139.3.patch against trunk revision 061bc29. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5007//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5007//console This message is automatically generated. > ConcurrentModificationException in ContainerLogAppender > ------------------------------------------------------- > > Key: MAPREDUCE-6139 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6139 > Project: Hadoop Map/Reduce > Issue Type: Bug > Reporter: Mohammad Kamrul Islam > Assignee: Mohammad Kamrul Islam > Priority: Critical > Attachments: ContainerLogAppender.java, MAPREDUCE-6139.1.patch, MAPREDUCE-6139.2.patch, MAPREDUCE-6139.3.patch > > > Context: > * Hadoop-2.3.0 > * Using Oozie 4.0.1 > * Pig version 0.11.x > The job is submitted by Oozie to launch Pig script. > The following exception traces were found on MR task log: > In syslog: > {noformat} > 2014-10-24 20:37:29,317 WARN [Thread-5] org.apache.hadoop.util.ShutdownHookManager: ShutdownHook '' failed, java.util.ConcurrentModificationException > java.util.ConcurrentModificationException > at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:966) > at java.util.LinkedList$ListItr.next(LinkedList.java:888) > at org.apache.hadoop.yarn.ContainerLogAppender.close(ContainerLogAppender.java:94) > at org.apache.log4j.helpers.AppenderAttachableImpl.removeAllAppenders(AppenderAttachableImpl.java:141) > at org.apache.log4j.Category.removeAllAppenders(Category.java:891) > at org.apache.log4j.Hierarchy.shutdown(Hierarchy.java:471) > at org.apache.log4j.LogManager.shutdown(LogManager.java:267) > at org.apache.hadoop.mapred.TaskLog.syncLogsShutdown(TaskLog.java:286) > at org.apache.hadoop.mapred.TaskLog$2.run(TaskLog.java:339) > at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54) > 2014-10-24 20:37:29,395 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask metrics system... > {noformat} > in stderr: > {noformat} > java.util.ConcurrentModificationException > at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:966) > at java.util.LinkedList$ListItr.next(LinkedList.java:888) > at org.apache.hadoop.yarn.ContainerLogAppender.close(ContainerLogAppender.java:94) > at org.apache.log4j.helpers.AppenderAttachableImpl.removeAllAppenders(AppenderAttachableImpl.java:141) > at org.apache.log4j.Category.removeAllAppenders(Category.java:891) > at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:759) > at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648) > at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514) > at org.apache.log4j.PropertyConfigurator.configure(PropertyConfigurator.java:440) > at org.apache.pig.Main.configureLog4J(Main.java:740) > at org.apache.pig.Main.run(Main.java:384) > at org.apache.pig.PigRunner.run(PigRunner.java:49) > at org.apache.oozie.action.hadoop.PigMain.runPigJob(PigMain.java:283) > at org.apache.oozie.action.hadoop.PigMain.run(PigMain.java:223) > at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:37) > at org.apache.oozie.action.hadoop.PigMain.main(PigMain.java:76) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:483) > at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:226) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)