Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7F006200B12 for ; Sun, 12 Jun 2016 08:33:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7DE69160A07; Sun, 12 Jun 2016 06:33:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C572A160A2C for ; Sun, 12 Jun 2016 08:33:22 +0200 (CEST) Received: (qmail 91632 invoked by uid 500); 12 Jun 2016 06:33:21 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 91617 invoked by uid 99); 12 Jun 2016 06:33:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Jun 2016 06:33:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 034772C1F68 for ; Sun, 12 Jun 2016 06:33:21 +0000 (UTC) Date: Sun, 12 Jun 2016 06:33:21 +0000 (UTC) From: "Qiuzhuang Lian (JIRA)" To: dev@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HIVE-13998) CompactorMR for ORC ACID throws NPE MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sun, 12 Jun 2016 06:33:23 -0000 Qiuzhuang Lian created HIVE-13998: ------------------------------------- Summary: CompactorMR for ORC ACID throws NPE Key: HIVE-13998 URL: https://issues.apache.org/jira/browse/HIVE-13998 Project: Hive Issue Type: Bug Components: ORC Affects Versions: 1.2.1 Environment: Hadoop 2.6.2+Hive 1.2.1 Reporter: Qiuzhuang Lian When job CompactorMR is running, we see NPE stack as follows, 2016-06-12 14:20:34,463 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1464322345445_83343_m_000003_1 to list of failed maps 2016-06-12 14:20:34,597 INFO [IPC Server handler 7 on 40704] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1464322345445_83343_m_000002_0 is : 0.0 2016-06-12 14:20:34,599 FATAL [IPC Server handler 12 on 40704] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1464322345445_83343_m_000002_0 - exited : java.lang.NullPointerException at java.util.Hashtable.put(Hashtable.java:514) at java.util.Hashtable.putAll(Hashtable.java:587) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$StringableMap.toProperties(CompactorMR.java:608) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.getWriter(CompactorMR.java:541) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:517) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:491) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 2016-06-12 14:20:34,599 INFO [IPC Server handler 12 on 40704] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1464322345445_83343_m_000002_0: Error: java.lang.NullPointerException at java.util.Hashtable.put(Hashtable.java:514) at java.util.Hashtable.putAll(Hashtable.java:587) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$StringableMap.toProperties(CompactorMR.java:608) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.getWriter(CompactorMR.java:541) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:517) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:491) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 2016-06-12 14:20:34,599 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1464322345445_83343_m_000002_0: Error: java.lang.NullPointerException at java.util.Hashtable.put(Hashtable.java:514) at java.util.Hashtable.putAll(Hashtable.java:587) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$StringableMap.toProperties(CompactorMR.java:608) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.getWriter(CompactorMR.java:541) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:517) at org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:491) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) -- This message was sent by Atlassian JIRA (v6.3.4#6332)