hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6452) NPE when intermediate encrypt enabled for LocalRunner
Date Fri, 28 Aug 2015 19:39:46 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720451#comment-14720451
] 

Hudson commented on MAPREDUCE-6452:
-----------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #8365 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/8365/])
MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai
Xu (zxu: rev cbb249534aa72ff6c290c4f99766415aeea9d6f5)
* hadoop-mapreduce-project/CHANGES.txt
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapred/LocalJobRunner.java
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java


> NPE when intermediate encrypt enabled for LocalRunner
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-6452
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6452
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Bibin A Chundatt
>            Assignee: zhihai xu
>             Fix For: 2.8.0
>
>         Attachments: MAPREDUCE-6452.002.patch, MAPREDUCE-6452.1.patch, TestLocalJobSubmission.java
>
>
> Enable the below properties try running mapreduce job
> mapreduce.framework.name=local
> mapreduce.job.encrypted-intermediate-data=true
> {code}
> 2015-08-14 16:27:25,248 WARN  [Thread-21] mapred.LocalJobRunner (LocalJobRunner.java:run(561))
- job_local473843898_0001
> java.lang.Exception: java.lang.NullPointerException
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:463)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:523)
> Caused by: java.lang.NullPointerException
>         at org.apache.hadoop.crypto.CryptoOutputStream.<init>(CryptoOutputStream.java:92)
>         at org.apache.hadoop.fs.crypto.CryptoFSDataOutputStream.<init>(CryptoFSDataOutputStream.java:31)
>         at org.apache.hadoop.mapreduce.CryptoUtils.wrapIfNecessary(CryptoUtils.java:112)
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1611)
>         at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1492)
>         at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:723)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:244)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> {code}
> Jobs are failing always



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message