hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hongyuan Li (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-14567) DistCP NullPointerException when -atomic is set but -tmp is not
Date Sun, 25 Jun 2017 16:06:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062365#comment-16062365
] 

Hongyuan Li edited comment on HADOOP-14567 at 6/25/17 4:05 PM:
---------------------------------------------------------------

[~harisekhon] Can you please list the commands that you used to run distcp. I deeped into
the code to find that maybe the targetPath is "/", so its parent is null,thus causing this
problem.

*Update*

tmp does not set make AtomicWorkPath = null.


was (Author: hongyuan li):
[~harisekhon] Can you please list the commands that you used to run distcp. I deeped into
the code to find that maybe the targetPath is "/", so its parent is null,thus causing this
problem.

> DistCP NullPointerException when -atomic is set but -tmp is not
> ---------------------------------------------------------------
>
>                 Key: HADOOP-14567
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14567
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: tools/distcp
>    Affects Versions: 2.7.3
>         Environment: HDP 2.5.0 kerberized cluster -> HDP 2.6.0 kerberized cluster
>            Reporter: Hari Sekhon
>            Priority: Minor
>
> When running distcp if using -atomic but not specifying -tmp then the following NullPointerException
is encountered - removing -atomic avoids this bug:
> {code}
> 17/06/21 16:50:59 ERROR tools.DistCp: Exception encountered
> java.lang.NullPointerException
>         at org.apache.hadoop.fs.Path.<init>(Path.java:104)
>         at org.apache.hadoop.fs.Path.<init>(Path.java:93)
>         at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:363)
>         at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:247)
>         at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:176)
>         at org.apache.hadoop.tools.DistCp.execute(DistCp.java:155)
>         at org.apache.hadoop.tools.DistCp.run(DistCp.java:128)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
>         at org.apache.hadoop.tools.DistCp.main(DistCp.java:462)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message