hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6879) TestDFSIO#sequentialTest throws java.lang.NullPointerException due to uninitialized IOStream
Date Thu, 20 Apr 2017 08:45:04 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976317#comment-15976317
] 

ASF GitHub Bot commented on MAPREDUCE-6879:
-------------------------------------------

GitHub user wenxinhe opened a pull request:

    https://github.com/apache/hadoop/pull/215

    MAPREDUCE-6879. TestDFSIO#sequentialTest throws java.lang.NullPointerException due to
uninitialized IOStream

    [https://issues.apache.org/jira/browse/MAPREDUCE-6879](https://issues.apache.org/jira/browse/MAPREDUCE-6879)
    
    When I use -seq arg to write files, TestDFSIO#sequentialTest throws java.lang.NullPointerException
due to uninitialized stream inherited from IOMapperBase:
    
    [root@7b65290f2609 hadoop-3.0.0-alpha3-SNAPSHOT]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.0.0-alpha3-SNAPSHOT-tests.jar
TestDFSIO -seq -write
    2017-04-20 15:50:43,505 INFO fs.TestDFSIO: TestDFSIO.1.8
    2017-04-20 15:50:43,510 INFO fs.TestDFSIO: nrFiles = 1
    2017-04-20 15:50:43,510 INFO fs.TestDFSIO: nrBytes (MB) = 1.0
    2017-04-20 15:50:43,510 INFO fs.TestDFSIO: bufferSize = 1000000
    2017-04-20 15:50:43,510 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO
    2017-04-20 15:50:43,655 WARN util.NativeCodeLoader: Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
    java.lang.NullPointerException
    	at org.apache.hadoop.fs.TestDFSIO$WriteMapper.doIO(TestDFSIO.java:427)
    	at org.apache.hadoop.fs.TestDFSIO$WriteMapper.doIO(TestDFSIO.java:395)
    	at org.apache.hadoop.fs.TestDFSIO.sequentialTest(TestDFSIO.java:722)
    	at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:846)
    	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
    	at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:731)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
    	at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
    	at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:136)
    	at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:144)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.apache.hadoop.util.RunJar.run(RunJar.java:239)
    	at org.apache.hadoop.util.RunJar.main(RunJar.java:153)


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/wenxinhe/hadoop trunk

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/hadoop/pull/215.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #215
    
----
commit 4d7caeffc54cc5f74ed2f28f262f86ef2c77cfed
Author: vincent he <he.wenxin@zte.com.cn>
Date:   2017-04-20T08:41:05Z

    MAPREDUCE-6879. TestDFSIO#sequentialTest throws java.lang.NullPointerException due to
uninitialized IOStream

----


> TestDFSIO#sequentialTest throws java.lang.NullPointerException due to uninitialized IOStream
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6879
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6879
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: benchmarks
>    Affects Versions: 3.0.0-alpha2
>            Reporter: vincent he
>            Priority: Minor
>
> When I use {color:red} -seq {color} arg to write files, TestDFSIO#sequentialTest throws
java.lang.NullPointerException due to uninitialized stream inherited from IOMapperBase:
> {code}
> [root@7b65290f2609 hadoop-3.0.0-alpha3-SNAPSHOT]# bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.0.0-alpha3-SNAPSHOT-tests.jar
TestDFSIO -seq -write
> 2017-04-20 15:50:43,505 INFO fs.TestDFSIO: TestDFSIO.1.8
> 2017-04-20 15:50:43,510 INFO fs.TestDFSIO: nrFiles = 1
> 2017-04-20 15:50:43,510 INFO fs.TestDFSIO: nrBytes (MB) = 1.0
> 2017-04-20 15:50:43,510 INFO fs.TestDFSIO: bufferSize = 1000000
> 2017-04-20 15:50:43,510 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO
> 2017-04-20 15:50:43,655 WARN util.NativeCodeLoader: Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
> java.lang.NullPointerException
> 	at org.apache.hadoop.fs.TestDFSIO$WriteMapper.doIO(TestDFSIO.java:427)
> 	at org.apache.hadoop.fs.TestDFSIO$WriteMapper.doIO(TestDFSIO.java:395)
> 	at org.apache.hadoop.fs.TestDFSIO.sequentialTest(TestDFSIO.java:722)
> 	at org.apache.hadoop.fs.TestDFSIO.run(TestDFSIO.java:846)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
> 	at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:731)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
> 	at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> 	at org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:136)
> 	at org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:144)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:239)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:153)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message