hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3299) org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize TextInput format files with the configuration resulting in an NullPointerException
Date Sat, 26 Apr 2008 00:45:57 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Douglas updated HADOOP-3299:
----------------------------------

    Fix Version/s: 0.18.0
           Status: Patch Available  (was: Open)

> org.apache.hadoop.mapred.join.CompositeInputFormat does not initialize  TextInput format
files with the configuration resulting in an NullPointerException
> ----------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3299
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3299
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: io, mapred
>    Affects Versions: 0.16.3
>            Reporter: Jason
>             Fix For: 0.18.0
>
>         Attachments: 3299-0.patch, keyvaluetext.diff, text.diff
>
>
> The input formats are not initialized with the Configuration object before the isSplitable
method is called.
> bin/hadoop jar hadoop-0.16.3-examples.jar  join -r 1 -inFormat org.apache.hadoop.mapred.KeyValueTextInputFormat
-outFormat org.apache.hadoop.mapred.TextOutputFormat  -joinOp outer datajoin/input datajoin/output
-outKey org.apache.hadoop.io.Text -outValue org.apache.hadoop.mapred.join.TupleWritable
> 08/04/22 15:05:33 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker,
sessionId=
> Job started: Tue Apr 22 15:05:33 GMT-08:00 2008
> 08/04/22 15:05:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker,
sessionId= - already initialized
> 08/04/22 15:05:33 INFO mapred.FileInputFormat: Total input paths to process : 2
> java.lang.NullPointerException
> 	at org.apache.hadoop.mapred.KeyValueTextInputFormat.isSplitable(KeyValueTextInputFormat.java:44)
> 	at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:185)
> 	at org.apache.hadoop.mapred.join.Parser$WNode.getSplits(Parser.java:304)
> 	at org.apache.hadoop.mapred.join.Parser$CNode.getSplits(Parser.java:374)
> 	at org.apache.hadoop.mapred.join.CompositeInputFormat.getSplits(CompositeInputFormat.java:129)
> 	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:542)
> 	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:803)
> 	at org.apache.hadoop.examples.Join.run(Join.java:149)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.examples.Join.main(Join.java:158)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> 	at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> 	at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:52)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:155)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message