hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suman Sehgal (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-6130) ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner
Date Wed, 08 Jul 2009 05:44:14 GMT
ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner
--------------------------------------------------------------------

                 Key: HADOOP-6130
                 URL: https://issues.apache.org/jira/browse/HADOOP-6130
             Project: Hadoop Common
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.20.0
            Reporter: Suman Sehgal
            Priority: Critical


KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of the specified
key is missing. 
Scenario :
=======
when  value of num.key.fields.for.partition is greater than the separators provided in the
input.
Command:
========
hadoop jar streaming.jar -Dmapred.reduce.tasks=3 -Dnum.key.fields.for.partition=5 -input <input-dir>
 -output <output-dir> -mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer org.apache.hadoop.mapred.lib.IdentityReducer
-inputformat org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message