hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-450) Remove the need for users to specify the types of the inputs
Date Fri, 11 Aug 2006 23:33:15 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-450?page=all ]

Owen O'Malley updated HADOOP-450:

    Status: Patch Available  (was: Open)

This patch does:
  1. depriciates the JobConf methods for get/set key/value type
  2. adds createKey/Value to the RecordReader
  3. changes TextInputFormat to use Text rather than UTF8
  4. cleans up the uses with examples, lib, and streaming.

> Remove the need for users to specify the types of the inputs
> ------------------------------------------------------------
>                 Key: HADOOP-450
>                 URL: http://issues.apache.org/jira/browse/HADOOP-450
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.5.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.6.0
> Currently, the application specifies the types of the input keys and values and the RecordReader
checks them for consistency. It would make more sense to have the RecordReader define the
types of keys that it will produce. Therefore, I propose that we add two new methods to RecordReader:
> WritableComparable createKey();
> Writable createValue();
> Note that I propose adding them to the RecordReader rather than the InputFormat, so that
they can specific to a particular input split.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message