hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rong-En Fan (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3152) Make index interval configuable when using MapFileOutputFormat for map-reduce job
Date Wed, 02 Apr 2008 04:41:25 GMT
Make index interval configuable when using MapFileOutputFormat for map-reduce job
---------------------------------------------------------------------------------

                 Key: HADOOP-3152
                 URL: https://issues.apache.org/jira/browse/HADOOP-3152
             Project: Hadoop Core
          Issue Type: Bug
          Components: io
    Affects Versions: 0.16.0
         Environment: ubuntu, 64bit, jdk1.6
            Reporter: Rong-En Fan
         Attachments: mapfile.diff

Per discussion with Doug Cutting on hadoop user mailing around Mar 21,
thread title "MapFile and MapFileOutputFormat". Currently, there is no way 
to change the index interval for the output MapFile in a map-reduce job.
As suggested, adding a static method MapFile(Configuration, int) to set the
index interval and stores in Configuration, then MapFile.Writer constructor
reads the setting from configuration may be a good idea. 

I also noticed that Hbase did similar things in HBASE-364.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message