hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2046) A input split cannot be less than a dfs block
Date Tue, 31 Aug 2010 19:19:55 GMT
A input split cannot be less than a dfs block 
----------------------------------------------

                 Key: MAPREDUCE-2046
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2046
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Namit Jain


I ran into this while testing some hive features.

Whether we use hiveinputformat or combinehiveinputformat, a split cannot be less than a dfs
block size.
This is a problem if we want to increase the block size for older data to reduce memory consumption
for the
name node.

It would be useful if the input split was independent of the dfs block size.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message