A input split cannot be less than a dfs block
----------------------------------------------
Key: MAPREDUCE-2046
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2046
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Namit Jain
I ran into this while testing some hive features.
Whether we use hiveinputformat or combinehiveinputformat, a split cannot be less than a dfs
block size.
This is a problem if we want to increase the block size for older data to reduce memory consumption
for the
name node.
It would be useful if the input split was independent of the dfs block size.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
|