hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "alex gemini (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4630) API for setting dfs.block.size
Date Sat, 13 Oct 2012 09:05:07 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13475558#comment-13475558
] 

alex gemini commented on MAPREDUCE-4630:
----------------------------------------

I think you should create a new type conf like HiveConf, for fileformat special blocksize,you
only need HiveConf.getRCFileBlockSize() or just getProp(fileformat_blocksize.default_blocksize)
something like that.
                
> API for setting dfs.block.size
> ------------------------------
>
>                 Key: MAPREDUCE-4630
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4630
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>         Environment: Hadoop 2
>            Reporter: Radim Kolar
>            Priority: Minor
>
> Add API for setting block size in Tool while creating MR job.
> I propose
> FileOutputFormat.setBlockSize(Job job, int blocksize);
> which sets dfs.block.size

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message