hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1428) Make block size and the size of archive created files configurable.
Date Thu, 01 Apr 2010 17:20:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852465#action_12852465

Mahadev konar commented on MAPREDUCE-1428:

the javac warning is because of : 
[deprecation] create(org.apache.hadoop.fs.Path,org.apache.hadoop.fs.permission.FsPermission,boolean,int,short,long,org.apache.hadoop.util.Progressable)
in org.apache.hadoop.fs.FileSystem has been deprecated
[javac]         partStream = destFs.create(tmpOutput, new FsPermission((short)0700),


I dont see a solution arnd it.

> Make block size and the size of archive created files configurable.
> -------------------------------------------------------------------
>                 Key: MAPREDUCE-1428
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1428
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: harchive
>            Reporter: Mahadev konar
>            Assignee: Mahadev konar
>             Fix For: 0.22.0
>         Attachments: BinaryFileGenerator.java, BinaryFileGenerator.java, BinaryFileGenerator.java,
> Currently the block size used by archives is the default block size of the hdfs filesystem.
We need to make it configurable so that the block size can be higher for the part files that
archives create.
> Also, we need to make the size of part files in archives configurable again to make it
bigger in size and create less number of such files.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message