hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-2703) Add a doc note about changes to io.sort.mb and io.sort.factor config params for SequenceFile sorting in DistCp
Date Sun, 18 Dec 2011 11:04:31 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Harsh J resolved MAPREDUCE-2703.
--------------------------------

    Resolution: Won't Fix

Appears to be that DistCp uses Sorter only for filename sorting, not much other. Defaults
suffice here. Docs not absolutely necessary.
                
> Add a doc note about changes to io.sort.mb and io.sort.factor config params for SequenceFile
sorting in DistCp
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2703
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2703
>             Project: Hadoop Map/Reduce
>          Issue Type: Task
>          Components: distcp, documentation
>    Affects Versions: 0.22.0
>            Reporter: Harsh J
>            Assignee: Harsh J
>            Priority: Trivial
>             Fix For: 0.24.0
>
>
> Carrying over work from MAPREDUCE-2622 and HADOOP-6801 that impacts how sequencefiles
will utilize the now deprecated io.sort.mb and io.sort.factor configs (new configs are made
available for it to use, see HADOOP-6801). Since DistCp is the remaining lone framework user
of SequenceFile.Sorter, it will require additions to docs about new properties to control.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message