hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santhosh Srinivasan (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-702) Computation of number of reducers in order by has to change for a static cluster (Hadoop 20)
Date Fri, 06 Mar 2009 19:39:56 GMT
Computation of number of reducers in order by has to change for a static cluster (Hadoop 20)
--------------------------------------------------------------------------------------------

                 Key: PIG-702
                 URL: https://issues.apache.org/jira/browse/PIG-702
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: types_branch
            Reporter: Santhosh Srinivasan
             Fix For: types_branch


In Hadoop 20, a static cluster is shared amongst multiple queues. The computation of the number
of reducers in order by queries when parallel keyword needs to change. Currently, the number
of reducers is computed as a function of the number of reduce slots and the number of nodes
in the cluster. Conservatively, this should revert to one reducer.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message