tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyunsik Choi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TAJO-292) Too many intermediate partition files
Date Tue, 29 Oct 2013 05:13:30 GMT
Hyunsik Choi created TAJO-292:

             Summary: Too many intermediate partition files
                 Key: TAJO-292
                 URL: https://issues.apache.org/jira/browse/TAJO-292
             Project: Tajo
          Issue Type: Bug
          Components: repartitioning
            Reporter: Hyunsik Choi
            Assignee: Hyunsik Choi
            Priority: Critical
             Fix For: 0.8-incubating

Unlike the before, the number of partitions are being currently determined by the volume size
and the number of distinct keys. It can cause unnecessary overheads. We need to improve the
partition number determiner to consider the number of cluster nodes.

This message was sent by Atlassian JIRA

View raw message