tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyunsik Choi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TAJO-222) Eliminate local data transmission during repartition phases
Date Tue, 01 Oct 2013 13:08:23 GMT
Hyunsik Choi created TAJO-222:
---------------------------------

             Summary: Eliminate local data transmission during repartition phases
                 Key: TAJO-222
                 URL: https://issues.apache.org/jira/browse/TAJO-222
             Project: Tajo
          Issue Type: Improvement
          Components: repartitioning
            Reporter: Hyunsik Choi


During a repartition phase, each worker pulls intermediate of completed tasks of one or more
child execution blocks. However, a worker pulls the intermediate data completed at the same
worker via HTTP. This causes unnecessary read/write overheads on disk. We should eliminate
this overhead.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message