tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-375) Remove 2 second wait for end of shuffle
Date Sun, 18 Aug 2013 06:35:47 GMT
Bikas Saha created TEZ-375:
------------------------------

             Summary: Remove 2 second wait for end of shuffle
                 Key: TEZ-375
                 URL: https://issues.apache.org/jira/browse/TEZ-375
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Bikas Saha


According to following code Shuffle may wait upto 2 second for completion depending on when
the sleep wait starts
PROGRESS_FREQUENCY is 2000 ms.
{code}
    while (!scheduler.waitUntilDone(PROGRESS_FREQUENCY)) {
      reporter.progress();
      
      synchronized (this) {
        if (throwable != null) {
          throw new ShuffleError("error in shuffle in " + throwingThreadName,
                                 throwable);
        }
      }
    }
{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message