hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "GAO Rui (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )
Date Wed, 02 Dec 2015 01:33:10 GMT
GAO Rui created HDFS-9494:

             Summary: Parallel optimization of DFSStripedOutputStream#flushAllInternals( )
                 Key: HDFS-9494
                 URL: https://issues.apache.org/jira/browse/HDFS-9494
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: GAO Rui
            Assignee: GAO Rui
            Priority: Minor

Currently, in DFSStripedOutputStream#flushAllInternals( ), we trigger and 
wait for flushInternal( ) in sequence. So the runtime flow is like:
Streamer0#flushInternal( )
Streamer0#waitForAckedSeqno( )
Streamer1#flushInternal( )
Streamer1#waitForAckedSeqno( )
Streamer8#flushInternal( )
Streamer8#waitForAckedSeqno( )
It could be better to trigger all the streamers to flushInternal( ) and
wait for all of them to return from waitForAckedSeqno( ),  and then flushAllInternals( ) returns.

This message was sent by Atlassian JIRA

View raw message