chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <>
Subject [jira] Created: (CHUKWA-313) Remove the 10 sec ack from SeqWriter
Date Thu, 18 Jun 2009 21:38:07 GMT
Remove the 10 sec ack from SeqWriter

                 Key: CHUKWA-313
             Project: Hadoop Chukwa
          Issue Type: Improvement
            Reporter: Jerome Boulon
            Assignee: Jerome Boulon

SeqWriter.add is waiting 10 sec in a worse case before calling a flush. This was there to
guarantee that the data has been written to HDFS before returning the ack.
It used to work well with 0.18 but in 0.20 the flush is a nohup so there's no point in waiting
10 sec for nothing.

The real flush will give us the ability to write redo logs directly to HDFS so the ack implementation
will have to change anyway.
So I vote for removing the 10 sec ack from the add method.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message