hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Kellerman (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1138) Test that readers opened after a sync can see all data up to the sync
Date Tue, 20 Jan 2009 16:35:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665462#action_12665462

Jim Kellerman commented on HBASE-1138:

We can mitigate this in the short term by making HLog block size configurable as there is
a (new to me) createWriter method:
   * Construct the preferred type of SequenceFile Writer.
   * @param fs The configured filesystem.
   * @param conf The configuration.
   * @param name The name of the file.
   * @param keyClass The 'key' type.
   * @param valClass The 'value' type.
   * @param bufferSize buffer size for the underlaying outputstream.
   * @param replication replication factor for the file.
   * @param blockSize block size for the file.
   * @param compressionType The compression type.
   * @param codec The compression codec.
   * @param progress The Progressable object to track progress.
   * @param metadata The metadata of the file.
   * @return Returns the handle to the constructed SequenceFile Writer.
   * @throws IOException
  public static Writer
    createWriter(FileSystem fs, Configuration conf, Path name,
                 Class keyClass, Class valClass, int bufferSize,
                 short replication, long blockSize,
                 CompressionType compressionType, CompressionCodec codec,
                 Progressable progress, Metadata metadata) throws IOException {

If we did make HLog block size configurable, we'd have to provide guidelines for setting it
based on 
average key and value length, and the sync interval.

> Test that readers opened after a sync can see all data up to the sync
> ---------------------------------------------------------------------
>                 Key: HBASE-1138
>                 URL: https://issues.apache.org/jira/browse/HBASE-1138
>             Project: Hadoop HBase
>          Issue Type: Test
>          Components: regionserver, test
>    Affects Versions: 0.19.0
>            Reporter: Jim Kellerman
>             Fix For: 0.19.1, 0.20.0
> Test that readers opened on a file after it has been synced can see all the records prior
to the sync.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message