hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jim Kellerman (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1138) Test that readers opened after a sync can see all data up to the sync
Date Tue, 20 Jan 2009 16:35:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665462#action_12665462
] 

Jim Kellerman commented on HBASE-1138:
--------------------------------------

We can mitigate this in the short term by making HLog block size configurable as there is
a (new to me) createWriter method:
{code}
  /**
   * Construct the preferred type of SequenceFile Writer.
   * @param fs The configured filesystem.
   * @param conf The configuration.
   * @param name The name of the file.
   * @param keyClass The 'key' type.
   * @param valClass The 'value' type.
   * @param bufferSize buffer size for the underlaying outputstream.
   * @param replication replication factor for the file.
   * @param blockSize block size for the file.
   * @param compressionType The compression type.
   * @param codec The compression codec.
   * @param progress The Progressable object to track progress.
   * @param metadata The metadata of the file.
   * @return Returns the handle to the constructed SequenceFile Writer.
   * @throws IOException
   */
  public static Writer
    createWriter(FileSystem fs, Configuration conf, Path name,
                 Class keyClass, Class valClass, int bufferSize,
                 short replication, long blockSize,
                 CompressionType compressionType, CompressionCodec codec,
                 Progressable progress, Metadata metadata) throws IOException {
{code}

If we did make HLog block size configurable, we'd have to provide guidelines for setting it
based on 
average key and value length, and the sync interval.


> Test that readers opened after a sync can see all data up to the sync
> ---------------------------------------------------------------------
>
>                 Key: HBASE-1138
>                 URL: https://issues.apache.org/jira/browse/HBASE-1138
>             Project: Hadoop HBase
>          Issue Type: Test
>          Components: regionserver, test
>    Affects Versions: 0.19.0
>            Reporter: Jim Kellerman
>             Fix For: 0.19.1, 0.20.0
>
>
> Test that readers opened on a file after it has been synced can see all the records prior
to the sync.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message