Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4041810C63 for ; Thu, 11 Jul 2013 19:17:18 +0000 (UTC) Received: (qmail 84806 invoked by uid 500); 11 Jul 2013 19:17:17 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 84760 invoked by uid 500); 11 Jul 2013 19:17:17 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 84752 invoked by uid 99); 11 Jul 2013 19:17:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Jul 2013 19:17:17 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ndimiduk@gmail.com designates 209.85.128.170 as permitted sender) Received: from [209.85.128.170] (HELO mail-ve0-f170.google.com) (209.85.128.170) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Jul 2013 19:17:12 +0000 Received: by mail-ve0-f170.google.com with SMTP id 14so7580519vea.15 for ; Thu, 11 Jul 2013 12:16:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=dS5ZzNmYSv11bKNJgEivFBUqCTbfb1Fj1IGb1B5q2gQ=; b=jhivjjAPyO65i/8JPHne2RD3Z/ulqRVEuTyVdwhBxTfLCjrSzLDr5qFREFfgIE09mw uuCsHuG9cuv+ESxQexvsDyjywwyxVIsAx1ezs4aAtHMbn+PdoYPbwT3Vgsz4SAjh9WJ7 KkD3dW0K5Fd9v4JxC9Lbon+8zWRpq5osTq81r3EoJFg8nx0D790MmddOYWLrlMGf0s8D NLbZIgxg0oT+WP75nTCZq473K1vuGGZKVQg154We6s+QFwbZSJrBD4Whb1J85Y3IEG70 Glcn3XVew7k8z28LRLMlXyTVh0obZgawE3zG8ib8/8T1nAClsmZ+Esubr5vHVgzK4S+R WVqg== X-Received: by 10.220.201.138 with SMTP id fa10mr22803998vcb.18.1373570211584; Thu, 11 Jul 2013 12:16:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.97.204 with HTTP; Thu, 11 Jul 2013 12:16:31 -0700 (PDT) From: Nick Dimiduk Date: Thu, 11 Jul 2013 12:16:31 -0700 Message-ID: Subject: Data types stage 1 is ready for reivew To: hbase-dev Content-Type: multipart/alternative; boundary=001a11c1c00889227a04e1413c23 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c1c00889227a04e1413c23 Content-Type: text/plain; charset=UTF-8 Heya devs, I have two 90k patches I'd like to get some more eyes on. The first is the OrderedBytes patch, HBASE-8201 [0]. It is lightly analogous to the existing Bytes.toXXX methods, but implements order-preserving serialization strategies. Its encoding format can be inspected to determine the encoding used. The patch is nearing completion, so now's the time to add your concerns to RB [1]. The major outstanding issue with this patch is its use of ByteBuffers; there's concern about the amount of garbage that will be generated in tight loops. Our ByteRange was proposed as a mutable alternative. The other concern is performance of the encoding implementations. While performance is a consideration in this implementation, I've created a separate ticket [2] for evaluating and improving runtime performance. Please keep your attention on the on-disk formats and APIs this patch implements. The second is the Data Types API patch, HBASE-8693 [3]. It provides a user-extensible data type API and includes implementations of a number of simple types. Many of those types depend on the encoding provided by OrderedByes. It also provides a collection of "legacy" types, which all use the existing Bytes.toXXX methods. These are intended to ease the burden of transitioning an existing HBase application over to the new data types APIs. This patch is in an earlier stage, but it's conceptually quite simple so it should be easier to review. It's also available on RB [4]. Thanks for your time and attention, Nick [0]: https://issues.apache.org/jira/browse/HBASE-8201 [1]: https://reviews.apache.org/r/11633/ [2]: https://issues.apache.org/jira/browse/HBASE-8694 [3]: https://issues.apache.org/jira/browse/HBASE-8693 [4]: https://reviews.apache.org/r/12069/ --001a11c1c00889227a04e1413c23--