Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 729769D37 for ; Fri, 6 Jul 2012 02:32:47 +0000 (UTC) Received: (qmail 64628 invoked by uid 500); 6 Jul 2012 02:32:45 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 64367 invoked by uid 500); 6 Jul 2012 02:32:45 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 64332 invoked by uid 99); 6 Jul 2012 02:32:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jul 2012 02:32:44 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.212.179 as permitted sender) Received: from [209.85.212.179] (HELO mail-wi0-f179.google.com) (209.85.212.179) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jul 2012 02:32:39 +0000 Received: by wibhq4 with SMTP id hq4so223610wib.2 for ; Thu, 05 Jul 2012 19:32:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=IHfrhyt3iGs4ceLDzMcnN2oKEnyfHDZ9xQRvyQk4nvE=; b=zl9JGGUmuIeO8GV0vQVqoE/6S7pMBX/bBwe0J0ZotNDpwJ7sIwHp8f7HDt/kZ+61k/ LD7H82zfQJbQvQiwrtmtvgsI8MfR6/6sQ+HD2huBwZpESVSI4PKSQ584ieRsxdfzAKq2 w1Vc9s1qyZg2YGdP7CA01ig5x3UbKDgyYSoiTxsMc8LOChdRudnGK/tOOaPqdOtel4qU m87TkmRhM51qzYzM+FnPNuENWHim1G7UhoWTlXr8uClxVu0xE4ogeL1rDorDynApQtjo Od8cu3YdJSv/FIOWdSPX5KF2Wf01xdB3BaGgl++3p5vYiI5iRz6j5mSoNxFdQ7gSHZFZ Nmrg== MIME-Version: 1.0 Received: by 10.216.226.140 with SMTP id b12mr9053504weq.216.1341541937793; Thu, 05 Jul 2012 19:32:17 -0700 (PDT) Received: by 10.216.12.205 with HTTP; Thu, 5 Jul 2012 19:32:17 -0700 (PDT) In-Reply-To: References: Date: Thu, 5 Jul 2012 19:32:17 -0700 Message-ID: Subject: Re: secondary index using coprocessors From: Ted Yu To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001636e1ec86a7497e04c42012e7 X-Virus-Checked: Checked by ClamAV on apache.org --001636e1ec86a7497e04c42012e7 Content-Type: text/plain; charset=ISO-8859-1 The following action allows me to compile your code: 551 cp ~/hbase-indexed/src/org/apache/hadoop/hbase/regionserver/*.java src/main/java/org/apache/hadoop/hbase/regionserver/ 552 mkdir src/main/java/org/apache/hadoop/hbase/regionserver/indexed 553 cp ~/hbase-indexed/src/org/apache/hadoop/hbase/regionserver/indexed/* src/main/java/org/apache/hadoop/hbase/regionserver/indexed/ There is no unit test. Can you add some ? Do you have performance data: overhead for writing index, speedup in query ? The most recent motion on this subject is HBASE-5723. I still need to dig into your code. If you can comment on the level of consistency guarantees for your design, that would be nice. Cheers On Thu, Jul 5, 2012 at 6:50 PM, fding hbase wrote: > Hi all, > > I've implemented an indexing system. It needs refinement of course > but I have my own work to do, so I decided to open it for everyone to > access, modify and any improvement or ideas would be great. > > https://github.com/danix800/hbase-indexed > > -- > > Best Regards! > > Fei Ding > fding.church@gmail.com > --001636e1ec86a7497e04c42012e7--