Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of piyushgoel84@gmail.com
 designates 209.85.216.171 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=MXRV7NokYg1ZMygnbeK4ee6ogo7RMU3pnOLgSnuBGN/bvcsdR3NbMamPodkb6ragfg
         ApRepdOrxxq4Hdpseb2yLfjIQGcNKJcHTEKhPGeSMJQL39DAqIVUQiF59/+th1Lci4Rm
         u6TbPuq+64qynuOINv2P3U4bmykQK+sjuE8CQ=
MIME-Version: 1.0
Date: Mon, 13 Jul 2009 16:06:37 +0530
Message-ID: <ac47e6e60907130336p5953435keeb6cdf82e3bd397@mail.gmail.com>
Subject: help needed with base schema
From: Piyush Goel <piyushgoel84@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=00163645899694ddd1046e93e50c

--00163645899694ddd1046e93e50c
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

Hi,
>
>
> I am trying to design a high scale key value storage system. The hbase
> table for the same is outlined below:
>
> {
>   "userid1" : {
>     "update" : {
>         t3 : "some update1",
>         t2 : "some update2",
>         t1 : "some update3"
>     },
>     "sender" : {
>         t3 : "sender3"
>         t2 : "sender2"
>         t1 : "sender1"
>     },
>
>   "userid2" : {
>     "update" : {
>         t9 : "some update9",
>         t6 : "some update534",
>         t1 : "some update343"
>     },
>     "sender" : {
>         t9 : "sender3"
>         t6 : "sender2"
>         t1 : "sender1"
>     },
>
>
> }
>
> The system is going to have around 15-20M users with around 3-4M put write
> operations per day (which rules out mysql automatically). The max number of
> entries in "update" and "sender" columns  will be around 1000 (around 1
> weeks updates)
>
> My queries would be like "For a given userid, return top 20 updates,
> senders based on timestamp". Is there a way to make a secondary index on
> "userid, timestamp" which can help speed up my "get" calls? Or how can I
> change my schema design to minimize response time for get calls ?
>
>
> thanks,

piyush

--00163645899694ddd1046e93e50c--