Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of mohajeri@gmail.com designates
 209.85.219.46 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAKUJFg1pZ9E0FJ_05n7_XA+Ws31H+E05S3KOHOHRNztEa6n66A@mail.gmail.com>
References: 
 <CAKUJFg0_9EB4ZmXGwJHKwquRRzObL+OfFowA3Gc4wX7qnc_Dmw@mail.gmail.com>
	<CAKUJFg1pZ9E0FJ_05n7_XA+Ws31H+E05S3KOHOHRNztEa6n66A@mail.gmail.com>
Date: Tue, 28 Jan 2014 09:27:52 -0800
Message-ID: 
 <CAO6Jcpj51mU1t_Eth6_G6NXMd0w0OYJFjXteD9t0jp=8fTSEyA@mail.gmail.com>
Subject: Re: Suggestion technology/design on this usecase
From: Peyman Mohajerian <mohajeri@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c362e6db0cf004f10b2425

--001a11c362e6db0cf004f10b2425
Content-Type: text/plain; charset=ISO-8859-1

No-sql solution with real-time counters would work, e.g. Cassandra or
hbase. But I think elastic search or Solr would be simpler and can do the
counting on access. There are solutions that are the combination of both
these approaches.


On Tue, Jan 28, 2014 at 8:51 AM, Naresh Yadav <nyadav.ait@gmail.com> wrote:

> please give suggestions on this...
>
>
> On Tue, Jan 28, 2014 at 3:18 PM, Naresh Yadav <nyadav.ait@gmail.com>wrote:
>
>> Hi all,
>>
>> I am new to big data technologies and design so looking for help from
>> java world.
>>
>> I have concept of tags and tagcombinations.
>> For example U.S.A and Pen are two tags AND if they come together in some
>> definition then register a tagcombination(U.S.A-Pen) for that..
>>
>> *tags *(U.S.A, Pen, Pencil, India, Shampoo)
>> *tagcombinations*(U.S.A-Pen, India-pencil, U.S.A-Pencil, India-Pen,
>> India-Pen-Shampoo)
>>
>> - millions of tags
>> - billions of tagcombinations
>> - one tagcombination generally have 2-8 tags....
>> - Every day we get lakhs of new tagcombinations to write
>> - daily crores of queries to find matching combination by set of tags
>>
>> Query need to support :
>> one tag or set of tags appears in how many tagcombinationids ????
>> If i query for Pen,India then it should return two tagcombinaions
>> (India-Pen, India-Pen-Shampoo))..Query will be fired by application in
>> realtime.
>>
>> Please suggest a solution which is distributed with java client and can
>> handle scale of data  i am looking for..
>>
>> Thanks
>> Naresh
>>
>
>
>
>

--001a11c362e6db0cf004f10b2425
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">No-sql solution with real-time counters would work, e.g. C=
assandra or hbase. But I think elastic search or Solr would be simpler and =
can do the counting on access. There are solutions that are the combination=
 of both these approaches.</div>
<div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Tue, Jan 2=
8, 2014 at 8:51 AM, Naresh Yadav <span dir=3D"ltr">&lt;<a href=3D"mailto:ny=
adav.ait@gmail.com" target=3D"_blank">nyadav.ait@gmail.com</a>&gt;</span> w=
rote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">please give suggestions on =
this...<br><div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quot=
e">On Tue, Jan 28, 2014 at 3:18 PM, Naresh Yadav <span dir=3D"ltr">&lt;<a h=
ref=3D"mailto:nyadav.ait@gmail.com" target=3D"_blank">nyadav.ait@gmail.com<=
/a>&gt;</span> wrote:<br>


<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div><div>Hi all,<br><br>I =
am new to big data technologies and design so looking for help from java wo=
rld.<br>


</div><div><br clear=3D"all"></div>I have concept of tags and tagcombinatio=
ns.<br>
For example U.S.A and Pen are two tags AND if they come together in some
 definition then register a tagcombination(U.S.A-Pen) for that..<br><br><b>=
tags </b>(U.S.A, Pen, Pencil, India, Shampoo)<br><b>tagcombinations</b>(U.S=
.A-Pen, India-pencil, U.S.A-Pencil, India-Pen, India-Pen-Shampoo)<br>
<br>- millions of tags <br>- billions of tagcombinations<br>- one tagcombin=
ation generally have 2-8 tags....<br>- Every day we get lakhs of new tagcom=
binations to write<br></div>- daily crores of queries to find matching comb=
ination by set of tags<br>


<div><br><div>Query need to support :<br>
</div><div>one tag or set of tags appears in how many tagcombinationids ???=
?<br></div><div>If
 i query for Pen,India then it should return two tagcombinaions=20
(India-Pen, India-Pen-Shampoo))..Query will be fired by application in=20
realtime.<br><br></div><div>Please suggest a solution which is distributed =
with java client and can <br></div><div>handle scale of data=A0 i am lookin=
g for..<br></div><div><br></div>Thanks<span><font color=3D"#888888"><br>

</font></span></div><span><font color=3D"#888888"><div>Naresh<br></div></fo=
nt></span></div>
</blockquote></div><br><br clear=3D"all"><br></div></div></div>
</blockquote></div><br></div>

--001a11c362e6db0cf004f10b2425--