From user-return-17359-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Jan 19 05:48:22 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 4A6BE180654 for ; Fri, 19 Jan 2018 05:48:22 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 37A3D160C48; Fri, 19 Jan 2018 04:48:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 57EEB160C26 for ; Fri, 19 Jan 2018 05:48:21 +0100 (CET) Received: (qmail 47255 invoked by uid 500); 19 Jan 2018 04:48:20 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 47245 invoked by uid 99); 19 Jan 2018 04:48:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Jan 2018 04:48:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id BE2411A0EC8 for ; Fri, 19 Jan 2018 04:48:19 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id agluyaONR7k5 for ; Fri, 19 Jan 2018 04:48:15 +0000 (UTC) Received: from mail-lf0-f45.google.com (mail-lf0-f45.google.com [209.85.215.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 51CE15F47F for ; Fri, 19 Jan 2018 04:48:15 +0000 (UTC) Received: by mail-lf0-f45.google.com with SMTP id g72so560411lfg.5 for ; Thu, 18 Jan 2018 20:48:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=4mpaMEbf41oD/VDXCKnVzR3aele1XDXuMOikdY0faxw=; b=CGeWaApG9MninRWagTVun6T7T4zPW4DJVjWOWYC0r3T0gQEQAGCw6T5Q0Y2z5wIJjS Wmzz2KD7DUqS7cvsOqn4LuV60c3nKwivSMZbXtwakXQlXIOPYNANvYcXnbpOzyJ2K+R6 ZMZbdIAvsZIZLb/cHcymgXMK/IUaVvvMdjI6LyeX9U0HD/6JlDeF9cdMamy4Ff8MnHvK vy6jH1iVei8qj5Yng2skg7ATQiJAbpk8U8dDQURnsJTBrJWmnNiTAZnML153Dp5Xld5h gA2KtBWqlehybfQQ547HPRwpxfOQMdGeONTXpsXjbLOaeJYJr8kT4l8OPUU+PG6beXKN qzfg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=4mpaMEbf41oD/VDXCKnVzR3aele1XDXuMOikdY0faxw=; b=eiOR/8yNpTxHDOLjSHKp7MzMchpOr+tgTKmWTjIK6AnUlMpyBWnZv7tYULj/LE0bKM ICsBhbjPOc6xHs85ocrv1DfoWXwMgG6wck+oopbnkwU9TsFDnQyL/ndFhqhbUKo9F5E9 BTTKDhb1kDFa3rog7FdV+rbto33TT2UHG2IcV0rtvbQDZdtosCzJl7kOSw3071IkDc8f m8/d6341rcs0UAdZ192bgH0SgOzeY/WVQZuO3eimpDVCgbpyooOWQScgGh9t5CKkgBXX Xj4XrdXgkoV2FQWHmHheChGOsMCQhgPkfU3HuOrro1I9aLTY5Vf3jcux2bIc/I897m+r SKwQ== X-Gm-Message-State: AKwxytcWXiBTEBCfKwF5oUiy6usN76Zawj3WeeuFEiuj4f4zCKqYR2Kq b1/9kUuess5m8ODjP0kO566rX9yQyTIJRyxVmD4= X-Google-Smtp-Source: ACJfBosTfqjUBKjPZYDSz4fK00fh6I5PHB+mcMnwluEfsycQnk7B2YLVjbTtvgWjwwKLb6q9L0YrWRtPbdfMw/bj4J0= X-Received: by 10.46.2.221 with SMTP id y90mr9621136lje.39.1516337294343; Thu, 18 Jan 2018 20:48:14 -0800 (PST) MIME-Version: 1.0 Received: by 10.25.89.85 with HTTP; Thu, 18 Jan 2018 20:48:13 -0800 (PST) In-Reply-To: <1516333913336-0.post@n6.nabble.com> References: <1516314382918-0.post@n6.nabble.com> <1516333913336-0.post@n6.nabble.com> From: Rajesh Kishore Date: Fri, 19 Jan 2018 10:18:13 +0530 Message-ID: Subject: Re: how to create Index for binary or byte type value To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="94eb2c1a65beca04ce056319c9d9" --94eb2c1a65beca04ce056319c9d9 Content-Type: text/plain; charset="UTF-8" Hi Val, Would indices be possible on binary data value , I dont think so. I think I will stick with the POJO for now. I have queries on indices and l am not relying on external persistence system. a) What are the different indices type Ignite supports apart from equality i.e does it support the substring query like - name=raj% or equivalent b) How does indices are actually stored in Ignite, what is the performance overhead when its a very large data set say 20 million each entry is of size 5 kb -Rajesh On Fri, Jan 19, 2018 at 9:21 AM, vkulichenko wrote: > Rajesh, > > This actually sounds exactly like binary format Ignite uses to store the > data: https://apacheignite.readme.io/docs/binary-marshaller > > Doing this manually (i.e. explicitly saving some byte array and creating > indexes over this array) would not be possible, but I don't think you > really > need it. Just work with POJOs or BinaryObject-s on application level and > Ignite will do the rest for you. > > -Val > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > --94eb2c1a65beca04ce056319c9d9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Val,

Would indices be possi= ble on binary data value , I dont think so. I think I will stick with the P= OJO for now.

I have queries on indices and l am not relying on exter= nal persistence system.

a) What are the different indices type= Ignite supports apart from equality i.e does it support the substring quer= y like -=C2=A0 name=3Draj% or equivalent
b) How does indices are a= ctually stored in Ignite, what is the performance overhead when its a very = large data set say 20 million each entry is of size 5 kb

<= div>
-Rajesh


On Fri, Jan 19, = 2018 at 9:21 AM, vkulichenko <valentin.kulichenko@gmail.com> wrote:
Rajesh,

This actually sounds exactly like binary format Ignite uses to store the data:
https://apacheignite.readme.io/docs/= binary-marshaller

Doing this manually (i.e. explicitly saving some byte array and creating indexes over this array) would not be possible, but I don't think you r= eally
need it. Just work with POJOs or BinaryObject-s on application level and Ignite will do the rest for you.

--94eb2c1a65beca04ce056319c9d9--