Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BDC59200C1C for ; Wed, 15 Feb 2017 13:08:23 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id BC754160B5E; Wed, 15 Feb 2017 12:08:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E3C28160B46 for ; Wed, 15 Feb 2017 13:08:22 +0100 (CET) Received: (qmail 73647 invoked by uid 500); 15 Feb 2017 12:08:22 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 73635 invoked by uid 99); 15 Feb 2017 12:08:21 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Feb 2017 12:08:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2EE7E1865E5 for ; Wed, 15 Feb 2017 12:08:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 8BsJ-5BVDj-n for ; Wed, 15 Feb 2017 12:08:19 +0000 (UTC) Received: from mail-yb0-f170.google.com (mail-yb0-f170.google.com [209.85.213.170]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 5F5FD5F4E5 for ; Wed, 15 Feb 2017 12:08:19 +0000 (UTC) Received: by mail-yb0-f170.google.com with SMTP id j82so44202869ybg.1 for ; Wed, 15 Feb 2017 04:08:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=durDTn92JGGWZ4ttO8EcIdU349ZylICioYBzVrneUmc=; b=QQysggH7kwLL4bbrRmn3u6EefZmDJcVBUL+MvZAmZf+xoQ2P2S0czHlPIy+iPFUV0j nwZ3GFkFv+a1LtYJySqzEkBBpSGdu7oMLmvulJSlJRwhIvbt0B+0rixr1Nwu3qld+TSj p+jmoff+a1PnqMpDsb4ujxXRIxS3t6grp2nUMvEysg94g+4fNe8Qley+xi+BHV67UE0G uFDykwS1frYMaICt0GTsh0sn8VO049WLJK1HLhZy2QRH5Myc61WNYCGQ/vBQBuanZMRE DGEKLmbMdETfkZZ89nvQ+SgiOcepQUbjV8RAGfLkrCmLkchiwgLYQGkpPN+CSDdH8PeJ 2KtA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=durDTn92JGGWZ4ttO8EcIdU349ZylICioYBzVrneUmc=; b=aCPe5GgfKLtFPSK04qfR3sY9Vtes0ADG+Fj0h0RiP/x4VI6bxcUe1MQz75F8WBOciA lX9WAPabI26KjzkQFOP3HBdYaUA787wyw6HFrAUmSoTlWD2yrUEVqNcwnRLPYoMszZlb JtHIVsDkVdlcYRO3+bK7RVv84JNsuQ1H+7j8436fa5sIZg6gTz46CRf6R/INeXG4NZKY tKiFssfMqw7P6SoTJPKVD+kaeHGfP73GHcIg0cAmVhAUUdY3dgmE3ln0FHNKjfGXInXt 5MT2WWf2cmOlMXYIjjwKbffXsCVNF9xPQlrFtZrgg+jtovgXffz51mHfRx2lBL15rgJU tu5w== X-Gm-Message-State: AMke39mmdYpKd9nb/OunqUjgTT00+FQL/7JNKNEIAxlrl4lpaQMygtuZg5su/JWGG66Yik+V3NskkncB+IM2zw== X-Received: by 10.37.170.243 with SMTP id t106mr24672262ybi.171.1487160493085; Wed, 15 Feb 2017 04:08:13 -0800 (PST) MIME-Version: 1.0 Received: by 10.37.11.214 with HTTP; Wed, 15 Feb 2017 04:07:32 -0800 (PST) In-Reply-To: References: From: Sergi Vladykin Date: Wed, 15 Feb 2017 15:07:32 +0300 Message-ID: Subject: Re: DML data streaming To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary=94eb2c193f30ea216d05489088df archived-at: Wed, 15 Feb 2017 12:08:23 -0000 --94eb2c193f30ea216d05489088df Content-Type: text/plain; charset=UTF-8 I don't see any improvement here. Usability will only suffer with this change. I'd suggest to just add mapping for system columns like _key, _val , _ver. Sergi 2017-02-15 13:18 GMT+03:00 Vladimir Ozerov : > I think the whole QueryEntity class require rework to allow for this > change. I would start with creating QueryField class which will encapsulate > all field properties which are currently set through different setters: > > class QueryField { > String name; > String type; > String alias; > boolean keyField; > } > > class QueryEntity { > String tableName; > String keyType; > String valType; > Collection fields; > Collection indexes; > } > > Then we can add optional key and value field names to top-level config. If > set, key and/or value will have names and will be included into SELECT * > query in the same way as we do this for _KEY and _VAL at the moment: > > class QueryEntity { > String tableName; > String keyType; > String valType; > * String keyFieldName;* > * String valFieldName;* > Collection fields; > Collection indexes; > } > > Any other ideas? > > On Tue, Feb 14, 2017 at 9:19 PM, Dmitriy Setrakyan > wrote: > > > Vova, > > > > Agree about the primitive types. However, it is not clear to me how the > > mapping from a primitive type to a column name will be supported. Do you > > have a design in mind? > > > > D. > > > > On Tue, Feb 14, 2017 at 6:16 AM, Vladimir Ozerov > > wrote: > > > > > Dima, > > > > > > This will not work for primitive keys and values as currently the only > > way > > > to address them is to use "_KEY" and "_VAL" aliases respectively. For > > this > > > reason I would rather postpone UPDATE/DELETE implementation until > "_KEY" > > > and "_VAL" are hidden from public API and some kind of mapping is > > > introduced. AFAIK this should be handled as a part of IGNITE-3487 ]1]. > > > > > > [1] https://issues.apache.org/jira/browse/IGNITE-3487 > > > > > > On Sat, Feb 11, 2017 at 3:36 AM, Dmitriy Setrakyan < > > dsetrakyan@apache.org> > > > wrote: > > > > > > > On Fri, Feb 10, 2017 at 3:36 AM, Vladimir Ozerov < > vozerov@gridgain.com > > > > > > > wrote: > > > > > > > > > I propose to ship streaming with INSERT support only for now. This > is > > > > > enough for multitude cases and will add value to Ignite 1.9 > > > immediately. > > > > We > > > > > can think about correct streaming UPDATE/DELETE architecture > > separately > > > > .It > > > > > is much more difficult thing, we cannot support it in a clean way > > right > > > > now > > > > > due to multiple "_key" and "_val" usages over the code base. > > > > > > > > > > > > > Vova, I disagree. If all parts of the key are present, then we can > > always > > > > construct a key in all cases. For these operations we can always > > support > > > > streaming. For all other operations, we can delegate to standard MR, > > but > > > > still perform most operations on the same node, as I suggested in > > another > > > > email. > > > > > > > > > > --94eb2c193f30ea216d05489088df--