From user-return-4427-archive-asf-public=cust-asf.ponee.io@kylin.apache.org Fri Jun 14 02:52:32 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 89E0B18064E for ; Fri, 14 Jun 2019 04:52:32 +0200 (CEST) Received: (qmail 30427 invoked by uid 500); 14 Jun 2019 02:52:31 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 30417 invoked by uid 99); 14 Jun 2019 02:52:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Jun 2019 02:52:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id ED582C28E1 for ; Fri, 14 Jun 2019 02:52:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.06 X-Spam-Level: ** X-Spam-Status: No, score=2.06 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id HJ9DkvWX09FZ for ; Fri, 14 Jun 2019 02:52:29 +0000 (UTC) Received: from mail-io1-f68.google.com (mail-io1-f68.google.com [209.85.166.68]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 51C075F1BE for ; Fri, 14 Jun 2019 02:52:28 +0000 (UTC) Received: by mail-io1-f68.google.com with SMTP id k8so2648758iot.1 for ; Thu, 13 Jun 2019 19:52:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=ApUxTD+VH8a4X1IlicL0jWqHZO7ozYrUAzL5BGlrJ5A=; b=QlCxQLfQwrWoQcTNHBPA6XZMltEft47IBtkKRHZm8nT+0Mxu89SnEqKVMNgEyFgvJm yWww8hBOm4046Hyayl/KXIcbi2QZDCv8PJSZ470M/mrahlEe3CvXURmQuNMORR0uz4Tq MjFYJ2uZ3kajNSDn2z7HiHaF7o9tsH29P89mr+uh3wUKQfBsHHYv2IIbB01YPpKVFSiL HKg6o0HNP+hoJeNtdI52bQf/nqe6rdQvB6XVKO2NJXKP1lRpx+XhOdU5P6n9/026aQnU 0hZw5ZOFo0MwRYLZxG/1Ttqg1MGlRHPtUADDJh+Y7IBZfx3kT4YvjEXZuRB38r0g5bEY UrBQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ApUxTD+VH8a4X1IlicL0jWqHZO7ozYrUAzL5BGlrJ5A=; b=Uo9/66i5azuv/pnhhciJRcYjv0TfiVKXix5GyY83JLlYXzRN6nWeg5w/QAGq3YkZTA 5+lwZlFc55hMRJMdAZTX0b38cKejh+FYVUL/WKenFM139v5h0We3cizx1ls+Cgkub6aG mkvH5mOCUqAm7zofGSnwbvfCUgdlcQIVIoidrppWoFcK+0+qSNr2ddAIAdpzrfKRxFnZ 4daHNxOzocRm010gClWjtYV1iJXSy+5JjNBZie2k/j4aE0fb+yQZnHhDJvSftNvFC92T WTlEEyi3v+OrJGMqB0NY1icEVssIm1EWe88vuyqlvD+SUGlS0OavV2D3dYR3Kc0yDaHI 2qUw== X-Gm-Message-State: APjAAAXiL5E05EUvZVETa130vM6nxvIlWmRYXzQnP1x4J1L3b3rXom+o rX4khekLaW2exPNNadGn8dTaa1wKDaMvxf0uVSDmWgut X-Google-Smtp-Source: APXvYqw23hGZnlftp/l4FJbi7sul9yOBagFHOKoWzXNnZnND9THdOaCRPUq9zVuiKZ4LtuoyvMffRYNOjmbunLM2xdQ= X-Received: by 2002:a02:ce52:: with SMTP id y18mr58703719jar.78.1560480747072; Thu, 13 Jun 2019 19:52:27 -0700 (PDT) MIME-Version: 1.0 References: <201906131703389296647@ymm56.com> In-Reply-To: <201906131703389296647@ymm56.com> From: Chao Long Date: Fri, 14 Jun 2019 10:52:16 +0800 Message-ID: Subject: =?UTF-8?B?UmU6IOWIhuWPkeS4remXtOihqOaVsOaNruWAvuaWnA==?= To: user@kylin.apache.org Content-Type: multipart/alternative; boundary="0000000000009bb2f4058b3fbcf7" --0000000000009bb2f4058b3fbcf7 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: base64 SGkgd2FuZywNCiAgICJESVNUUklCVVRFIEJZIFJBTkQoKSIgbWF5IGNhdXNlIGRhdGEgaW5jb25z aXN0ZW5jeSwgc28gd2UgY2hhbmdlZCBpdCB0bw0KZGlzdHJpYnV0ZSBieSB0aGUgZmlyc3QgZmV3 IGNvbHVtbnMgb2YgIHRoZSByb3drZXksIGFuZCB0aGUgZGVmYXVsdCBpcyB0aGUNCmZpcnN0IDMg Y29sdW1ucy4gWW91IGNhbiBzZWUgdGhlIGZvbGxvd2luZyBpc3N1ZXMgZm9yIG1vcmUgZGV0YWls cy4gSWYgeW91DQpkb24ndCBoYXZlIGEgZGF0YSBza2V3IHByb2JsZW0sIHlvdSBjYW4ganVzdCBk aXNhYmxlIHRoZSAicmVkaXN0cmlidXRlIg0Kc3RlcCBieSBzZXR0aW5nICJreWxpbi5zb3VyY2Uu aGl2ZS5yZWRpc3RyaWJ1dGUtZmxhdC10YWJsZSIgdG8gZmFsc2UuDQpodHRwczovL2lzc3Vlcy5h cGFjaGUub3JnL2ppcmEvYnJvd3NlL0tZTElOLTMzODgNCmh0dHBzOi8vaXNzdWVzLmFwYWNoZS5v cmcvamlyYS9icm93c2UvS1lMSU4tMzQ1Nw0KDQpPbiBUaHUsIEp1biAxMywgMjAxOSBhdCA1OjAz IFBNIG5pbmcud2FuZ0B5bW01Ni5jb20gPG5pbmcud2FuZ0B5bW01Ni5jb20+DQp3cm90ZToNCg0K PiDmjInnhafmlofmoaPor7Tms5XvvIzph43mlrDliIblj5HkuK3pl7TooajnmoTml7blgJnmmK/p mo/mnLrmlrnlvI9ESVNUUklCVVRFIEJZDQo+IFJBTkQoKe+8jOaIkeeahGN1YmXph4zmsqHmnInm jIflrprliIbniYflrZfmrrXvvIzkvYbmmK/kuI3mmK/mjInnhafpmo/mnLrmlrnlvI/liIblj5Hn moTvvIzogIzmmK/lj5bnmoTnu7TluqblrZfmrrXph4znmoTliY0z5Liq5a2X5q6177yM55Sx5LqO Y3ViZemHjOeahOe7tOW6puayoeaciemrmOWfuue7tOW6puWvvOiHtOaVsOaNruWAvuaWnO+8jA0K PiDmgI7kuYjorr7nva7miY3og73pmo/mnLrliIblj5HlkaLvvIzmiJbogIXmnInku4DkuYjlpb3n moTlu7rorq4NCj4NCj4gLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tDQo+IG5pbmcud2Fu Z0B5bW01Ni5jb20NCj4NCg== --0000000000009bb2f4058b3fbcf7 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi wang,
=C2=A0 =C2=A0"DISTRIBUTE BY RAND()" may cause data=C2=A0inconsistency, so= we changed it to distribute by the first few columns of=C2=A0 the rowkey, = and the default is the first 3 columns. You can see the following issues fo= r more details. If you don't have a data skew problem, you can just dis= able the "redistribute" step by setting "kylin.source.hive.r= edistribute-flat-table" to false.
=

= On Thu, Jun 13, 2019 at 5:03 PM ning= .wang@ymm56.com <ning.wang@ym= m56.com> wrote:
=E6=8C=89=E7=85=A7=E6=96=87=E6=A1=A3=E8=AF=B4=E6=B3=95=EF= =BC=8C=E9=87=8D=E6=96=B0=E5=88=86=E5=8F=91=E4=B8=AD=E9=97=B4=E8=A1=A8=E7=9A= =84=E6=97=B6=E5=80=99=E6=98=AF=E9=9A=8F=E6=9C=BA=E6=96=B9=E5=BC=8FDISTRIBUTE BY RAND()=EF=BC=8C=E6=88=91=E7=9A=84cube=E9=87=8C=E6= =B2=A1=E6=9C=89=E6=8C=87=E5=AE=9A=E5=88=86=E7=89=87=E5=AD=97=E6=AE=B5=EF=BC= =8C=E4=BD=86=E6=98=AF=E4=B8=8D=E6=98=AF=E6=8C=89=E7=85=A7=E9=9A=8F=E6=9C=BA= =E6=96=B9=E5=BC=8F=E5=88=86=E5=8F=91=E7=9A=84=EF=BC=8C=E8=80=8C=E6=98=AF=E5= =8F=96=E7=9A=84=E7=BB=B4=E5=BA=A6=E5=AD=97=E6=AE=B5=E9=87=8C=E7=9A=84=E5=89= =8D3=E4=B8=AA=E5=AD=97=E6=AE=B5=EF=BC=8C=E7=94=B1=E4=BA=8Ecube=E9=87=8C=E7= =9A=84=E7=BB=B4=E5=BA=A6=E6=B2=A1=E6=9C=89=E9=AB=98=E5=9F=BA=E7=BB=B4=E5=BA= =A6=E5=AF=BC=E8=87=B4=E6=95=B0=E6=8D=AE=E5=80=BE=E6=96=9C=EF=BC=8C
=E6=80=8E=E4= =B9=88=E8=AE=BE=E7=BD=AE=E6=89=8D=E8=83=BD=E9=9A=8F=E6=9C=BA=E5=88=86=E5=8F= =91=E5=91=A2=EF=BC=8C=E6=88=96=E8=80=85=E6=9C=89=E4=BB=80=E4=B9=88=E5=A5=BD= =E7=9A=84=E5=BB=BA=E8=AE=AE

--0000000000009bb2f4058b3fbcf7--