Return-Path: X-Original-To: apmail-kylin-dev-archive@minotaur.apache.org Delivered-To: apmail-kylin-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 234F717C2F for ; Mon, 2 Mar 2015 17:32:05 +0000 (UTC) Received: (qmail 70291 invoked by uid 500); 2 Mar 2015 17:32:04 -0000 Delivered-To: apmail-kylin-dev-archive@kylin.apache.org Received: (qmail 70243 invoked by uid 500); 2 Mar 2015 17:32:04 -0000 Mailing-List: contact dev-help@kylin.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kylin.incubator.apache.org Delivered-To: mailing list dev@kylin.incubator.apache.org Received: (qmail 70081 invoked by uid 99); 2 Mar 2015 17:32:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2015 17:32:04 +0000 X-ASF-Spam-Status: No, hits=-13.0 required=5.0 tests=ENV_AND_HDR_SPF_MATCH,RCVD_IN_DNSWL_HI,SPF_PASS,USER_IN_DEF_SPF_WL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sadunuthula@ebay.com designates 216.113.172.64 as permitted sender) Received: from [216.113.172.64] (HELO phx-mipot-001.corp.ebay.com) (216.113.172.64) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2015 17:31:58 +0000 DomainKey-Signature: s=ebaycorp; d=ebay.com; c=nofws; q=dns; h=X-EBay-Corp:X-IronPort-AV:Received:Received:From:To: Subject:Thread-Topic:Thread-Index:Date:Message-ID: References:In-Reply-To:Accept-Language:Content-Language: X-MS-Has-Attach:X-MS-TNEF-Correlator:x-originating-ip: Content-Type:Content-ID:Content-Transfer-Encoding: MIME-Version:X-CFilter; b=DQMAzrEyW8o3SVslm5Ay106mb56BjOdpquh0R+h0lcgVBm/+lswiSOIX fw4l+GhwndnBoPsA/KM+e4j3Sa58EPKs8nVPgUjqA+agrRjiU7dWypCBP Lru+tIPTRi3ziamqlPLwt49SDPX5FOkH5eWARhoPARYu6cEhDazekWlDH M=; DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ebay.com; i=@ebay.com; q=dns/txt; s=ebaycorp; t=1425317518; x=1456853518; h=from:to:subject:date:message-id:references:in-reply-to: content-id:content-transfer-encoding:mime-version; bh=draofC0qbmBZNu802Y+BKiWnnHiaMUdj3DdzOSmFPwk=; b=gMgYgxnPMTU4uxKnhpx3Ndwk84cwtDLA3M6ciNEumMAAfXU60DbyrPJP FpLgW66e0JqnseNYfekRF3pZf8U3Pe9MKVn+1991ZRpOQWYpDPqcKvrsn dS5b+Lt7IWMbCNEoTYBZ4laEriViIPilnvZXWKQPLFtOZP8rKDfSOBhW3 Q=; X-EBay-Corp: Yes X-IronPort-AV: E=Sophos;i="5.09,676,1418112000"; d="scan'208";a="219446066" Received: from phx-vteml-004.corp.ebay.com (HELO PHX-EXMHT-001.corp.ebay.com) ([10.58.40.103]) by phx-mipot-001.corp.ebay.com with ESMTP; 02 Mar 2015 09:30:37 -0800 Received: from PHX-EXRDA-S61.corp.ebay.com ([169.254.11.11]) by PHX-EXMHT-001.corp.ebay.com ([10.58.12.70]) with mapi id 14.03.0224.002; Mon, 2 Mar 2015 10:30:37 -0700 From: "Adunuthula, Seshu" To: "dev@kylin.incubator.apache.org" Subject: Re: Tez Thread-Topic: Tez Thread-Index: AQHQVOfDjcoEsXi+nUOs6YfTz0cVk50JHruAgACkvwD//4+pdYAAfxmAgAAAqAD//4+4AA== Date: Mon, 2 Mar 2015 17:30:37 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.241.16.197] Content-Type: text/plain; charset="iso-8859-1" Content-ID: <2AD70026399882419C1C75BB8836295C@corp.ebay.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-CFilter: Scanned X-Virus-Checked: Checked by ClamAV on apache.org Jakob, Could you go ahead and file a JIRA with the stack trace at https://issues.apache.org/jira/browse/KYLIN/ Also include the App Master and Map/Reduce Task logs for the Tasks that failed. Regards Seshu On 3/2/15, 8:12 AM, "Jakob Steng=E5rd" wrote: >Correction: That, isn't the last job, it's step 9. > >/J > >On Mon, Mar 2, 2015 at 5:10 PM, Jakob Steng=E5rd >wrote: > >> Well, this only happens with >> >> hive.execution.engine >> tez >> >> >> If i use mr, it works fine. >> >> >> From what i can see form the job log, none of the previous map-reduce >>jobs >> fail, but the build fails at the last step. >> Log from the last mr job for example: >> http://pastebin.com/jNWSRKLi >> >> >> Is tez supposed to work? Because in that case, maybe it's just my setup. >> >> /Jakob >> >> >> >> On Mon, Mar 2, 2015 at 4:34 PM, Santosh Akhilesh < >> santoshakhilesh@gmail.com> wrote: >> >>> This doesn't seems to be complete kylin.log. Do you have any exception >>> related to MR counter in map reduce logs? If yes then this needs to be >>> checked because kylin will need the MR counter to calculate the cube >>>size. >>> On Mon, 2 Mar 2015 at 8:49 pm, Jakob Steng=E5rd >>> >>> wrote: >>> >>> > It breaks on the last step: "Load HFile to HBase Table": >>> > >>> > Kylin.log: >>> > http://pastebin.com/3kAQmJ3u >>> > >>> > On Mon, Mar 2, 2015 at 2:27 PM, Adunuthula, Seshu >>>>> > >>> > wrote: >>> > >>> > > Jakob, >>> > > >>> > > Could you please send out the complete stack trace with Tez >>>enabled? >>> > > >>> > > Regards >>> > > Seshu >>> > > >>> > > On 3/2/15, 4:51 AM, "Jakob Steng=E5rd" >>> wrote: >>> > > >>> > > >Hi >>> > > >Will kylin suport hive+tez in v0.7.x? >>> > > > >>> > > >I've tried using tez with hive, but currently the cube build fails >>> with >>> > > >"Can't get cube source record size", because kylin expects certain >>> > console >>> > > >output from map-reduce, and tez doesn't print this. >>> > > > >>> > > >BG. >>> > > >Jakob Stengard >>> > > >>> > > >>> > >>> >> >>