Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 02EAC10C48 for ; Mon, 27 Apr 2015 13:18:54 +0000 (UTC) Received: (qmail 88990 invoked by uid 500); 27 Apr 2015 13:18:52 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 88925 invoked by uid 500); 27 Apr 2015 13:18:52 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 88915 invoked by uid 99); 27 Apr 2015 13:18:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Apr 2015 13:18:51 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: message received from 54.191.145.13 which is an MX secondary for user@hive.apache.org) Received: from [54.191.145.13] (HELO mx1-us-west.apache.org) (54.191.145.13) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Apr 2015 13:18:44 +0000 Received: from sulu.netzoomi.net (sulu.netzoomi.net [83.138.144.103]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTP id E8A3D2738B for ; Mon, 27 Apr 2015 13:18:23 +0000 (UTC) Received: from vulcan.netzoomi.net (unknown [212.100.249.54]) by sulu.netzoomi.net (Postfix) with ESMTP id 62B426A4861 for ; Mon, 27 Apr 2015 14:17:51 +0100 (BST) X-Envelope-From: Received: from vista (cpc7-seve18-2-0-cust228.13-3.cable.virginm.net [86.19.240.229]) by vulcan.netzoomi.net (Postfix) with ESMTPA id 11ADC1248022 for ; Mon, 27 Apr 2015 14:17:51 +0100 (BST) From: "Mich Talebzadeh" To: Subject: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Exception while processing Date: Mon, 27 Apr 2015 14:16:59 +0100 Message-ID: <02b401d080ec$7126f4c0$5374de40$@co.uk> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_02B5_01D080F4.D2EB5CC0" X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: AdCA7HDasIs0OQ6ASfOvjbentHfzOQ== Content-Language: en-gb X-domainnameshop-MailScanner-Information: Please contact the ISP for more information X-domainnameshop-MailScanner-ID: 62B426A4861.A24D2 X-domainnameshop-MailScanner: Found to be clean X-domainnameshop-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=1.275, required 5, autolearn=disabled, HTML_MESSAGE 0.00, RDNS_NONE 1.27) X-domainnameshop-MailScanner-SpamScore: 1 X-domainnameshop-MailScanner-From: mich@peridale.co.uk X-domainnameshop-MailScanner-Watermark: 1430745472.49865@Y9Ab5hWvMzWM3ueM5s4a1w X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Status: No This is a multi-part message in MIME format. ------=_NextPart_000_02B5_01D080F4.D2EB5CC0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, Has anyone seen this error in the process of loading 1 million rows into hive table t (no partition or bucket) in batch of 10K rows at a time through a temp table Loading data to table asehadoop.rs_temp__0x150dd470_t Table asehadoop.rs_temp__0x150dd470_t stats: [numFiles=1, numRows=0, totalSize=2242, rawDataSize=0] OK Query ID = hduser_20150427110303_05026b43-54d5-4d1b-bf52-f0d49b3455b4 Total jobs = 3 Launching Job 1 out of 3 Number of reduce tasks is set to 0 since there's no reduce operator Starting Job = job_1430123093051_0140, Tracking URL = http://rhes564:8088/proxy/application_1430123093051_0140/ Kill Command = /home/hduser/hadoop/hadoop-2.6.0/bin/hadoop job -kill job_1430123093051_0140 Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0 2015-04-27 11:03:50,276 Stage-1 map = 0%, reduce = 0% 2015-04-27 11:03:56,399 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.33 sec MapReduce Total cumulative CPU time: 1 seconds 330 msec Ended Job = job_1430123093051_0140 Stage-4 is selected by condition resolver. Stage-3 is filtered out by condition resolver. Stage-5 is filtered out by condition resolver. Moving data to: hdfs://rhes564:9000/tmp/hive/hduser/45ae2966-7f31-48d5-a17c-b3ebe194609a/hiv e_2015-04-27_11-03-35_746_6949414871530584623-35/-ext-10000 Loading data to table asehadoop.t Table asehadoop.t stats: [numFiles=136, numRows=770067, totalSize=1724297463, rawDataSize=1723527396] MapReduce Jobs Launched: Stage-Stage-1: Map: 1 Cumulative CPU: 1.33 sec HDFS Read: 2507 HDFS Write: 2314 SUCCESS Total MapReduce CPU Time Spent: 1 seconds 330 msec OK OK OK FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Exception while processing t That is it. No real error etc! Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books "A Practitioner's Guide to Upgrading to Sybase ASE 15", ISBN 978-0-9563693-0-7. co-author "Sybase Transact SQL Guidelines Best Practices", ISBN 978-0-9759693-0-4 Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache Oracle and Sybase, Concepts and Contrasts, ISBN: 978-0-9563693-1-4, volume one out shortly NOTE: The information in this email is proprietary and confidential. This message is for the designated recipient only, if you are not the intended recipient, you should destroy it immediately. Any information in this message shall not be understood as given or endorsed by Peridale Ltd, its subsidiaries or their employees, unless expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. ------=_NextPart_000_02B5_01D080F4.D2EB5CC0 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

Has anyone = seen this error in the process of loading 1 million rows into hive table = t (no partition or bucket) in batch of 10K rows at a time through = a temp table

 

Loading = data to table asehadoop.rs_temp__0x150dd470_t

Table asehadoop.rs_temp__0x150dd470_t stats: = [numFiles=3D1, numRows=3D0, totalSize=3D2242, = rawDataSize=3D0]

OK

Query ID = =3D = hduser_20150427110303_05026b43-54d5-4d1b-bf52-f0d49b3455b4

Total = jobs =3D 3

Launching Job 1 out of 3

Number of reduce tasks is set to 0 since there's no = reduce operator

Starting = Job =3D job_1430123093051_0140, Tracking URL =3D = http://rhes564:8088/proxy/application_1430123093051_0140/

Kill = Command =3D /home/hduser/hadoop/hadoop-2.6.0/bin/hadoop job  -kill = job_1430123093051_0140

Hadoop = job information for Stage-1: number of mappers: 1; number of reducers: = 0

2015-04-27 11:03:50,276 Stage-1 map =3D 0%,  = reduce =3D 0%

2015-04-27 11:03:56,399 Stage-1 map =3D 100%,  = reduce =3D 0%, Cumulative CPU 1.33 sec

MapReduce Total cumulative CPU time: 1 seconds 330 = msec

Ended = Job =3D job_1430123093051_0140

Stage-4 is selected by condition = resolver.

Stage-3 = is filtered out by condition resolver.

Stage-5 is filtered out by condition = resolver.

Moving = data to: = hdfs://rhes564:9000/tmp/hive/hduser/45ae2966-7f31-48d5-a17c-b3ebe194609a/= hive_2015-04-27_11-03-35_746_6949414871530584623-35/-ext-10000=

Loading = data to table asehadoop.t

Table asehadoop.t stats: [numFiles=3D136, = numRows=3D770067, totalSize=3D1724297463, = rawDataSize=3D1723527396]

MapReduce Jobs Launched:

Stage-Stage-1: Map: 1   Cumulative CPU: 1.33 = sec   HDFS Read: 2507 HDFS Write: 2314 = SUCCESS

Total = MapReduce CPU Time Spent: 1 seconds 330 msec

OK

OK

OK

FAILED: = Execution Error, return code 1 from = org.apache.hadoop.hive.ql.exec.DDLTask. Exception while processing = t

 

T= hat is it. No real error etc!

<= o:p> 

T= hanks

<= o:p> 

 <= /span>

Mich = Talebzadeh

 <= /span>

h= ttp://talebzadehmich.wordpress.com

 

Author of the = books "A Practitioner’s Guide to Upgrading to = Sybase ASE = 15", ISBN = 978-0-9563693-0-7. =

co-author = "Sybase Transact SQL Guidelines Best Practices", ISBN = 978-0-9759693-0-4

Publications due shortly:

Cr= eating in-memory Data Grid for Trading Systems with Oracle TimesTen and = Coherence Cache

Oracle and = Sybase, Concepts and Contrasts, = ISBN: = 978-0-9563693-1-4, volume one out = shortly

<= o:p> 

NO= TE: The information in this email is proprietary and confidential. This = message is for the designated recipient only, if you are not the = intended recipient, you should destroy it immediately. Any information = in this message shall not be understood as given or endorsed by Peridale = Ltd, its subsidiaries or their employees, unless expressly so stated. It = is the responsibility of the recipient to ensure that this email is = virus free, therefore neither Peridale Ltd, its subsidiaries nor their = employees accept any responsibility.

 

------=_NextPart_000_02B5_01D080F4.D2EB5CC0--