Return-Path: Delivered-To: apmail-hadoop-hive-user-archive@locus.apache.org Received: (qmail 13192 invoked from network); 10 Dec 2008 09:08:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 10 Dec 2008 09:08:52 -0000 Received: (qmail 20853 invoked by uid 500); 10 Dec 2008 09:09:05 -0000 Delivered-To: apmail-hadoop-hive-user-archive@hadoop.apache.org Received: (qmail 20833 invoked by uid 500); 10 Dec 2008 09:09:05 -0000 Mailing-List: contact hive-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-user@hadoop.apache.org Delivered-To: mailing list hive-user@hadoop.apache.org Received: (qmail 20824 invoked by uid 99); 10 Dec 2008 09:09:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Dec 2008 01:09:05 -0800 X-ASF-Spam-Status: No, hits=4.0 required=10.0 tests=HTML_FONT_FACE_BAD,HTML_MESSAGE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.200.169] (HELO wf-out-1314.google.com) (209.85.200.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Dec 2008 09:08:51 +0000 Received: by wf-out-1314.google.com with SMTP id 24so69526wfg.2 for ; Wed, 10 Dec 2008 01:08:29 -0800 (PST) Received: by 10.142.84.3 with SMTP id h3mr123808wfb.149.1228900109595; Wed, 10 Dec 2008 01:08:29 -0800 (PST) Received: from ?192.168.1.102? (c-71-202-152-68.hsd1.ca.comcast.net [71.202.152.68]) by mx.google.com with ESMTPS id 22sm595350wfd.53.2008.12.10.01.08.28 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 10 Dec 2008 01:08:29 -0800 (PST) Message-Id: <2D17A1D2-57EE-4CC1-A31B-807CE344C5B6@besquared.net> From: Josh Ferguson To: hive-user@hadoop.apache.org In-Reply-To: Content-Type: multipart/alternative; boundary=Apple-Mail-1--662664231 Mime-Version: 1.0 (Apple Message framework v929.2) Subject: Re: Failed Query Date: Wed, 10 Dec 2008 01:08:42 -0800 References: X-Mailer: Apple Mail (2.929.2) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-1--662664231 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit I should say this is during the last reduction step that occures in this query Josh On Dec 10, 2008, at 1:06 AM, Josh Ferguson wrote: > This Query > > INSERT OVERWRITE TABLE aggregations PARTITION ( account='80c27664- > b047-4c0a-86f3-342c0cdf36c7', application='myproduct', > dataset='purchase', hour=341165, aggregation='count', > aggregated_by='all' ) SELECT COUNT(actor_id) AS value FROM > activities WHERE ( account='80c27664-b047-4c0a-86f3-342c0cdf36c7' > AND application='myproduct' AND dataset='purchase' AND hour=341165 ) > > Generates this message > > java.lang.RuntimeException: Error while closing operators: > org.apache.hadoop.hive.ql.metadata.HiveException: > org.apache.hadoop.hive.serde2.SerDeException: > org.apache.hadoop.hive.serde2.SerDeException: Trying to serialize 0 > fields into a struct with 1 > at > org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:202) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:440) > at org.apache.hadoop.mapred.Child.main(Child.java:155) > > > Josh Ferguson --Apple-Mail-1--662664231 Content-Type: text/html; charset=US-ASCII Content-Transfer-Encoding: quoted-printable I should say this is during the = last reduction step that occures in this = query

Josh

On Dec 10, 2008, = at 1:06 AM, Josh Ferguson wrote:

This = Query

INSERT OVERWRITE TABLE aggregations = PARTITION ( account=3D'80c27664-b047-4c0a-86f3-342c0cdf36c7', = application=3D'myproduct', dataset=3D'purchase', hour=3D341165, = aggregation=3D'count', aggregated_by=3D'all' ) SELECT COUNT(actor_id) AS = value FROM activities WHERE ( = account=3D'80c27664-b047-4c0a-86f3-342c0cdf36c7' AND = application=3D'myproduct' AND dataset=3D'purchase' AND hour=3D341165 = )

Generates this = message
java.lang.RuntimeException: Error while = closing operators: org.apache.hadoop.hive.ql.metadata.HiveException: = org.apache.hadoop.hive.serde2.SerDeException: = org.apache.hadoop.hive.serde2.SerDeException: Trying to serialize 0 = fields into a struct with 1 at = org.apache.hadoop.hive.ql.exec.ExecReducer.close(ExecReducer.java:202) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:440) at org.apache.hadoop.mapred.Child.main(Child.java:155)
<= div>Josh = Ferguson