Return-Path: Delivered-To: apmail-hadoop-chukwa-dev-archive@minotaur.apache.org Received: (qmail 86997 invoked from network); 9 Feb 2010 16:27:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 9 Feb 2010 16:27:49 -0000 Received: (qmail 82088 invoked by uid 500); 9 Feb 2010 16:27:49 -0000 Delivered-To: apmail-hadoop-chukwa-dev-archive@hadoop.apache.org Received: (qmail 82036 invoked by uid 500); 9 Feb 2010 16:27:49 -0000 Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@hadoop.apache.org Delivered-To: mailing list chukwa-dev@hadoop.apache.org Received: (qmail 82026 invoked by uid 99); 9 Feb 2010 16:27:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Feb 2010 16:27:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Feb 2010 16:27:48 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id E4B06234C052 for ; Tue, 9 Feb 2010 08:27:27 -0800 (PST) Message-ID: <1516410092.152611265732847935.JavaMail.jira@brutus.apache.org> Date: Tue, 9 Feb 2010 16:27:27 +0000 (UTC) From: "Eric Yang (JIRA)" To: chukwa-dev@hadoop.apache.org Subject: [jira] Commented: (CHUKWA-452) ChukwaArchive byte[] needs to be wrapped in DataByteArray In-Reply-To: <322657879.148951265720547967.JavaMail.jira@brutus.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CHUKWA-452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831523#action_12831523 ] Eric Yang commented on CHUKWA-452: ---------------------------------- This actually changes Chukwa Archive format to be pig specific. ChukwaArchive should be extensible to become archiver for pig data format. It would be better that to leave Chukwa Archive as it is and create a new archiver class to extend on top of this one. What do you guys think? > ChukwaArchive byte[] needs to be wrapped in DataByteArray > --------------------------------------------------------- > > Key: CHUKWA-452 > URL: https://issues.apache.org/jira/browse/CHUKWA-452 > Project: Hadoop Chukwa > Issue Type: Bug > Affects Versions: 0.4.0 > Reporter: Gerrit Jansen van Vuuren > Fix For: 0.4.0 > > Attachments: CHUKWA-452.patch > > > I've been trying to read the data inserted into /chukwa/finalArchives using the ChukwaArchive Loader in pig. > On trying to STORE only the data field using BinaryStore I get: > FAILED > java.lang.ClassCastException: [B cannot be cast to org.apache.pig.data.DataByteArray > at org.apache.pig.builtin.BinaryStorage.putNext(BinaryStorage.java:128) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:200) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:174) > at org.apache.hadoop.mapred.MapTask$DirectMapOutputCollector.collect(MapTask.java:642) > at org.apache.hadoop.mapred.MapTask$OldOutputCollector.collect(MapTask.java:466) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.collect(PigMapOnly.java:70) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:255) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:244) > at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:65) > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) > at org.apache.hadoop.mapred.Child.main(Child.java:170) > Looking at the ChukwaArchive class I saw that the data:byte[] is set to the Tuple without wrapping to DataByteArray. > The patch I'm submitting applies this change by wrapping the data:byte[] with the DataByteArray class. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.