Return-Path: X-Original-To: apmail-giraph-dev-archive@www.apache.org Delivered-To: apmail-giraph-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7B853D155 for ; Sat, 30 Jun 2012 20:28:44 +0000 (UTC) Received: (qmail 83071 invoked by uid 500); 30 Jun 2012 20:28:44 -0000 Delivered-To: apmail-giraph-dev-archive@giraph.apache.org Received: (qmail 83031 invoked by uid 500); 30 Jun 2012 20:28:44 -0000 Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@giraph.apache.org Delivered-To: mailing list dev@giraph.apache.org Received: (qmail 83022 invoked by uid 500); 30 Jun 2012 20:28:44 -0000 Delivered-To: apmail-incubator-giraph-dev@incubator.apache.org Received: (qmail 83019 invoked by uid 99); 30 Jun 2012 20:28:44 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Jun 2012 20:28:44 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id D24211402B5 for ; Sat, 30 Jun 2012 20:28:43 +0000 (UTC) Date: Sat, 30 Jun 2012 20:28:42 +0000 (UTC) From: "Eli Reisman (JIRA)" To: giraph-dev@incubator.apache.org Message-ID: <1292294535.75799.1341088123863.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Created] (GIRAPH-227) ArrayWritables and their sub-classes don't play well with GiraphJob.run() MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Eli Reisman created GIRAPH-227: ---------------------------------- Summary: ArrayWritables and their sub-classes don't play well with GiraphJob.run() Key: GIRAPH-227 URL: https://issues.apache.org/jira/browse/GIRAPH-227 Project: Giraph Issue Type: Bug Components: graph, test Affects Versions: 0.2.0 Reporter: Eli Reisman Fix For: 0.2.0 Twice now (GIRAPH-157 and GIRAPH-217) I have attempted to implement vertices that use ArrayWritables (including subclassing as described in Hadoop docs, and the generic String[] version with its own constructor). Although the code will compile and compute() can successfully be unit tested, a real run breaks the code. Thanks to Sean Choi (also struggling with this) for helping me figure out I'm not crazy, this is a real issue. A guick grep in Giraph reveals no one else is using them yet, so maybe thats why this has gotten past us thus far. I am happy to take a hard look at GiraphJob (etc) and see if i can figure a workaround, but this one might be above my pay grade. Help! Incidently, I used Sean's solution in 157 to simple output final data tuples as Text vertex values, but this is wasteful and not good for bulk data processing. Could be something about our output formats, but between us we have attempted several with no dice. If I have just been a newbie and missed something, please let me know, otherwise I'm going to change GIRAPH-217 to use Text output as well, and fix it again later when this issue is resolved. Thanks for your help! -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira