Return-Path: Delivered-To: apmail-incubator-pig-dev-archive@locus.apache.org Received: (qmail 42329 invoked from network); 2 Apr 2008 20:13:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 2 Apr 2008 20:13:55 -0000 Received: (qmail 43336 invoked by uid 500); 2 Apr 2008 20:13:55 -0000 Delivered-To: apmail-incubator-pig-dev-archive@incubator.apache.org Received: (qmail 43292 invoked by uid 500); 2 Apr 2008 20:13:55 -0000 Mailing-List: contact pig-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: pig-dev@incubator.apache.org Delivered-To: mailing list pig-dev@incubator.apache.org Received: (qmail 43277 invoked by uid 99); 2 Apr 2008 20:13:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Apr 2008 13:13:54 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Apr 2008 20:13:12 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6665A234C0B8 for ; Wed, 2 Apr 2008 13:11:24 -0700 (PDT) Message-ID: <1232149362.1207167084418.JavaMail.jira@brutus> Date: Wed, 2 Apr 2008 13:11:24 -0700 (PDT) From: "Olga Natkovich (JIRA)" To: pig-dev@incubator.apache.org Subject: [jira] Updated: (PIG-55) Allow user control over split creation In-Reply-To: <8311784.1199848113878.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/PIG-55?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-55: ------------------------------ Resolution: Fixed Status: Resolved (was: Patch Available) > Allow user control over split creation > -------------------------------------- > > Key: PIG-55 > URL: https://issues.apache.org/jira/browse/PIG-55 > Project: Pig > Issue Type: Improvement > Affects Versions: 0.0.0 > Reporter: Charlie Groves > Fix For: 0.1.0 > > Attachments: pig_chunker_split.patch, pig_chunker_split_v2.patch, pig_chunker_split_v3.patch, pig_chunker_split_v4.patch, pig_chunker_split_v5.patch, pig_chunker_split_v6.patch, pig_chunker_split_v7.patch, replaceable_PigSplit.diff, replaceable_PigSplit_v2.diff > > > I have a dataset in HDFS that's stored in a file per column that I'd like to access from pig. This means I can't use LoadFunc to get at the data as it only allows the loader access to a single input stream at a time. To handle this usage, I've broken the existing split creation code out into a few classes and interfaces, and allowed user specified load functions to be used in place of the existing code. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.