Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@crunch.apache.org
Date: Tue, 4 Feb 2014 15:36:09 +0000 (UTC)
From: "Josh Wills (JIRA)" <jira@apache.org>
To: crunch-dev@incubator.apache.org
Message-ID: <JIRA.12693120.1391526509301.34236.1391528169729@arcas>
In-Reply-To: <JIRA.12693120.1391526509301@arcas>
References: <JIRA.12693120.1391526509301@arcas>
Subject: [jira] [Commented] (CRUNCH-337) Make it easier to use multiple
 input paths
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CRUNCH-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890773#comment-13890773 ] 

Josh Wills commented on CRUNCH-337:
-----------------------------------

We do our best. I'll see if any of the other committers have an opinion and if it looks good, I'll commit it later today Pacific Time.

> Make it easier to use multiple input paths
> ------------------------------------------
>
>                 Key: CRUNCH-337
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-337
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.9.0
>            Reporter: Matthew Basil
>            Assignee: Josh Wills
>            Priority: Minor
>         Attachments: CRUNCH-337.patch
>
>
> It would be more user-friendly, especially for newbies, to provides methods on {{From}} for creating sources from multiple {{Path}}s.  I'm currently attempting to write my first Crunch Pipeline, which needs to read from multiple paths using a custom input format, and I needed to dig into the source for {{From.formattedFile}} to see I need to do something like this
> {code}
> PTableType<K, V> tableType = keyType.getFamily().tableOf(keyType, valueType);
> return new FileTableSourceImpl<K, V>(paths, tableType, formatClass);
> {code}
> I don't particularly mind, but other potential new users might be a bit put off by having to look at the source on the first line of their first pipeline. If it's undesirable to double the number of methods in {{From}} by doing this (which is understandable), it might be nice to add some note on multiple input paths to the section of the users guide on {{Source}}s.
> Thanks!


--
This message was sent by Atlassian JIRA
(v6.1.5#6160)