Return-Path: X-Original-To: apmail-incubator-crunch-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-crunch-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8214DEB50 for ; Tue, 12 Feb 2013 21:40:05 +0000 (UTC) Received: (qmail 53383 invoked by uid 500); 12 Feb 2013 21:40:05 -0000 Delivered-To: apmail-incubator-crunch-dev-archive@incubator.apache.org Received: (qmail 53358 invoked by uid 500); 12 Feb 2013 21:40:05 -0000 Mailing-List: contact crunch-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: crunch-dev@incubator.apache.org Delivered-To: mailing list crunch-dev@incubator.apache.org Received: (qmail 53344 invoked by uid 99); 12 Feb 2013 21:40:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Feb 2013 21:40:05 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of josh.wills@gmail.com designates 209.85.217.179 as permitted sender) Received: from [209.85.217.179] (HELO mail-lb0-f179.google.com) (209.85.217.179) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Feb 2013 21:39:58 +0000 Received: by mail-lb0-f179.google.com with SMTP id j14so467713lbo.10 for ; Tue, 12 Feb 2013 13:39:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=vrEpQAp1H92wGu7Y7J5Hy9xPCd/JAm45g22YaYhK6mI=; b=X5I3FH8qRtH8InpCv06Rf9XacBqJNL6Y0ZRwrlUlQFmDSK1wLE4cyIB3WDsjjnOY9p SZfIdupwmEnTDkIPTmw5s+f+/VrkR5J/shZoX9IrxiWYNXX6GKyIBda/3jjqNadScdaE eCzcFZdM1cQ74zMdFxzNoE3PXyCjG7/l/7AYTsT/lquiorTKe3mkiODXe+haUtwuAQfO wM3HwhAsza74354RU4EcbaL8KrsedT37GU+DCBd9/MMys8Dz/eb/lKv++WLnExnxnth8 WkMi0V5/YW6wlxiyUsxRipOll2ueXlEnyMqoGmPfEAByvapmCYH4fyweBR38zp+NSv/x plFA== X-Received: by 10.112.28.102 with SMTP id a6mr7715956lbh.109.1360705177281; Tue, 12 Feb 2013 13:39:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.14.71 with HTTP; Tue, 12 Feb 2013 13:39:17 -0800 (PST) In-Reply-To: References: From: Josh Wills Date: Tue, 12 Feb 2013 13:39:17 -0800 Message-ID: Subject: Re: multiple input files as pipeline source? To: crunch Content-Type: multipart/alternative; boundary=f46d040168b3bc652004d58ddcfb X-Virus-Checked: Checked by ClamAV on apache.org --f46d040168b3bc652004d58ddcfb Content-Type: text/plain; charset=ISO-8859-1 Yeah, of course-- that's how stuff like joins work. PTable first = pipeline.read(new TableSource(firstFile)); PTable second = ...; PTable union = first.union(second); etc. On Tue, Feb 12, 2013 at 1:36 PM, Victor Iacoban wrote: > Is there any support in crunch to use multiple sequence files as pipeline > source? > something similar to standard MultipleInputs > > Thanks, > victor > --f46d040168b3bc652004d58ddcfb--