Return-Path: X-Original-To: apmail-crunch-user-archive@www.apache.org Delivered-To: apmail-crunch-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4CD3717244 for ; Mon, 3 Nov 2014 09:07:04 +0000 (UTC) Received: (qmail 46200 invoked by uid 500); 3 Nov 2014 09:07:03 -0000 Delivered-To: apmail-crunch-user-archive@crunch.apache.org Received: (qmail 46160 invoked by uid 500); 3 Nov 2014 09:07:03 -0000 Mailing-List: contact user-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@crunch.apache.org Delivered-To: mailing list user@crunch.apache.org Received: (qmail 46150 invoked by uid 99); 3 Nov 2014 09:07:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2014 09:07:03 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of thilini.gunasekara@gmail.com designates 209.85.214.171 as permitted sender) Received: from [209.85.214.171] (HELO mail-ob0-f171.google.com) (209.85.214.171) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2014 09:06:37 +0000 Received: by mail-ob0-f171.google.com with SMTP id wp18so8743811obc.16 for ; Mon, 03 Nov 2014 01:05:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=htUv0Av1oKvUQAit9PBmkazotv89nkcgn9qPe9a2CB8=; b=dNQgt4salr1mtadLO73yy80C5KFreLxQbUoLyTN5aVIJUs8q6MLjBvIMheModxbVBT inQcCiAP077zL4ZezH9AH8GRIN7Qg/WVYfdn16HeycXc/zLJ0Qi9YQ5lkPz9kTZc56lI GEZpLpuqWCG1M4YeLtFHFUKfxYhuYv22nGf4r0CW5wbBlpE3L0vS1XKeU3admm7YuP6S 0aVGo2TSr7hLzxkNQtV9hE+B7ZUgzT703D6oPuKGA3xOTXUq3SriO0E5QD1i8T9lZpSg TKSF9dymCNPS7M0mkV8IgqmA98sUSIaBijDq85yt5PtSWNjheqS20yIsWgWHhb16bmks gKbQ== MIME-Version: 1.0 X-Received: by 10.182.1.170 with SMTP id 10mr3968obn.62.1415005551019; Mon, 03 Nov 2014 01:05:51 -0800 (PST) Received: by 10.76.92.67 with HTTP; Mon, 3 Nov 2014 01:05:50 -0800 (PST) Date: Mon, 3 Nov 2014 14:35:50 +0530 Message-ID: Subject: Input source Text() does not exist! From: Pavithra Siriwardena To: user@crunch.apache.org Content-Type: multipart/alternative; boundary=001a1134a2c4394ca30506f0a75b X-Virus-Checked: Checked by ClamAV on apache.org --001a1134a2c4394ca30506f0a75b Content-Type: text/plain; charset=UTF-8 Hi folks, I am trying to run my first Crunch pipeline, using the example project given in Crunch Home Page. I'm using Hadoop 2.51 and the Crunch0.11.0. When I try to run it locally with using Hadoop's launcher script, hadoop jar target/crunch-demo-1.0-SNAPSHOT-job.jar /home/pavithra/in /home/pavithra/out I get the error following error saying 'Input source Text() does not exist!'; Note that the input text files are in '/home/pavithra/in'. Exception in thread "main" java.lang.IllegalStateException: Input source Text(/home/pavithra/in) does not exist! at org.apache.crunch.impl.dist.collect.BaseInputCollection.getSizeInternal(BaseInputCollection.java:66) at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:315) at org.apache.crunch.impl.dist.collect.BaseDoCollection.getSizeInternal(BaseDoCollection.java:49) at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:315) at org.apache.crunch.impl.dist.collect.BaseDoCollection.getSizeInternal(BaseDoCollection.java:49) at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:315) at org.apache.crunch.util.PartitionUtils.getRecommendedPartitions(PartitionUtils.java:51) at org.apache.crunch.util.PartitionUtils.getRecommendedPartitions(PartitionUtils.java:40) at org.apache.crunch.lib.Aggregate.count(Aggregate.java:55) at org.apache.crunch.impl.dist.collect.PCollectionImpl.count(PCollectionImpl.java:245) at com.example.WordCount.run(WordCount.java:54) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at com.example.WordCount.main(WordCount.java:22) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Can you please guide me on this problem... Thanks -Pavithra --001a1134a2c4394ca30506f0a75b Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi folks,

I am trying to run my first C= runch pipeline, using the example project given in Crunch Home Page. I'm using Hadoop 2.51 a= nd the Crunch0.11.= 0.=C2=A0

When I try to run it locally with = using Hadoop's launcher script,=C2=A0

hadoop j= ar target/crunch-demo-1.0-SNAPSHOT-job.jar /home/pavithra/in /home/pavithra= /out

I get the error following error saying &#= 39;Input source Text() does not exist!'; Note that the input text files= are in '/home/pavithra/in'.=C2=A0

Ex= ception in thread "main" java.lang.IllegalStateException: Input s= ource Text(/home/pavithra/in) does not exist!
at org.apache.crunch.impl.dist.collect.Base= InputCollection.getSizeInternal(BaseInputCollection.java:66)
at org.apache.crunch.impl.di= st.collect.PCollectionImpl.getSize(PCollectionImpl.java:315)
at org.apache.crunch.impl.di= st.collect.BaseDoCollection.getSizeInternal(BaseDoCollection.java:49)
=
at org.apache.crunc= h.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:315)
=
at org.apache.crunc= h.impl.dist.collect.BaseDoCollection.getSizeInternal(BaseDoCollection.java:= 49)
at org.apa= che.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:3= 15)
at org.apa= che.crunch.util.PartitionUtils.getRecommendedPartitions(PartitionUtils.java= :51)
at org.ap= ache.crunch.util.PartitionUtils.getRecommendedPartitions(PartitionUtils.jav= a:40)
at org.a= pache.crunch.lib.Aggregate.count(Aggregate.java:55)
at org.apache.crunch.impl.dist.coll= ect.PCollectionImpl.count(PCollectionImpl.java:245)
at com.example.WordCount.run(WordCo= unt.java:54)
a= t org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at com.example.WordCount.main= (WordCount.java:22)
<= /span>at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
<= div> at sun.reflect.Nativ= eMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMet= hodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.= invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

=C2=A0Can you please guide me on this problem...
=

Thanks
-Pavithra


--001a1134a2c4394ca30506f0a75b--