crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Landon Robinson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-140) Input source Text does not exist!
Date Thu, 01 Oct 2015 13:39:26 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939827#comment-14939827
] 

Landon Robinson commented on CRUNCH-140:
----------------------------------------

I'm having a similar issue in Oozie when using Java action. The data IS in HDFS, and works
when I run this exact jar as Hadoop Jar. But not in Java action.

Is this a bug with Oozie or am I doing something incorrectly?

Caused by: java.lang.IllegalStateException: Input source Text(/path/to/my/data/lookup.csv)
does not exist!
at org.apache.crunch.impl.dist.collect.BaseInputCollection.getSizeInternal(BaseInputCollection.java:77)
at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:355)
at org.apache.crunch.impl.dist.collect.BaseDoTable.getSizeInternal(BaseDoTable.java:77)
at org.apache.crunch.impl.dist.collect.BaseGroupedTable.getSizeInternal(BaseGroupedTable.java:68)
at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:355)
at org.apache.crunch.impl.dist.collect.BaseDoTable.getSizeInternal(BaseDoTable.java:77)
at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:355)
at org.apache.crunch.impl.dist.collect.BaseDoCollection.getSizeInternal(BaseDoCollection.java:49)
at org.apache.crunch.impl.dist.collect.PCollectionImpl.getSize(PCollectionImpl.java:355)
at org.apache.crunch.impl.dist.collect.PCollectionImpl.materialize(PCollectionImpl.java:96)
at org.apache.crunch.materialize.pobject.PObjectImpl.<init>(PObjectImpl.java:56)
at org.apache.crunch.materialize.pobject.FirstElementPObject.<init>(FirstElementPObject.java:38)
at org.apache.crunch.lib.Aggregate.length(Aggregate.java:95)
at org.apache.crunch.impl.dist.collect.PCollectionImpl.length(PCollectionImpl.java:285)
at mypackage.TransformKronosMR.run(TransformKronosMR.java:156)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at mypackage.TransformKronosMR.main(TransformKronosMR.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:55)

> Input source Text  does not exist!
> ----------------------------------
>
>                 Key: CRUNCH-140
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-140
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Ubuntu 12.04
> Hadoop 0.20.205
> Apache Crunch 0.4.0-incubating (binary) tar.gz
>            Reporter: DeepakVohra
>
> The Crunch examples org.apache.crunch.examples.WordCount, org.apache.crunch.examples.AverageBytesByIP,
org.apache.crunch.examples.TotalBytesByIP generate error:
> Input source Text (the sample input)  does not exist!
> Input path does not include "globs/wildcards" as noted in another issue.
> https://issues.apache.org/jira/browse/CRUNCH-131
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message