apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Munagala Ramanath <...@datatorrent.com>
Subject Re: FileNotFoundException: File does not exist
Date Wed, 31 Aug 2016 13:40:14 GMT
We see the following exception w.r.t. partitioning; can you describe how
your code is handling partitioning ?

Ram

-----------------------------------------------------------------------
Exception: Partitioner returns null or empty.
java.lang.IllegalStateException: Partitioner returns null or empty.
        at
com.datatorrent.stram.plan.physical.PhysicalPlan.initPartitioning(PhysicalPlan.java:755)
        at
com.datatorrent.stram.plan.physical.PhysicalPlan.addLogicalOperator(PhysicalPlan.java:1676)
        at
com.datatorrent.stram.plan.physical.PhysicalPlan.<init>(PhysicalPlan.java:378)
        at
com.datatorrent.stram.StreamingContainerManager.<init>(StreamingContainerManager.java:418)


On Tue, Aug 30, 2016 at 11:34 PM, JOHN, BIBIN <bj9306@att.com> wrote:

> I have attached logs. I am trying to check other items which you mentioned
> below.
>
>
>
> *Thanks and Regards,*
>
> *Bibin John| Data Movement Technology Development*
>
> *20205 North Creek Pkwy , Bothell, WA 98011 USA*
>
> *(* *Office: (770) 235 5614 <%28770%29%20235%205614> | Cell: (469)
> 648-9858 <%28469%29%20648-9858>*
>
> *Email: *bj9306@att.com
>
>
>
> OOO Alert :  09/19/2016 – 10/14/2016
>
>
>
>
>
>
>
> *From:* Venkatesh Kottapalli [mailto:venkatesh@datatorrent.com]
> *Sent:* Tuesday, August 30, 2016 2:42 PM
> *To:* users@apex.apache.org
> *Subject:* Re: FileNotFoundException: File does not exist
>
>
>
> Hi,
>
>
>
> I used the POM from your email excluding goldengate dependency and I am
> able to submit the file2file job without any issues. PFA the POM file.
>
>
>
> You can get the logs using "yarn logs -applicationId <application Id>”.
> Please check the logs for other exceptions if any and attach the complete
> stack trace.
>
>
>
>
>
>   Also, please check for the compatability of rest of the libraries that
> you add in your environment.
>
>
>
> -Venkatesh.
>
>
>
>
>
> On Aug 30, 2016, at 12:41 AM, JOHN, BIBIN <bj9306@att.com> wrote:
>
>
>
> I am getting below exception in most of my application. How can I get the
> root cause associated with below error from any log files? Venkatesh helped
> me with another application and it worked and we tried to mimic similar pom
> in this app too. But still getting error.
>
>
>
>
>
>
>
> 2016-08-30 00:36:59,174 WARN com.datatorrent.stram.client.EventsAgent:
> Got exception when reading events
>
> java.io.FileNotFoundException: File does not exist:
> /user/bj9306/datatorrent/apps/application_1472055988122_
> 0026/events/index.txt
>
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(
> INodeFile.java:71)
>
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(
> INodeFile.java:61)
>
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.
> getBlockLocationsInt(FSNamesystem.java:1828)
>
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.
> getBlockLocations(FSNamesystem.java:1799)
>
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.
> getBlockLocations(FSNamesystem.java:1712)
>
>         at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.
> getBlockLocations(NameNodeRpcServer.java:652)
>
>         at org.apache.hadoop.hdfs.protocolPB.
> ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(
> ClientNamenodeProtocolServerSideTranslatorPB.java:365)
>
>         at org.apache.hadoop.hdfs.protocol.proto.
> ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(
> ClientNamenodeProtocolProtos.java)
>
>         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$
> ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
>
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
>
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
>
>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>
>         at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1657)
>
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
>
>
>
> *Thanks and Regards,*
>
> *Bibin John| Data Movement Technology Development*
>
> *20205 North Creek Pkwy , Bothell, WA 98011 USA*
>
> *(* *Office: (770) 235 5614 <%28770%29%20235%205614> | Cell: (469)
> 648-9858 <%28469%29%20648-9858>*
>
> *Email: *bj9306@att.com
>
>
>
> OOO Alert :  09/19/2016 – 10/14/2016
>
>
>
>
>
>
>
> <pom.xml>
>
>
>

Mime
View raw message