apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandeep Deshmukh <sand...@datatorrent.com>
Subject Re: [malhar-users] Error when using file splitter
Date Tue, 20 Oct 2015 13:21:48 GMT
+ dev@Apex

Tejaswi,

Could you please share your use case?

Is this while running in local mode?

Regards,
Sandeep

On Tue, Oct 20, 2015 at 5:07 PM, tejaswi <koneru.tejaswi@gmail.com> wrote:

> Hi,
>
> I am getting the below error  randomly sometime not all the time. I am
> using FileSplitter .
> What could be the reason for it?
>
>
> Operator set
> [OperatorDeployInfo[id=1,name=FileSplitter,type=INPUT,checkpoint={ffffffffffffffff,
> 0,
> 0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=blocksMetadataOutput,streamId=blockin,bufferServer=<null>]]]]
> stopped running due to an exception.
>
> *java.lang.RuntimeException*: saving recovery
>
> at com.datatorrent.lib.io.fs.FileSplitter.endWindow(
> *FileSplitter.java:264*)
>
> at com.datatorrent.stram.engine.InputNode.run(*InputNode.java:123*)
>
> at com.datatorrent.stram.engine.StreamingContainer$2.run(
> *StreamingContainer.java:1365*)
>
> Caused by: *java.io.FileNotFoundException*: File
> file:/C:/Users/tejaswi_koneru/workspace/subs/target/com.datatorrent.stram.StramLocalCluster/idempotentState/1
> does not exist
>
> at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(
> *RawLocalFileSystem.java:520*)
>
> at org.apache.hadoop.fs.DelegateToFileSystem.getFileStatus(
> *DelegateToFileSystem.java:111*)
>
> at org.apache.hadoop.fs.AbstractFileSystem.renameInternal(
> *AbstractFileSystem.java:721*)
>
> at org.apache.hadoop.fs.FilterFs.renameInternal(*FilterFs.java:218*)
>
> at org.apache.hadoop.fs.AbstractFileSystem.rename(
> *AbstractFileSystem.java:657*)
>
> at org.apache.hadoop.fs.FileContext.rename(*FileContext.java:905*)
>
> at com.datatorrent.common.util.FSStorageAgent.save(
> *FSStorageAgent.java:114*)
>
> at
> com.datatorrent.lib.io.IdempotentStorageManager$FSIdempotentStorageManager.save(
> *IdempotentStorageManager.java:177*)
>
> at com.datatorrent.lib.io.fs.FileSplitter.endWindow(
> *FileSplitter.java:261*)
>
> ... 2 more
>
>
> Regards
>
> Tejaswi
>
> --
> You received this message because you are subscribed to the Google Groups
> "Malhar" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to malhar-users+unsubscribe@googlegroups.com.
> To post to this group, send email to malhar-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/malhar-users.
> For more options, visit https://groups.google.com/d/optout.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message