apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pramod Immaneni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-732) Container fails where there is a serialization problem in tuple recording
Date Tue, 30 May 2017 15:26:04 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16029554#comment-16029554

Pramod Immaneni commented on APEXCORE-732:

Here is an excerpt of an exception that one might see

Exception Message...
                at com.datatorrent.common.codec.JsonStreamCodec.toByteArray(JsonStreamCodec.java:99)
                at com.datatorrent.stram.debug.TupleRecorder.writeTuple(TupleRecorder.java:400)
                at com.datatorrent.stram.debug.TupleRecorder$RecorderSink.put(TupleRecorder.java:504)
                at com.datatorrent.stram.debug.MuxSink.put(MuxSink.java:55)
                at com.datatorrent.stram.debug.TappedReservoir.put(TappedReservoir.java:80)
                at com.datatorrent.stram.stream.BufferServerSubscriber$BufferReservoir.sweep(BufferServerSubscriber.java:288)
                at com.datatorrent.stram.debug.TappedReservoir.sweep(TappedReservoir.java:56)
                at com.datatorrent.stram.engine.GenericNode.run(GenericNode.java:269)
                at com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1441)

> Container fails where there is a serialization problem in tuple recording
> -------------------------------------------------------------------------
>                 Key: APEXCORE-732
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-732
>             Project: Apache Apex Core
>          Issue Type: Bug
>            Reporter: Pramod Immaneni
>            Assignee: Pramod Immaneni
>            Priority: Minor
> Tuple recording is an optional feature used to record data for debugging purposes. If
there are exceptions while saving the recorded data or transporting it to the client they
are logged and processing continues, however, if there is an issue in the serialization it
is not caught causing the container to fail. This serialization is json based and does not
have any relation to the serialization of tuples between operators which could still be fine
even though this serialization is having a problem.

This message was sent by Atlassian JIRA

View raw message