flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timo Walther (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1437) Bug in PojoSerializer's copy() method
Date Thu, 12 Feb 2015 01:06:11 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317313#comment-14317313
] 

Timo Walther commented on FLINK-1437:
-------------------------------------

Is it too late to get this bugfix into 0.8.1?

> Bug in PojoSerializer's copy() method
> -------------------------------------
>
>                 Key: FLINK-1437
>                 URL: https://issues.apache.org/jira/browse/FLINK-1437
>             Project: Flink
>          Issue Type: Bug
>          Components: Java API
>            Reporter: Timo Walther
>            Assignee: Timo Walther
>             Fix For: 0.9
>
>
> The PojoSerializer's {{copy()}} method does not work properly with {{null}} values. An
exception could look like:
> {code}
> Caused by: java.io.IOException: Thread 'SortMerger spilling thread' terminated due to
an exception: null
> 	at org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:792)
> Caused by: java.io.EOFException
> 	at org.apache.flink.runtime.io.disk.RandomAccessInputView.nextSegment(RandomAccessInputView.java:83)
> 	at org.apache.flink.runtime.memorymanager.AbstractPagedInputView.advance(AbstractPagedInputView.java:159)
> 	at org.apache.flink.runtime.memorymanager.AbstractPagedInputView.readByte(AbstractPagedInputView.java:270)
> 	at org.apache.flink.runtime.memorymanager.AbstractPagedInputView.readUnsignedByte(AbstractPagedInputView.java:277)
> 	at org.apache.flink.types.StringValue.copyString(StringValue.java:839)
> 	at org.apache.flink.api.common.typeutils.base.StringSerializer.copy(StringSerializer.java:83)
> 	at org.apache.flink.api.java.typeutils.runtime.PojoSerializer.copy(PojoSerializer.java:261)
> 	at org.apache.flink.runtime.operators.sort.NormalizedKeySorter.writeToOutput(NormalizedKeySorter.java:449)
> 	at org.apache.flink.runtime.operators.sort.UnilateralSortMerger$SpillingThread.go(UnilateralSortMerger.java:1303)
> 	at org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:788)
> {code}
> I'm working on a fix for that...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message