flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timo Walther (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1437) Bug in PojoSerializer's copy() method
Date Thu, 22 Jan 2015 15:22:34 GMT
Timo Walther created FLINK-1437:
-----------------------------------

             Summary: Bug in PojoSerializer's copy() method
                 Key: FLINK-1437
                 URL: https://issues.apache.org/jira/browse/FLINK-1437
             Project: Flink
          Issue Type: Bug
          Components: Java API
            Reporter: Timo Walther
            Assignee: Timo Walther


The PojoSerializer's {{copy()}} method does not work properly with {{null}} values. An exception
could look like:

{code}
Caused by: java.io.IOException: Thread 'SortMerger spilling thread' terminated due to an exception:
null
	at org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:792)
Caused by: java.io.EOFException
	at org.apache.flink.runtime.io.disk.RandomAccessInputView.nextSegment(RandomAccessInputView.java:83)
	at org.apache.flink.runtime.memorymanager.AbstractPagedInputView.advance(AbstractPagedInputView.java:159)
	at org.apache.flink.runtime.memorymanager.AbstractPagedInputView.readByte(AbstractPagedInputView.java:270)
	at org.apache.flink.runtime.memorymanager.AbstractPagedInputView.readUnsignedByte(AbstractPagedInputView.java:277)
	at org.apache.flink.types.StringValue.copyString(StringValue.java:839)
	at org.apache.flink.api.common.typeutils.base.StringSerializer.copy(StringSerializer.java:83)
	at org.apache.flink.api.java.typeutils.runtime.PojoSerializer.copy(PojoSerializer.java:261)
	at org.apache.flink.runtime.operators.sort.NormalizedKeySorter.writeToOutput(NormalizedKeySorter.java:449)
	at org.apache.flink.runtime.operators.sort.UnilateralSortMerger$SpillingThread.go(UnilateralSortMerger.java:1303)
	at org.apache.flink.runtime.operators.sort.UnilateralSortMerger$ThreadBase.run(UnilateralSortMerger.java:788)
{code}

I'm working on a fix for that...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message