hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsuyoshi Ozawa <oz...@apache.org>
Subject TimSort bug and its workaround
Date Thu, 26 Feb 2015 08:04:05 GMT
Hi hadoop developers,

Last 2 weeks, a bug of JDK about TimSort, related to Collections#sort,
 is reported. How can we deal with this problem?


The bug causes ArrayIndexOutOfBoundsException if the number of element
is larger than 67108864.

We use the sort method at 77 places at least.
find . -name "*.java" | xargs grep "Collections.sort"  | wc -l

One reasonable workaround is to set
java.util.Arrays.useLegacyMergeSort() by default.

- Tsuyoshi

View raw message