hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3442) QuickSort may get into unbounded recursion
Date Wed, 04 Jun 2008 20:36:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12602449#action_12602449

Chris Douglas commented on HADOOP-3442:

bq. The jobs it's failing on are running on data I can't release.

Would it be possible to apply the patch, validate the spills with the checker, and post some
debugging information? In particular, patching QuickSort to catch StackOverflowError and print
out its left and right indices as it unwinds would be the first thing I'd try with a reproducible
test. If you can't include the kvbuffer data, the kvindices data would be modestly helpful
and would reveal only lengths and partitions. Also, even if the checker doesn't reproduce
the error, the "STACK OVERFLOW" log message from the failed mapper should include the buffer
and accounting indices. Those would also be valuable and reveal nothing about your data.

> QuickSort may get into unbounded recursion
> ------------------------------------------
>                 Key: HADOOP-3442
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3442
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.17.0
>            Reporter: Runping Qi
>            Assignee: Chris Douglas
>         Attachments: 3442-0.patch, CheckSortBuffer.java, HADOOP-3442.patch, spillbuffers.patch

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message