hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tony Reix (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6346) mapred.nativetask.kvtest.KVTest crashes on PPC64LE
Date Thu, 30 Apr 2015 08:39:06 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521138#comment-14521138
] 

Tony Reix commented on MAPREDUCE-6346:
--------------------------------------

In short: I'd like to receive some help by experts of this code in order to quickly understand
what is the root cause of this crash.
It looks that the crash appears long time after a bug has corrupted data, when reading data.
And I have no idea about what this test is aimed to test and how it does it and what is the
code to look at.

> mapred.nativetask.kvtest.KVTest crashes on PPC64LE
> --------------------------------------------------
>
>                 Key: MAPREDUCE-6346
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6346
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 2.7.1
>         Environment: RHEL 7.1 - PPC64 LE - OpenJDK rhel-2.5.5.1.ael7b_1-ppc64le u79-b14
>            Reporter: Tony Reix
>
> Test org.apache.hadoop.mapred.nativetask.kvtest.KVTest (and 5 or 6 other tests) crashes
on PPC64LE .
> ....
> 15/04/28 10:46:06 INFO Mid-spill: { id: 4, collect: 245 ms, in-memory sort: 32 ms, in-memory
records: 48202, merge&spill: 80 ms, uncompressed size: 5031451, real size: 3739319 path:
/tmp/hadoop-reixt/mapred/local/localRunner/reixt/jobcache/job_local408221154_0008/attempt_local408221154_0008_m_000000_0/output/spill4.out
}
> # A fatal error has been detected by the Java Runtime Environment:
> #
> #  SIGSEGV (0xb) at pc=0x00003fff6c7d8e50, pid=945, tid=70366264881616
> #
> # JRE version: OpenJDK Runtime Environment (7.0_79-b14) (build 1.7.0_79-mockbuild_2015_04_10_10_48-b00)
> # Java VM: OpenJDK 64-Bit Server VM (24.79-b02 mixed mode linux-ppc64 compressed oops)
> # Derivative: IcedTea 2.5.5
> # Distribution: Built on Red Hat Enterprise Linux Server release 7.1 (Maipo) (Fri Apr
10 10:48:01 EDT 2015)
> # Problematic frame:
> # C  [libnativetask.so.1.0.0+0x58e50]  NativeTask::WritableUtils::ReadVLongInner(char
const*, unsigned int&)+0x40
> #
> # Core dump written. Default location: /home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/core
or core.945
> #
> # An error report file with more information is saved as:
> # /tmp/jvm-945/hs_error.log
> #
> # If you would like to submit a bug report, please include
> # instructions on how to reproduce the bug and visit:
> #   http://icedtea.classpath.org/bugzilla
> # The crash happened outside the Java Virtual Machine in native code.
> # See problematic frame for where to report the bug.
> #
> /bin/sh: line 1:   945 Aborted                 (core dumped) /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.79-2.5.5.1.ael7b_1.ppc64le/jre/bin/java
-Xmx4096m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar /home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/target/surefire/surefirebooter9078773752877532263.jar
/home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/target/surefire/surefire4138802116387705281tmp
/home/reixt/HADOOP-2.7.0/hadoop-FromApache-Trunk-201504241115/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/target/surefire/surefire_01525011254551870798tmp
> /tmp/jvm-945/hs_error.log :
> # C  [libnativetask.so.1.0.0+0x58e50]  NativeTask::WritableUtils::ReadVLongInner(char
const*, unsigned int&)+0x40



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message