hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zheng Shao <zs...@facebook.com>
Subject RE: I got java crash error when writing SequenceFile
Date Mon, 08 Mar 2010 06:21:44 GMT
We had a similar problem and it turns out that hadoop native library built on CentOS 5 cannot
run reliably on Fedora Core 4.
You might want to recompile the hadoop native library.

Zheng

________________________________
From: forbbs forbbs [bbsexclusive@gmail.com]
Sent: Sunday, March 07, 2010 6:13 PM
To: general@hadoop.apache.org
Subject: I got java crash error when writing SequenceFile

I just ran a simple program, and got the error below:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGFPE (0x8) at pc=0x00000030bda07927, pid=22891, tid=1076017504
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode linux-amd64 )
# Problematic frame:
# C  [ld-linux-x86-64.so.2+0x7927]
#
# An error report file with more information is saved as:
# /home1/wwp/amy/SDB/hs_err_pid22891.log
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Aborted


The code is CreatePartition.java:

import java.io.IOException;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.io.SequenceFile.Writer;
import org.apache.hadoop.io.SequenceFile;

public class CreatePartition
{
 public static void main(String args[]) throws IOException
 {
   Configuration conf = new Configuration();
   FileSystem fs = FileSystem.get(conf);
   SequenceFile.Writer wr = SequenceFile.createWriter(fs, conf, new Path("_sortPartitioning"),
IntWritable.class, IntWritable.class);
   IntWritable k = new IntWritable(123);
   IntWritable v = new IntWritable(123);
   wr.append(k, v);
   wr.close();
 }
}


---------------  S Y S T E M  ---------------

OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 6)

uname:Linux 2.6.9-67.ELsmp #1 SMP Wed Nov 7 13:56:44 EST 2007 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 73728, NOFILE 1024, AS infinity
load average:0.08 0.08 0.04

CPU:total 4 (2 cores per cpu, 1 threads per core) family 15 model 33 stepping 2, cmov, cx8,
fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext

Memory: 4k page, physical 8162896k(1127340k free), swap 16386292k(16386052k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64 JRE (1.6.0_18-b07),
built on Dec 17 2009 13:42:22 by "java_re" with gcc 3.2.2 (SuSE Linux)

Hadoop 0.19.2

The error log /home1/wwp/amy/SDB/hs_err_pid22891.log is attached with this mail.


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message