hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vivek K <hadoop.v...@gmail.com>
Subject Re: libhdfs: 32 bit jvm on 64 bit machine
Date Tue, 27 Sep 2011 14:33:27 GMT
Thanks Brian.

A quick question: can we have both 32bit and 64bit jvms on the cluster
machines ?

Vivek
--
On Tue, Sep 27, 2011 at 10:28 AM, Brian Bockelman <bbockelm@cse.unl.edu>wrote:

>
> On Sep 27, 2011, at 9:24 AM, Vivek K wrote:
>
> > Hi Brian
> >
> > Thanks for a prompt response.
> >
> > The machines on cluster didn't have libhdfs.so.0 file. So I copied my
> > libhdfs.so (that came with cloudera vm - libhdfs0 and libhdfs0-dev) on
> the
> > cluster machine. So it should be 32-bit.
> >
> > The "wrong ELF class" error pops up when I try to use the libjvm.so on
> the
> > cluster machines which is 64-bit.
> > And when i try to put my libjvm.so on the cluster machine and run, it
> simply
> > crashes with a seg-fault.
> >
>
> Ah - in that case, you need to do "file libjvm.so" for the *cluster JVM*.
>  I bet you'll find that is 64-bit.
>
> You cannot simply copy along libjvm.so, because it ties into the externals
> of the JVM itself.  You'll need to ask your  cluster admins to provide a
> 32-bit JVM.
>
> Brian
>
> > Vivek
> > --
> >
> > On Tue, Sep 27, 2011 at 10:17 AM, Brian Bockelman <bbockelm@cse.unl.edu
> >wrote:
> >
> >> Hi Vivek,
> >>
> >> Can you find your copy of libhdfs.so and run "file libhdfs.so"?
>  Guessing
> >> from the error message, it sounds like the version is 64-bit right now.
> >>
> >> Brian
> >>
> >> On Sep 27, 2011, at 9:10 AM, Vivek K wrote:
> >>
> >>> Hi all,
> >>>
> >>> I have a 32-bit binary that uses libhdfs for accessing hdfs (on the
> >> cloudera
> >>> VM) and am trying to run it on cluster with 64-bit machines. But
> >>> unfortunately it crashes with "error while loading shared libraries:
> >>> libjvm.so: wrong ELF class: ELFCLASS64". (libhdfs needs libjvm.so). I
> >> tried
> >>> uploading a 32-bit jvm (i.e. libjvm.so from ia32-java-6-sun
> >> installation).
> >>> But that gives a segmentation fault.
> >>>
> >>> The program works perfectly on my machine (in a pseudo-distributed
> >> setup);
> >>> running Cloudera VM (32-bit Ubuntu and hadoop 0.20.2-cdh3u.
> >>>
> >>> Any pointers/comments would be useful.
> >>>
> >>> Thanks.
> >>>
> >>> Best regards
> >>> Vivek
> >>> --
> >>
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message