hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prashant Sharma <scrapco...@gmail.com>
Subject Re: Problems
Date Fri, 25 Jan 2013 12:02:05 GMT
Can you remove native snappy ? and try!


On Fri, Jan 25, 2013 at 5:24 PM, Sean Hudson <sean.hudson@ostiasolutions.com
> wrote:

>   Hi Ke,
>             We are still looking at possible complications of the VM
> environment. I will post whatever we discover.
>
> Thanks for your interest,
>
> Sean
>
>  *From:* ke yuan <ke.yuan.whu@gmail.com>
> *Sent:* Friday, January 25, 2013 2:45 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Problems
>
> is there anything done with hardware? i used thinkpad t430,this problem
> occurs,but i used about 100 machines ,there is nothing to do  with this
> ,all the machines is redhat 6.0,and the jdk is jdk1.5 to jdk1.6 , so i
> think there is something to do with the hardware,any idea?
>
> 2013/1/22 Jean-Marc Spaggiari <jean-marc@spaggiari.org>
>
>> Hi Sean,
>>
>> Will you be able to run the memtest86 on this VM? Maybe it's an issue
>> with the way the VM is managing the memory?
>>
>> I ran HBase+Hadoop on a desktop with only 1.5G. So you should not have
>> any issue with 6GB.
>>
>> I don't think the issue you are facing is related to hadoop. Can you
>> try to run a simple Java application in you JVM? Something which will
>> use lot of memory. And see if it works?
>>
>> JM
>>
>> 2013/1/22, Sean Hudson <sean.hudson@ostiasolutions.com>:
>>  > Hi Jean-Marc,
>> >                         The Linux machine on which I am attempting to
>> get
>> > Hadoop running is actually Linux running in a VM partition. This VM
>> > partition had 2 Gigs of RAM when I first encountered the problem. This
>> RAM
>> > allocation has been bumped up to 6 Gigs, but the problem still persists,
>> > i.e
>> >
>> > bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+'
>> still
>> > crashes out as before.
>> >
>> > Is there a minimum RAM size requirement?
>> > Will Hadoop run correctly on Linux in a VM partition?
>> >
>> >                         I had attempted to run Hadoop in
>> Pseudo-Distributed
>> >
>> > Operation mode and this included modifying the conf/core-site.xml,
>> > conf/hdfs-site.xml and the conf/mapred-site.xml files as per the Quick
>> Start
>> >
>> > instructions. I also formatted a new distributed-filesystem as per the
>> > instructions. To re-test in Standalone mode with 6 Gigs of RAM, I
>> reversed
>> > the changes to the above three .xml files in /conf. However, I don't
>> see a
>> > way to back-out the distributed-filesystem. Will the existence of this
>> > distributed-filesystem interfere with my Standalone tests?
>> >
>> > Regards,
>> >
>> > Sean Hudson
>> >
>> > -----Original Message-----
>> > From: Jean-Marc Spaggiari
>> > Sent: Friday, January 18, 2013 3:24 PM
>> > To: user@hadoop.apache.org
>> > Subject: Re: Problems
>> >
>> > Hi Sean,
>> >
>> > It's strange. You should not faced that.  I faced same kind of issues
>> > on a desktop with memory errors. Can you install memtest86 and fullty
>> > test your memory (one pass is enought) to make sure you don't have
>> > issues on that side?
>> >
>> > 2013/1/18, Sean Hudson <sean.hudson@ostiasolutions.com>:
>> >> Leo,
>> >>         I downloaded the suggested 1.6.0_32 Java version to my home
>> >> directory, but I am still experiencing the same problem (See error
>> >> below).
>> >> The only thing that I have set in my hadoop-env.sh file is the
>> JAVA_HOME
>> >> environment variable. I have also tried it with the Java directory
>> added
>> >> to
>> >>
>> >> PATH.
>> >>
>> >> export JAVA_HOME=/home/shu/jre1.6.0_32
>> >> export PATH=$PATH:/home/shu/jre1.6.0_32
>> >>
>> >> Every other environment variable is defaulted.
>> >>
>> >> Just to clarify, I have tried this in Local Standalone mode and also in
>> >> Pseudo-Distributed Mode with the same result.
>> >>
>> >> Frustrating to say the least,
>> >>
>> >> Sean Hudson
>> >>
>> >>
>> >> shu@meath-nua:~/hadoop-1.0.4> bin/hadoop jar hadoop-examples-1.0.4.jar
>> >> grep
>> >>
>> >> input output 'dfs[a-z.]+'
>> >> #
>> >> # A fatal error has been detected by the Java Runtime Environment:
>> >> #
>> >> #  SIGFPE (0x8) at pc=0xb7fc51fb, pid=23112, tid=3075554208
>> >> #
>> >> # JRE version: 6.0_32-b05
>> >> # Java VM: Java HotSpot(TM) Client VM (20.7-b02 mixed mode, sharing
>> >> linux-x86 )
>> >> # Problematic frame:
>> >> # C  [ld-linux.so.2+0x91fb]  double+0xab
>> >> #
>> >> # An error report file with more information is saved as:
>> >> # /home/shu/hadoop-1.0.4/hs_err_pid23112.log
>> >> #
>> >> # If you would like to submit a bug report, please visit:
>> >> #   http://java.sun.com/webapps/bugreport/crash.jsp
>> >> # The crash happened outside the Java Virtual Machine in native code.
>> >> # See problematic frame for where to report the bug.
>> >> #
>> >> Aborted
>> >>
>> >> -----Original Message-----
>> >> From: Leo Leung
>> >> Sent: Thursday, January 17, 2013 6:46 PM
>> >> To: user@hadoop.apache.org
>> >> Subject: RE: Problems
>> >>
>> >> Use Sun/Oracle  1.6.0_32+   Build should be 20.7-b02+
>> >>
>> >> 1.7 causes failure and AFAIK,  not supported,  but you are free to try
>> >> the
>> >> latest version and report back.
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: Sean Hudson [mailto:sean.hudson@ostiasolutions.com]
>> >> Sent: Thursday, January 17, 2013 6:57 AM
>> >> To: user@hadoop.apache.org
>> >> Subject: Re: Problems
>> >>
>> >> Hi,
>> >>       My Java version is
>> >>
>> >> java version "1.6.0_25"
>> >> Java(TM) SE Runtime Environment (build 1.6.0_25-b06) Java HotSpot(TM)
>> >> Client
>> >>
>> >> VM (build 20.0-b11, mixed mode, sharing)
>> >>
>> >> Would you advise obtaining a later Java version?
>> >>
>> >> Sean
>> >>
>> >> -----Original Message-----
>> >> From: Jean-Marc Spaggiari
>> >> Sent: Thursday, January 17, 2013 2:52 PM
>> >> To: user@hadoop.apache.org
>> >> Subject: Re: Problems
>> >>
>> >> Hi Sean,
>> >>
>> >> This is an issue with your JVM. Not related to hadoop.
>> >>
>> >> Which JVM are you using, and can you try with the last from Sun?
>> >>
>> >> JM
>> >>
>> >> 2013/1/17, Sean Hudson <sean.hudson@ostiasolutions.com>:
>> >>> Hi,
>> >>>       I have recently installed hadoop-1.0.4 on a linux machine.
>> >>> Whilst working through the post-install instructions contained in the
>> >>> “Quick Start”
>> >>> guide, I incurred the following catastrophic Java runtime error (See
>> >>> below).
>> >>> I have attached the error report file “hs_err_pid24928.log”. I have
>> >>> submitted a Java bug report, but perhaps it is a known hadoop-1.0.4
>> >>> version problem.
>> >>>
>> >>> I am a first time user of Hadoop and would welcome guidance on this
>> >>> problem,
>> >>>
>> >>> Regards,
>> >>>
>> >>> Sean Hudson.
>> >>>
>> >>> shu@meath-nua:~/hadoop-1.0.4> bin/hadoop jar
>> hadoop-examples-1.0.4.jar
>> >>> grep input output 'dfs[a-z.]+'
>> >>> #
>> >>> # A fatal error has been detected by the Java Runtime Environment:
>> >>> #
>> >>> #  SIGFPE (0x8) at pc=0xb7f2b1fb, pid=24928, tid=3074923424 # # JRE
>> >>> version: 6.0_25-b06 # Java VM: Java HotSpot(TM) Client VM (20.0-b11
>> >>> mixed mode, sharing
>> >>> linux-x86 )
>> >>> # Problematic frame:
>> >>> # C  [ld-linux.so.2+0x91fb]  double+0xab # # An error report file with
>> >>> more information is saved as:
>> >>> # /home/shu/hadoop-1.0.4/hs_err_pid24928.log
>> >>> #
>> >>> # If you would like to submit a bug report, please visit:
>> >>> #   http://java.sun.com/webapps/bugreport/crash.jsp
>> >>> # The crash happened outside the Java Virtual Machine in native code.
>> >>> # See problematic frame for where to report the bug.
>> >>> #
>> >>> Aborted
>> >>> --
>> >>> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings,
>> >>> Bray, Co. Wicklow, Ireland
>> >>>
>> >>> Registered in Ireland CRO No.507541 This email and any attachments to
>> >>> it is, unless otherwise stated, confidential, may contain copyright
>> >>> material and is for the use of the intended recipient only. If you
>> >>> have received this email in error, please notify the sender by return
>> >>> and deleting all copies. Any views expressed in this email are those
>> >>> of the sender and do not form part of any contract between Ostia
>> >>> Software Solutions Limited and any other party.
>> >>>
>> >>
>> >>
>> >> --
>> >> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings,
>> >> Bray,
>> >> Co. Wicklow, Ireland
>> >>
>> >> Registered in Ireland CRO No.507541 This email and any attachments to
>> it
>> >> is,
>> >>
>> >> unless otherwise stated, confidential, may contain copyright material
>> and
>> >>
>> >> is
>> >>
>> >> for the use of the intended recipient only. If you have received this
>> >> email
>> >>
>> >> in error, please notify the sender by return and deleting all copies.
>> Any
>> >> views expressed in this email are those of the sender and do not form
>> >> part
>> >> of any contract between Ostia Software Solutions Limited and any other
>> >> party.
>> >>
>> >>
>> >> --
>> >> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings,
>> >> Bray,
>> >> Co. Wicklow, Ireland
>> >>
>> >> Registered in Ireland CRO No.507541 This email and any attachments to
>> it
>> >> is, unless otherwise stated, confidential, may contain copyright
>> material
>> >> and is for the use of the intended recipient only. If you have received
>> >> this email in error, please notify the sender by return and deleting
>> all
>> >> copies. Any views expressed in this email are those of the sender and
>> do
>> >> not form part of any contract between Ostia Software Solutions Limited
>> >> and
>> >> any other party.
>> >>
>> >
>> >
>> > --
>> > Ostia Software Solutions Limited, 6 The Mill Building, The Maltings,
>> Bray,
>> > Co. Wicklow, Ireland
>> >
>> > Registered in Ireland CRO No.507541 This email and any attachments to it
>> > is, unless otherwise stated, confidential, may contain copyright
>> material
>> > and is for the use of the intended recipient only. If you have received
>> > this email in error, please notify the sender by return and deleting all
>> > copies. Any views expressed in this email are those of the sender and do
>> > not form part of any contract between Ostia Software Solutions Limited
>> and
>> > any other party.
>> >
>>
>
>
> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings, Bray,
> Co. Wicklow, Ireland
>
> Registered in Ireland CRO No.507541 This email and any attachments to it
> is, unless otherwise stated, confidential, may contain copyright material
> and is for the use of the intended recipient only. If you have received
> this email in error, please notify the sender by return and deleting all
> copies. Any views expressed in this email are those of the sender and do
> not form part of any contract between Ostia Software Solutions Limited and
> any other party.
>



-- 
s

Mime
View raw message