hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mahender bigdata <Mahender.BigD...@outlook.com>
Subject Re: "PermGen space" error
Date Wed, 10 Feb 2016 21:08:49 GMT
Thanks Stephen,  Do u want me update in mapred-site.xml ?

/Mahender

On 2/8/2016 2:12 PM, Stephen Bly wrote:
> You can play around with these settings: 
> http://stackoverflow.com/questions/8356416/xxmaxpermsize-with-or-without-xxpermsize 
>
>
> We ran into the same problem at my last company. Turns out it had to 
> do with the way Hive Server was loading jars, IIRC it was because Hive 
> was loading the same class definitions for every request, so they 
> built up over time. You should profile your application (examine its 
> memory) to see if this is the same issue (probably is).
>
> On Mon, Feb 8, 2016 at 2:32 PM, mahender bigdata 
> <Mahender.BigData@outlook.com <mailto:Mahender.BigData@outlook.com>> 
> wrote:
>
>
>     Any update on this error. has anyone faced this issue
>
>
>
>     On 2/7/2016 1:53 PM, mahender bigdata wrote:
>>     Hi Team,
>>
>>     We are continuously getting *"PermGen space" *error. We have
>>     increased Mapper and its Heap size also. but no luck. we are
>>     using hive 1.2.
>>
>>     When i search in google, it has been said that preserved memory
>>     has exceeded. our cluster is 4 nodes, each 4 cpu core and 7 GB 
>>     RAM.  File or internal table is in MB only.
>>
>>     Is there a way to increase *-XX: PermSize, *What settings should
>>     i keep to resolve this error
>>     *
>>
>>     *Exception in thread "main" java.lang.OutOfMemoryError: PermGen space
>>         at java.lang.ClassLoader.defineClass1(Native Method)
>>         at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
>>         at
>>     java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>>         at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
>>         at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>         at
>>     org.apache.hadoop.hive.ql.session.SessionState.close(SessionState.java:1467)
>>         at
>>     org.apache.hadoop.hive.cli.CliSessionState.close(CliSessionState.java:66)
>>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:683)
>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>>     sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>>     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:606)
>>         at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>>
>>
>
>


Mime
View raw message