kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: Re: restore metastore OutOfMemoryError
Date Tue, 22 Nov 2016 07:41:56 GMT
The JVM opts are set in $KYLIN_HOME/bin/setenv.sh; But I think
'MaxPermSize' is not the factor. You need check the size of those
dictionaries in dict/ folder, and then adjust the -Xmx;

2016-11-22 15:35 GMT+08:00 ypw89724@126.com <ypw89724@126.com>:

> Thank you ShaoFeng!
> I ask another question, when I run restore metastore command I got this
> message:
>
> [root@CDHmaster meta_restore]# ../../bin/metastore.sh
> restore /usr/kylin/meta_backups/meta_restore/
> KYLIN_HOME is set to ../../bin/../
> itStarting restoring /usr/kylin/meta_backups/meta_restore/
> KYLIN_HOME is set to /usr/kylin
> KYLIN_HOME is set to /usr/kylin
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
>  MaxPermSize=512M; support was removed in 8.0
> Java HotSpot(TM) 64-Bit Server VM warning: Using
> incremental CMS is deprecated and will likely be removed in
> a future release
> 16/11/22 14:14:27 WARN mapreduce.TableMapReduceUtil:
> The hbase-prefix-tree module jar containing PrefixTreeCodec is not
> present.  Continuing without it.
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring
> option MaxPermSize=512M; support was removed in 8.0
>
> I want to change MaxPermSize I need to edit which file?
> When I restore 'dict' folder I got 'Out Of Memory' error, I guess
> MaxPermSize too low.
>
>
> ------------------------------
> 袁鹏文  Pengwen Yuan
>
>
> *From:* ShaoFeng Shi <shaofengshi@apache.org>
> *Date:* 2016-11-22 14:27
> *To:* user <user@kylin.apache.org>
> *Subject:* Re: restore metastore OutOfMemoryError
> Hi Pengwen,
>
> "Directly saving resource /java_pid23454.hprof "
>
> Check whether you have put the hprof file in metadata directory by
> mistake; it shouldn't be a part of kylin metadata.
>
> 2016-11-22 14:22 GMT+08:00 ypw89724@126.com <ypw89724@126.com>:
>
>> hi all:
>> I restore kylin metastore
>> "bin/metastore.sh restore /usr/kylin/meta_backups/meta_restore/"
>> I get this error:
>> 2016-11-22 14:14:40,270 INFO  [main-SendThread(CDHslave2:218
>> 1) ClientCnxn:975]: Opening socket connection to server
>> CDHslave2/192.168.*.*:2181. Will not attempt to authentica
>> te using SASL (unknown error)
>> 2016-11-22 14:14:40,282 INFO  [main-SendThread(CDHslave2:218
>> 1) ClientCnxn:852]: Socket connection established, initiatin
>> g session, client: /192.168.*.*:33801, server: CDHslave2/192.168.*.*:2181
>> 2016-11-22 14:14:40,292 INFO  [main-SendThread(CDHslave2:218
>> 1) ClientCnxn:1235]: Session establishment complete on
>> server CDHslave2/192.168.*.*:2181, sessionid = 0x2586afc3d5
>> 93bed, negotiated timeout = 60000
>> 2016-11-22 14:14:41,565 DEBUG [main HBaseConnection:277]: HT
>> able 'kylin_metadata' already exists
>> 2016-11-22 14:14:41,566 DEBUG [main ResourceStore:207]: Dire
>> ctly saving resource /java_pid23454.hprof (Store kylin_metadata@hbase)
>> java.lang.OutOfMemoryError: Java heap space
>> Dumping heap to java_pid53190.hprof ...
>> Heap dump file created [81869727 bytes in 5.327 secs]
>> #
>> # java.lang.OutOfMemoryError: Java heap space
>> # -XX:OnOutOfMemoryError="kill -9 %p"
>> #   Executing /bin/sh -c "kill -9 53190"...
>> ../../bin/metastore.sh: 行 109: 53190 已杀死               ${KYL
>> IN_HOME}/bin/kylin.sh org.apache.kylin.common.persistence.
>> ResourceTool upload $_file
>>
>>  Is anyone met this problem ?
>>
>> ------------------------------
>> 袁鹏文 Pengwen Yuan
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message