kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaofeng SHI (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3261) Out of Memory Error
Date Mon, 25 Jun 2018 03:54:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shaofeng SHI updated KYLIN-3261:
--------------------------------
    Fix Version/s:     (was: v2.2.0)

Hi Praveen, 

 

OOM error always need in-depth investigation. You may need optimize the SQL query or tune
configurations. Please do some investigation, only confirmed bug/task be recorded as JIRA.
You can discuss in Kylin mail list first. Thanks.

> Out of Memory Error
> -------------------
>
>                 Key: KYLIN-3261
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3261
>             Project: Kylin
>          Issue Type: Bug
>          Components: Environment 
>    Affects Versions: v2.2.0
>            Reporter: praveenece
>            Priority: Critical
>
> I used apache Kylin for building cube (star Schema based) in cluster mode,but i have
issue which i mentioned below.please guide me.
>  
> Cluster detail
> three machine have 64GB(memory)
> one machine set job 
> other two machine  set query.
> version -apache kylin 2.2.0(hbase)
> hadoop version-2.4.0(Cluster mode)
> hbase version =1.3.1(Cluster mode)
> hive version 2.1.1
> Exception: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.yarn.exceptions.YarnRuntimeException):
java.io.IOException: Failed on local exception: java.io.IOException: Couldn't set up IO streams;
Host Details : local host is: "hostname/ipname"; destination host is: "hostname":9000;
>          at org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getFullJob(CachedHistoryStorage.java:147)
>          at org.apache.hadoop.mapreduce.v2.hs.JobHistory.getJob(JobHistory.java:217)
>          at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler$1.run(HistoryClientService.java:203)
>          at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler$1.run(HistoryClientService.java:199)
>          at java.security.AccessController.doPrivileged(Native Method)
>          at javax.security.auth.Subject.doAs(Subject.java:422)
>          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
>          at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:199)
>          at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getJobReport(HistoryClientService.java:231)
>          at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getJobReport(MRClientProtocolPBServiceImpl.java:122)
>          at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:275)
>          at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
>          at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
>          at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
>          at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
>          at java.security.AccessController.doPrivileged(Native Method)
>          at javax.security.auth.Subject.doAs(Subject.java:422)
>          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
>          at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
> Caused by: java.io.IOException: Failed on local exception: java.io.IOException: Couldn't
set up IO streams; Host Details : local host is: "[hostname/|http://ctsingtohp12.cts.com/10.237.247.12]ipaddress";
destination host is: "[h|http://ctsingtohp12.cts.com/]ostname":9000;
>          at [org.apache.hadoop.net|http://org.apache.hadoop.net/].NetUtils.wrapException(NetUtils.java:764)
>          at org.apache.hadoop.ipc.Client.call(Client.java:1414)
>          at org.apache.hadoop.ipc.Client.call(Client.java:1363)
>          at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
>          at com.sun.proxy.$Proxy9.getListing(Unknown Source)
>          at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
>          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>          at java.lang.reflect.Method.invoke(Method.java:498)
>          at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190)
>          at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103)
>          at com.sun.proxy.$Proxy9.getListing(Unknown Source)
>          at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:515)
>          at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1743)
>          at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:203)
>          at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:190)
>          at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:172)
>          at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:172)
>          at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1393)
>          at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1388)
>          at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
>          at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1388)
>          at org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils.listFilteredStatus(JobHistoryUtils.java:438)
>          at org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils.localGlobber(JobHistoryUtils.java:385)
>          at org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils.localGlobber(JobHistoryUtils.java:377)
>          at org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils.localGlobber(JobHistoryUtils.java:372)
>          at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanIntermediateDirectory(HistoryFileManager.java:779)
>          at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.getFileInfo(HistoryFileManager.java:931)
>          at org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage.getFullJob(CachedHistoryStorage.java:132)
>          ... 18 more
> Caused by: java.io.IOException: Couldn't set up IO streams
>          at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:769)
>          at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:367)
>          at org.apache.hadoop.ipc.Client.getConnection(Client.java:1462)
>          at org.apache.hadoop.ipc.Client.call(Client.java:1381)
>          ... 44 more
> Caused by: java.lang.OutOfMemoryError: unable to create new native thread
>          at java.lang.Thread.start0(Native Method)
>          at java.lang.Thread.start(Thread.java:717)
>          at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:762)
>          ... 47 more
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message