kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaofeng SHI (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (KYLIN-2512) Getting BufferUnderflowException from ConcurrentDiskStore
Date Wed, 30 May 2018 10:32:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shaofeng SHI resolved KYLIN-2512.
---------------------------------
    Resolution: Cannot Reproduce

Long time no see this error. 

> Getting BufferUnderflowException from ConcurrentDiskStore
> ---------------------------------------------------------
>
>                 Key: KYLIN-2512
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2512
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v1.6.0
>            Reporter: Shaofeng SHI
>            Assignee: liyang
>            Priority: Major
>         Attachments: KYLIN-2512_cube_metadata.txt
>
>
> Reported by 	rahulsingh <rahul.singh@i-link.co.in> in mailing list:
> getting this error while building a cube; Attached is the mock of the cube descriptor
> {code}
> org.apache.hadoop.mapred.YarnChild: Exception running child :
> java.io.IOException: Failed to build cube in mapper 9
>         at
> org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:148)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>         at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1714)
>         at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> Caused by: java.util.concurrent.ExecutionException:
> java.nio.BufferUnderflowException
>         at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:188)
>         at
> org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
>         ... 8 more
> Caused by: java.nio.BufferUnderflowException
>         at java.nio.Buffer.nextGetIndex(Buffer.java:492)
>         at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:135)
>         at org.apache.kylin.common.util.BytesUtil.readVLong(BytesUtil.java:208)
>         at org.apache.kylin.common.util.BytesUtil.readVInt(BytesUtil.java:223)
>         at
> org.apache.kylin.metadata.datatype.BigDecimalSerializer.peekLength(BigDecimalSerializer.java:83)
>         at
> org.apache.kylin.cube.gridtable.CubeCodeSystem.codeLength(CubeCodeSystem.java:91)
>         at org.apache.kylin.gridtable.GTRecord.loadColumns(GTRecord.java:294)
>         at
> org.apache.kylin.cube.inmemcubing.ConcurrentDiskStore$Reader$2.hasNext(ConcurrentDiskStore.java:233)
>         at
> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$MergeSlot.fetchNext(DoggedCubeBuilder.java:412)
>         at
> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$Merger.mergeAndOutput(DoggedCubeBuilder.java:328)
>         at
> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:119)
>         at
> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:75)
>         at
> org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message