kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-2662) NegativeArraySizeException in "Extract Fact Table Distinct Columns"
Date Sun, 08 Jul 2018 09:04:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16536032#comment-16536032
] 

ASF subversion and git services commented on KYLIN-2662:
--------------------------------------------------------

Commit f487d803a0505bb11dfadce90aee12d8d20042f5 in kylin's branch refs/heads/master from Li
Yang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=f487d80 ]

KYLIN-2662 fix NegativeArraySizeException in TrieDictionaryForest

Signed-off-by: shaofengshi <shaofengshi@apache.org>


> NegativeArraySizeException in "Extract Fact Table Distinct Columns"
> -------------------------------------------------------------------
>
>                 Key: KYLIN-2662
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2662
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>            Reporter: liyang
>            Assignee: liyang
>            Priority: Major
>              Labels: scope
>             Fix For: v2.5.0
>
>
> The full exception. The root cause suspect to be a cell goes over 32 KB. Need verification
and fix.
> {code}
> java.lang.NegativeArraySizeException
>                 at org.apache.kylin.dict.TrieDictionary.getValueBytesFromIdWithoutCache(SourceFile:239)
>                 at org.apache.kylin.dict.TrieDictionaryForestBuilder.addTree(SourceFile:134)
>                 at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(SourceFile:110)
>                 at org.apache.kylin.dict.DictionaryGenerator$StringTrieDictForestBuilder.build(SourceFile:218)
>                 at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(SourceFile:231)
>                 at org.apache.kylin.engine.mr.KylinReducer.cleanup(SourceFile:71)
>                 at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)
>                 at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
>                 at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
>                 at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>                 at java.security.AccessController.doPrivileged(Native Method)
>                 at javax.security.auth.Subject.doAs(Subject.java:415)
>                 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
>                 at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message