kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiatao.tao (JIRA)" <>
Subject [jira] [Commented] (KYLIN-3635) Percentile calculation on Spark engine is wrong
Date Fri, 26 Oct 2018 12:49:00 GMT


jiatao.tao commented on KYLIN-3635:

Hi Shaofeng, do you think we should provide a stronger constraint about this? I've tried to
make method reset() abstract so that the subclasses have to implement this, but I found most
of the implementation is still empty. What's your opinion about this?

> Percentile calculation on Spark engine is wrong
> -----------------------------------------------
>                 Key: KYLIN-3635
>                 URL:
>             Project: Kylin
>          Issue Type: Bug
>          Components: Spark Engine
>    Affects Versions: v2.3.0, v2.3.1, v2.4.0, v2.3.2, v2.4.1, v2.5.0
>            Reporter: Shaofeng SHI
>            Assignee: Shaofeng SHI
>            Priority: Major
>             Fix For: v2.4.2, v2.5.1
> As titled; Received reporting that percentile result is wrong when using Spark engine.
Checked the code and found the object was reused and not reset, the problem won't happen
on normal MR as it would be serialized before next call, but would be a problem on Spark,
as the object was cached in-memory and be serialized later.

This message was sent by Atlassian JIRA

View raw message