kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lemont (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3416) Kylin bitmap null pointer exception
Date Thu, 21 Jun 2018 03:00:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Lemont updated KYLIN-3416:
--------------------------
    Description: 
Hi,team:

  Ithink there is a conflict between dimensional aggregation and count distinct.

For example:

select
 (1524931200 - biz_time)/(30*86400),
 count(DISTINCT id) id
 from test

where pt ='20180621'
 group by (1524931200 - biz_time)/(30*86400)

Caused by: java.lang.NullPointerException
 at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.getMutableBitmap(RoaringBitmapCounter.java:58)
 at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.orWith(RoaringBitmapCounter.java:72)
 at org.apache.kylin.measure.bitmap.BitmapAggregator.aggregate(BitmapAggregator.java:43)
 at org.apache.kylin.measure.bitmap.BitmapDistinctCountAggFunc.add(BitmapDistinctCountAggFunc.java:31)

 

The problem cased by  GTCubeStorageQueryBase.isNeedStorageAggregation

There are three dimension int the cube,the sql use cuboid 5 and the cuboid.getColumns is

pt,bize_time.

The groupD is bize_time and singleValueD is pt.

So isNeedStorageAggregation return false.

But in fact this sql need storage agregation because the group is (1524931200 - biz_time)/(30*86400)
not only biz_time 

  was:
Hi,team:

  Ithink there is a conflict between dimensional aggregation and count distinct.

For example:

select
(1524931200 - biz_time)/(30*86400),
 count(DISTINCT id) id
 from test

where pt ='20180621'
 group by (1524931200 - biz_time)/(30*86400)

Caused by: java.lang.NullPointerException
 at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.getMutableBitmap(RoaringBitmapCounter.java:58)
 at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.orWith(RoaringBitmapCounter.java:72)
 at org.apache.kylin.measure.bitmap.BitmapAggregator.aggregate(BitmapAggregator.java:43)
 at org.apache.kylin.measure.bitmap.BitmapDistinctCountAggFunc.add(BitmapDistinctCountAggFunc.java:31)

 

The problem cased by  GTCubeStorageQueryBase.isNeedStorageAggregation

There are three dimension int the cube,the sql use cuboid 5 and the cuboid.getColumns is

pt,bize_time,the groupD is bize_time and singleValueD is pt.So isNeedStorageAggregation
return false.But in fact this sql need storage agregation because the group is (1524931200
- biz_time)/(30*86400) not only biz_time 


> Kylin bitmap null pointer exception
> -----------------------------------
>
>                 Key: KYLIN-3416
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3416
>             Project: Kylin
>          Issue Type: Bug
>          Components: Query Engine
>    Affects Versions: v2.3.1
>            Reporter: Lemont
>            Priority: Blocker
>
> Hi,team:
>   Ithink there is a conflict between dimensional aggregation and count distinct.
> For example:
> select
>  (1524931200 - biz_time)/(30*86400),
>  count(DISTINCT id) id
>  from test
> where pt ='20180621'
>  group by (1524931200 - biz_time)/(30*86400)
> Caused by: java.lang.NullPointerException
>  at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.getMutableBitmap(RoaringBitmapCounter.java:58)
>  at org.apache.kylin.measure.bitmap.RoaringBitmapCounter.orWith(RoaringBitmapCounter.java:72)
>  at org.apache.kylin.measure.bitmap.BitmapAggregator.aggregate(BitmapAggregator.java:43)
>  at org.apache.kylin.measure.bitmap.BitmapDistinctCountAggFunc.add(BitmapDistinctCountAggFunc.java:31)
>  
> The problem cased by  GTCubeStorageQueryBase.isNeedStorageAggregation
> There are three dimension int the cube,the sql use cuboid 5 and the cuboid.getColumns
is
> pt,bize_time.
> The groupD is bize_time and singleValueD is pt.
> So isNeedStorageAggregation return false.
> But in fact this sql need storage agregation because the group is (1524931200 - biz_time)/(30*86400)
not only biz_time 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message