kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chuxiao (Jira)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-4211) PartitionDesc support custom year、month、day partitions name
Date Tue, 29 Oct 2019 03:58:00 GMT
chuxiao created KYLIN-4211:
------------------------------

             Summary: PartitionDesc support custom year、month、day partitions name
                 Key: KYLIN-4211
                 URL: https://issues.apache.org/jira/browse/KYLIN-4211
             Project: Kylin
          Issue Type: Improvement
            Reporter: chuxiao


YearMonthDayPartitionConditionBuilder supports partition named year, month, day, but can not
support partition names like Y, M, D.
Because there are user using  fact table partitioned by Y, M, D, so add CustomYearMonthDayFieldPartitionConditionBuilder,
support custom year, month, day partitions name.

Partition metadata in model.json like:
{
  "uuid" : "459d48c1-a8a6-cdf5-6ea7-e2ae48b248e9",
  "last_modified" : 1571652918478,
  "version" : "2.6.0.20500",
  "name" : "kylin_sales_ymd",
  "owner" : "admin",
  "is_draft" : false,
  "description" : "",
  "fact_table" : "BIGDATA_KYLIN.KYLIN_SALES_YMD",
  "lookups" : [ ],
  "dimensions" : [ {
    "table" : "KYLIN_SALES_YMD",
    "columns" : [ "LEAF_CATEG_ID", "TRANS_ID", "SLR_SEGMENT_CD", "SELLER_ID", "BUYER_ID",
"OPS_USER_ID", "OPS_REGION", "Y", "M", "D" ]
  } ],
  "metrics" : [ "KYLIN_SALES_YMD.PRICE", "KYLIN_SALES_YMD.ITEM_COUNT" ],
  "filter_condition" : "",
  "partition_desc" : {
    "partition_date_column" : "KYLIN_SALES_YMD.Y, KYLIN_SALES_YMD.M, KYLIN_SALES_YMD.D",
    "partition_time_column" : null,
    "partition_date_start" : 0,
    "partition_date_format" : "yyyy-MM-dd",
    "partition_time_format" : "HH:mm:ss",
    "partition_type" : "APPEND",
    "partition_condition_builder" : "org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder"
  },
  "capacity" : "MEDIUM"
}

Partition_date_column is the year, month, and day partition field split by ','., and Partition_condition_builder
is org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder
Web can create a normal model and  "Edit JSON"  on Kylin web



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message