kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: 求助有一个超大维度
Date Mon, 13 Feb 2017 13:47:40 GMT
"MSISDN" is a UHC and it is mandatory, so this is a good case that setting
it as the "shard by" column; Please discard current build job, then edit
the cube in "advanced" step; besides, you can allocate more memory to the
mapper in conf/kylin_job_conf_inmem.xml; After doing these, rebuild the
cube. For more information you can check
https://kylin.apache.org/docs16/howto/howto_optimize_build.html

2017-02-13 19:48 GMT+08:00 Alberto Ramón <a.ramonportoles@gmail.com>:

> humm
> 74 measures ?  its a lot, 3-6 its more normal
> 15 measures (depends of cardinality) ? its a lot . As reference in old
> versions of kylin the max number of dimension was 12 (maximum)
>
> *I also work for telecom company and the cardinality of IMISI and IMEI  it
> too high (Huge)*
>
>
> 2017-02-13 12:08 GMT+01:00 不清 <452652018@qq.com>:
>
>> {
>>   "uuid": "d6459ad6-b1a7-4705-8df2-51ba947919d6",
>>   "last_modified": 1486785489427,
>>   "version": "1.6.0",
>>   "name": "user_all_cube_2",
>>   "model_name": "user_all_mode",
>>   "description": "",
>>   "null_string": null,
>>   "dimensions": [
>>     {
>>       "name": "HOUR_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "HOUR_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "DAY_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "DAY_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "CITY_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "CITY_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "CITY_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "CITY_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "MSISDN",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "MSISDN",
>>       "derived": null
>>     },
>>     {
>>       "name": "IMSI",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "IMSI",
>>       "derived": null
>>     },
>>     {
>>       "name": "IMEI",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "IMEI",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACTYPE_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACTYPE_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACTYPE_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACTYPE_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACBRAND_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACBRAND_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACBRAND_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACBRAND_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "APP_TYPE_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APP_TYPE_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "APP_SUBTYPE_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APP_SUBTYPE_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "APP_SUBTYPE_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APP_SUBTYPE_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "APPTYPE_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APPTYPE_ZHNAME",
>>       "derived": null
>>     }
>>   ],
>>   "measures": [
>>     {
>>       "name": "_COUNT_",
>>       "function": {
>>         "expression": "COUNT",
>>         "parameter": {
>>           "type": "constant",
>>           "value": "1",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "1",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "2",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "3",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_IP_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "4",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_IP_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "5",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_IP_FRAGMENT_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "6",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_IP_FRAGMENT_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "7",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_TCP_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "8",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_TCP_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "9",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_TCP_DISORDERED_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "10",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_TCP_DISORDERED_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "11",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_TCP_RETRANSMISSION_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "12",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_TCP_RETRANSMISSION_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "13",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_CONNECTION_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "14",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_ACKOFFSET_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "15",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_CONFIRMOFFSET_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "16",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "17",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_FAIL_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "18",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_FAIL_CONTENT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "19",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "20",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_FAIL_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "21",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_REQ_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "22",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "23",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "24",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_ONLINE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "25",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_ONLINE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "26",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "ONLINE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "27",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_SYN_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "28",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_SYNACK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "29",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_ACK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "30",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_DROP_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "31",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_REQ_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "32",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "33",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_FAILURE_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "34",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_FIRST_ACK_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "35",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_ACK_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "36",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_UPLINK_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "37",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DOWNLINK_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "38",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_TOTAL_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "39",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_TOTAL_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "40",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "AVERAGE_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "41",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "RST_INTERRUPT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "42",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "FIN_INTERRUPT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "43",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_BUSI_INTERRUPT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "44",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_HOME_REQ_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "45",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_HOME_RES_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "46",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_HOME_RES_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "47",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_FLOW_30",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "48",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_DUR_30",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "49",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_FLOW_50",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "50",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_DUR_50",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "51",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_FLOW_100",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "52",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_DUR_100",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "53",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_SPAGE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "54",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_SPAGE_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "55",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_BPAGE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "56",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_BPAGE_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "57",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_FINISH_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "58",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "BUSINESS_NORESP_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "59",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_LINK_SUC_TO_FI_DELAY_TRAN_REQ",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "60",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DELAY_FR_FI_TRA_RE_TO_FI_RE_PAC",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "61",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_DATA_300",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "62",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "ONLINE_DUR_300",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "63",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_DATA_500",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "64",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "ONLINE_DUR_500",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "65",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_RSP_FAIL_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "66",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_RSP_TERMFAIL_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "67",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_RSP_SPFAIL_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "68",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_NONRSP_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "69",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SUM_XDR_RATE",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "70",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "71",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_1_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "72",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_3_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "73",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_5_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "74",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_7_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "75",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_10_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     }
>>   ],
>>   "dictionaries": [],
>>   "rowkey": {
>>     "rowkey_columns": [
>>       {
>>         "column": "HOUR_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "DAY_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "CITY_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "CITY_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "MSISDN",
>>         "encoding": "integer:8",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "IMSI",
>>         "encoding": "integer:8",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "IMEI",
>>         "encoding": "integer:8",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACTYPE_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACTYPE_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACBRAND_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACBRAND_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APP_TYPE_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APP_SUBTYPE_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APP_SUBTYPE_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APPTYPE_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       }
>>     ]
>>   },
>>   "hbase_mapping": {
>>     "column_family": [
>>       {
>>         "name": "F1",
>>         "columns": [
>>           {
>>             "qualifier": "M",
>>             "measure_refs": [
>>               "_COUNT_",
>>               "1",
>>               "2",
>>               "3",
>>               "4",
>>               "5",
>>               "6",
>>               "7",
>>               "8",
>>               "9",
>>               "10",
>>               "11",
>>               "12",
>>               "13",
>>               "14",
>>               "15",
>>               "16",
>>               "17",
>>               "18",
>>               "19",
>>               "20",
>>               "21",
>>               "22",
>>               "23",
>>               "24",
>>               "25",
>>               "26",
>>               "27",
>>               "28",
>>               "29",
>>               "30",
>>               "31",
>>               "32",
>>               "33",
>>               "34",
>>               "35",
>>               "36",
>>               "37",
>>               "38",
>>               "39",
>>               "40",
>>               "41",
>>               "42",
>>               "43",
>>               "44",
>>               "45",
>>               "46",
>>               "47",
>>               "48",
>>               "49",
>>               "50",
>>               "51",
>>               "52",
>>               "53",
>>               "54",
>>               "55",
>>               "56",
>>               "57",
>>               "58",
>>               "59",
>>               "60",
>>               "61",
>>               "62",
>>               "63",
>>               "64",
>>               "65",
>>               "66",
>>               "67",
>>               "68",
>>               "69",
>>               "70",
>>               "71",
>>               "72",
>>               "73",
>>               "74",
>>               "75"
>>             ]
>>           }
>>         ]
>>       }
>>     ]
>>   },
>>   "aggregation_groups": [
>>     {
>>       "includes": [
>>         "HOUR_KEY",
>>         "DAY_KEY",
>>         "CITY_KEY",
>>         "CITY_ZHNAME",
>>         "MSISDN",
>>         "IMSI",
>>         "IMEI",
>>         "TACTYPE_KEY",
>>         "TACTYPE_ZHNAME",
>>         "TACBRAND_KEY",
>>         "TACBRAND_ZHNAME",
>>         "APP_TYPE_KEY",
>>         "APP_SUBTYPE_ZHNAME",
>>         "APP_SUBTYPE_KEY",
>>         "APPTYPE_ZHNAME"
>>       ],
>>       "select_rule": {
>>         "hierarchy_dims": [
>>           [
>>             "DAY_KEY",
>>             "HOUR_KEY"
>>           ]
>>         ],
>>         "mandatory_dims": [],
>>         "joint_dims": [
>>           [
>>             "MSISDN",
>>             "IMSI",
>>             "IMEI"
>>           ],
>>           [
>>             "TACTYPE_KEY",
>>             "TACTYPE_ZHNAME"
>>           ],
>>           [
>>             "TACBRAND_KEY",
>>             "TACBRAND_ZHNAME"
>>           ],
>>           [
>>             "APP_TYPE_KEY",
>>             "APPTYPE_ZHNAME"
>>           ],
>>           [
>>             "APP_SUBTYPE_KEY",
>>             "APP_SUBTYPE_ZHNAME"
>>           ]
>>         ]
>>       }
>>     }
>>   ],
>>   "signature": "rMiyEStPPLc9wLyNTJCEow==",
>>   "notify_list": [],
>>   "status_need_notify": [
>>     "ERROR",
>>     "DISCARDED",
>>     "SUCCEED"
>>   ],
>>   "partition_date_start": 0,
>>   "partition_date_end": 3153600000000,
>>   "auto_merge_time_ranges": [
>>     604800000,
>>     2419200000
>>   ],
>>   "retention_range": 604800000,
>>   "engine_type": 2,
>>   "storage_type": 2,
>>   "override_kylin_properties": {}
>> }
>>
>>
>> {
>>   "uuid": "fe441227-31a6-4694-85cd-9c6fcbf9fde5",
>>   "last_modified": 1486820767284,
>>   "version": "1.6.0",
>>   "name": "user_all_cube_2_only_msisdn",
>>   "model_name": "user_all_mode",
>>   "description": "",
>>   "null_string": null,
>>   "dimensions": [
>>     {
>>       "name": "HOUR_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "HOUR_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "DAY_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "DAY_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "CITY_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "CITY_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "CITY_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "CITY_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "MSISDN",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "MSISDN",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACTYPE_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACTYPE_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACTYPE_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACTYPE_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACBRAND_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACBRAND_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "TACBRAND_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "TACBRAND_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "APP_TYPE_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APP_TYPE_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "APP_SUBTYPE_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APP_SUBTYPE_ZHNAME",
>>       "derived": null
>>     },
>>     {
>>       "name": "APP_SUBTYPE_KEY",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APP_SUBTYPE_KEY",
>>       "derived": null
>>     },
>>     {
>>       "name": "APPTYPE_ZHNAME",
>>       "table": "KYLIN.DW_FT_SE_ST_HTTP_USER_L2_H_VIEW_USER_ALL",
>>       "column": "APPTYPE_ZHNAME",
>>       "derived": null
>>     }
>>   ],
>>   "measures": [
>>     {
>>       "name": "_COUNT_",
>>       "function": {
>>         "expression": "COUNT",
>>         "parameter": {
>>           "type": "constant",
>>           "value": "1",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "1",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "2",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "3",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_IP_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "4",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_IP_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "5",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_IP_FRAGMENT_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "6",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_IP_FRAGMENT_PCK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "7",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_TCP_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "8",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_TCP_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "9",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_TCP_DISORDERED_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "10",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_TCP_DISORDERED_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "11",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_TCP_RETRANSMISSION_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "12",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_TCP_RETRANSMISSION_MES_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "13",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_CONNECTION_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "14",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_ACKOFFSET_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "15",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_CONFIRMOFFSET_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "16",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "17",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_FAIL_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "18",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_FAIL_CONTENT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "19",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "20",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_FAIL_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "21",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_REQ_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "22",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_RES_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "23",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "24",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_ONLINE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "25",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_ONLINE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "26",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "ONLINE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "27",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_SYN_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "28",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_SYNACK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "29",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_ACK_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "30",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_DROP_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "31",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_REQ_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "32",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "33",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_FAILURE_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "34",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_FIRST_ACK_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "35",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_ACK_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "36",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_UPLINK_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "37",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DOWNLINK_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "38",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_TOTAL_FLOW",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "39",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_TOTAL_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "40",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "AVERAGE_DELAY",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "41",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "RST_INTERRUPT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "42",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "FIN_INTERRUPT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "43",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_BUSI_INTERRUPT_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "44",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_HOME_REQ_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "45",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_HOME_RES_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "46",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_HOME_RES_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "47",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_FLOW_30",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "48",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_DUR_30",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "49",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_FLOW_50",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "50",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_DUR_50",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "51",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_FLOW_100",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "52",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_DL_DUR_100",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "53",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_SPAGE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "54",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_SPAGE_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "55",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_BPAGE_DUR",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "56",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_BPAGE_SUC_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "57",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SESS_FINISH_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "58",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "BUSINESS_NORESP_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "59",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "TCP_LINK_SUC_TO_FI_DELAY_TRAN_REQ",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "60",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DELAY_FR_FI_TRA_RE_TO_FI_RE_PAC",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "61",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_DATA_300",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "62",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "ONLINE_DUR_300",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "63",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "DL_DATA_500",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "64",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "ONLINE_DUR_500",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "65",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_RSP_FAIL_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "66",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_RSP_TERMFAIL_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "67",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_RSP_SPFAIL_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "68",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "HTTP_NONRSP_CNT",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "69",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SUM_XDR_RATE",
>>           "next_parameter": null
>>         },
>>         "returntype": "decimal"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "70",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "71",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_1_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "72",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_3_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "73",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_5_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "74",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_7_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     },
>>     {
>>       "name": "75",
>>       "function": {
>>         "expression": "SUM",
>>         "parameter": {
>>           "type": "column",
>>           "value": "UL_10_SUM_XDR_NUM",
>>           "next_parameter": null
>>         },
>>         "returntype": "bigint"
>>       },
>>       "dependent_measure_ref": null
>>     }
>>   ],
>>   "dictionaries": [],
>>   "rowkey": {
>>     "rowkey_columns": [
>>       {
>>         "column": "HOUR_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "DAY_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "CITY_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "CITY_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "MSISDN",
>>         "encoding": "integer:8",
>>         "isShardBy": true
>>       },
>>       {
>>         "column": "TACTYPE_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACTYPE_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACBRAND_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "TACBRAND_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APP_TYPE_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APP_SUBTYPE_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APP_SUBTYPE_KEY",
>>         "encoding": "integer:4",
>>         "isShardBy": false
>>       },
>>       {
>>         "column": "APPTYPE_ZHNAME",
>>         "encoding": "dict",
>>         "isShardBy": false
>>       }
>>     ]
>>   },
>>   "hbase_mapping": {
>>     "column_family": [
>>       {
>>         "name": "F1",
>>         "columns": [
>>           {
>>             "qualifier": "M",
>>             "measure_refs": [
>>               "_COUNT_",
>>               "1",
>>               "2",
>>               "3",
>>               "4",
>>               "5",
>>               "6",
>>               "7",
>>               "8",
>>               "9",
>>               "10",
>>               "11",
>>               "12",
>>               "13",
>>               "14",
>>               "15",
>>               "16",
>>               "17",
>>               "18",
>>               "19",
>>               "20",
>>               "21",
>>               "22",
>>               "23",
>>               "24",
>>               "25",
>>               "26",
>>               "27",
>>               "28",
>>               "29",
>>               "30",
>>               "31",
>>               "32",
>>               "33",
>>               "34",
>>               "35",
>>               "36",
>>               "37",
>>               "38",
>>               "39",
>>               "40",
>>               "41",
>>               "42",
>>               "43",
>>               "44",
>>               "45",
>>               "46",
>>               "47",
>>               "48",
>>               "49",
>>               "50",
>>               "51",
>>               "52",
>>               "53",
>>               "54",
>>               "55",
>>               "56",
>>               "57",
>>               "58",
>>               "59",
>>               "60",
>>               "61",
>>               "62",
>>               "63",
>>               "64",
>>               "65",
>>               "66",
>>               "67",
>>               "68",
>>               "69",
>>               "70",
>>               "71",
>>               "72",
>>               "73",
>>               "74",
>>               "75"
>>             ]
>>           }
>>         ]
>>       }
>>     ]
>>   },
>>   "aggregation_groups": [
>>     {
>>       "includes": [
>>         "HOUR_KEY",
>>         "DAY_KEY",
>>         "CITY_KEY",
>>         "CITY_ZHNAME",
>>         "MSISDN",
>>         "TACTYPE_KEY",
>>         "TACTYPE_ZHNAME",
>>         "TACBRAND_KEY",
>>         "TACBRAND_ZHNAME",
>>         "APP_TYPE_KEY",
>>         "APP_SUBTYPE_ZHNAME",
>>         "APP_SUBTYPE_KEY",
>>         "APPTYPE_ZHNAME"
>>       ],
>>       "select_rule": {
>>         "hierarchy_dims": [
>>           [
>>             "DAY_KEY",
>>             "HOUR_KEY"
>>           ]
>>         ],
>>         "mandatory_dims": [
>>           "MSISDN"
>>         ],
>>         "joint_dims": [
>>           [
>>             "CITY_KEY",
>>             "CITY_ZHNAME"
>>           ],
>>           [
>>             "TACTYPE_KEY",
>>             "TACTYPE_ZHNAME"
>>           ],
>>           [
>>             "TACBRAND_KEY",
>>             "TACBRAND_ZHNAME"
>>           ],
>>           [
>>             "APP_TYPE_KEY",
>>             "APPTYPE_ZHNAME"
>>           ],
>>           [
>>             "APP_SUBTYPE_KEY",
>>             "APP_SUBTYPE_ZHNAME"
>>           ]
>>         ]
>>       }
>>     }
>>   ],
>>   "signature": "yYStTnD6sz4H3/IZyTtkyA==",
>>   "notify_list": [],
>>   "status_need_notify": [
>>     "ERROR",
>>     "DISCARDED",
>>     "SUCCEED"
>>   ],
>>   "partition_date_start": 0,
>>   "partition_date_end": 3153600000000,
>>   "auto_merge_time_ranges": [
>>     604800000,
>>     2419200000
>>   ],
>>   "retention_range": 604800000,
>>   "engine_type": 2,
>>   "storage_type": 2,
>>   "override_kylin_properties": {}
>> }
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "ShaoFeng Shi";<shaofengshi@apache.org>;
>> *发送时间:* 2017年2月13日(星期一) 晚上7:04
>> *收件人:* "user"<user@kylin.apache.org>;
>> *主题:* Re: 求助有一个超大维度
>>
>> root cause:  java.lang.OutOfMemoryError: GC overhead
>>
>> How many dimensions in the cube? if you can share the cube JSON, that
>> would be helpful for trouble shooting.
>>
>> 2017-02-13 10:53 GMT+08:00 不清 <452652018@qq.com>:
>>
>>> kylin社区,您好!
>>>
>>> 是手机号作为维度,这个维度的去重值在500w~1500w。
>>> 我是使用的integer 编码 然后length设置为8.  测试的数据量大约在1亿条。是我设置的有问题么?
>>>
>>> 对于超大维度,kylin需要进行什么设置么?
>>>
>>> 我使用的kylin版本是1.6.
>>>
>>> 谢谢
>>>
>>> 报错步骤是 build cube
>>> map任务耗时特别长,最后还报错了,如下
>>> Error: java.io.IOException: Failed to build cube in mapper 36 at
>>> org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
>>> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:148) at
>>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784) at
>>> org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
>>> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at
>>> java.security.AccessController.doPrivileged(Native Method) at
>>> javax.security.auth.Subject.doAs(Subject.java:415) at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
>>> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) Caused
>>> by: java.util.concurrent.ExecutionException:
>>> java.lang.RuntimeException: java.io.IOException: java.io.IOException:
>>> java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: Java heap space at
>>> java.util.concurrent.FutureTask.report(FutureTask.java:122) at
>>> java.util.concurrent.FutureTask.get(FutureTask.java:188) at
>>> org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
>>> ... 8 more Caused by: java.lang.RuntimeException: java.io.IOException:
>>> java.io.IOException: java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: Java heap space at
>>> org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1
>>> .run(AbstractInMemCubeBuilder.java:84) at java.util.concurrent.Executors
>>> $RunnableAdapter.call(Executors.java:471) at
>>> java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745) Caused by:
>>> java.io.IOException: java.io.IOException: java.lang.RuntimeException:
>>> java.io.IOException: java.lang.OutOfMemoryError: Java heap space at
>>> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnc
>>> e.build(DoggedCubeBuilder.java:128) at org.apache.kylin.cube.inmemcub
>>> ing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:75) at
>>> org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1
>>> .run(AbstractInMemCubeBuilder.java:82) ... 5 more Caused by:
>>> java.io.IOException: java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: Java heap space at
>>> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnc
>>> e.abort(DoggedCubeBuilder.java:196) at org.apache.kylin.cube.inmemcub
>>> ing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:169)
>>> at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnc
>>> e.build(DoggedCubeBuilder.java:116) ... 7 more Caused by:
>>> java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: Java heap space at
>>> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThr
>>> ead.run(DoggedCubeBuilder.java:289) Caused by: java.io.IOException:
>>> java.lang.OutOfMemoryError: Java heap space at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.throwExce
>>> ptionIfAny(InMemCubeBuilder.java:226) at org.apache.kylin.cube.inmemcub
>>> ing.InMemCubeBuilder.build(InMemCubeBuilder.java:186) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:137)
>>> at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThr
>>> ead.run(DoggedCubeBuilder.java:284) Caused by:
>>> java.lang.OutOfMemoryError: Java heap space at
>>> java.math.BigInteger.<init>(BigInteger.java:973) at
>>> java.math.BigInteger.valueOf(BigInteger.java:957) at
>>> java.math.BigDecimal.inflate(BigDecimal.java:3519) at
>>> java.math.BigDecimal.unscaledValue(BigDecimal.java:2205) at
>>> org.apache.kylin.metadata.datatype.BigDecimalSerializer.seri
>>> alize(BigDecimalSerializer.java:56) at org.apache.kylin.metadata.data
>>> type.BigDecimalSerializer.serialize(BigDecimalSerializer.java:33) at
>>> org.apache.kylin.measure.MeasureCodec.encode(MeasureCodec.java:76) at
>>> org.apache.kylin.measure.BufferedMeasureCodec.encode(BufferedMeasureCodec.java:93)
>>> at org.apache.kylin.gridtable.GTAggregateScanner$AggregationCac
>>> he$ReturningRecord.load(GTAggregateScanner.java:412) at
>>> org.apache.kylin.gridtable.GTAggregateScanner$AggregationCac
>>> he$2.next(GTAggregateScanner.java:355) at org.apache.kylin.gridtable.GTA
>>> ggregateScanner$AggregationCache$2.next(GTAggregateScanner.java:342) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.scanAndAg
>>> gregateGridTable(InMemCubeBuilder.java:436) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.aggregate
>>> Cuboid(InMemCubeBuilder.java:399) at org.apache.kylin.cube.inmemcub
>>> ing.InMemCubeBuilder.buildCuboid(InMemCubeBuilder.java:391) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.access$300(InMemCubeBuilder.java:65)
>>> at org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$CuboidTas
>>> kThread.run(InMemCubeBuilder.java:270) Container killed by the
>>> ApplicationMaster. Container killed on request. Exit code is 143 Container
>>> exited with a non-zero exit code 143
>>>
>>>
>>>
>>> 还有一次报错是:
>>> Error: java.io.IOException: Failed to build cube in mapper 11 at
>>> org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
>>> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:148) at
>>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784) at
>>> org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
>>> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at
>>> java.security.AccessController.doPrivileged(Native Method) at
>>> javax.security.auth.Subject.doAs(Subject.java:415) at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
>>> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) Caused
>>> by: java.util.concurrent.ExecutionException:
>>> java.lang.RuntimeException: java.io.IOException: java.io.IOException:
>>> java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded at
>>> java.util.concurrent.FutureTask.report(FutureTask.java:122) at
>>> java.util.concurrent.FutureTask.get(FutureTask.java:188) at
>>> org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
>>> ... 8 more Caused by: java.lang.RuntimeException: java.io.IOException:
>>> java.io.IOException: java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded at
>>> org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1
>>> .run(AbstractInMemCubeBuilder.java:84) at java.util.concurrent.Executors
>>> $RunnableAdapter.call(Executors.java:471) at
>>> java.util.concurrent.FutureTask.run(FutureTask.java:262) at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745) Caused by:
>>> java.io.IOException: java.io.IOException: java.lang.RuntimeException:
>>> java.io.IOException: java.lang.OutOfMemoryError: GC overhead limit exceeded
>>> at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnc
>>> e.build(DoggedCubeBuilder.java:128) at org.apache.kylin.cube.inmemcub
>>> ing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:75) at
>>> org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1
>>> .run(AbstractInMemCubeBuilder.java:82) ... 5 more Caused by:
>>> java.io.IOException: java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded at
>>> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnc
>>> e.abort(DoggedCubeBuilder.java:196) at org.apache.kylin.cube.inmemcub
>>> ing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:169)
>>> at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnc
>>> e.build(DoggedCubeBuilder.java:116) ... 7 more Caused by:
>>> java.lang.RuntimeException: java.io.IOException:
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded at
>>> org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThr
>>> ead.run(DoggedCubeBuilder.java:289) Caused by: java.io.IOException:
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.throwExce
>>> ptionIfAny(InMemCubeBuilder.java:226) at org.apache.kylin.cube.inmemcub
>>> ing.InMemCubeBuilder.build(InMemCubeBuilder.java:186) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:137)
>>> at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThr
>>> ead.run(DoggedCubeBuilder.java:284) Caused by:
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded at
>>> java.math.BigInteger.valueOf(BigInteger.java:957) at
>>> java.math.BigDecimal.inflate(BigDecimal.java:3519) at
>>> java.math.BigDecimal.unscaledValue(BigDecimal.java:2205) at
>>> org.apache.kylin.metadata.datatype.BigDecimalSerializer.seri
>>> alize(BigDecimalSerializer.java:56) at org.apache.kylin.metadata.data
>>> type.BigDecimalSerializer.serialize(BigDecimalSerializer.java:33) at
>>> org.apache.kylin.measure.MeasureCodec.encode(MeasureCodec.java:76) at
>>> org.apache.kylin.measure.BufferedMeasureCodec.encode(BufferedMeasureCodec.java:93)
>>> at org.apache.kylin.gridtable.GTAggregateScanner$AggregationCac
>>> he$ReturningRecord.load(GTAggregateScanner.java:412) at
>>> org.apache.kylin.gridtable.GTAggregateScanner$AggregationCac
>>> he$2.next(GTAggregateScanner.java:355) at org.apache.kylin.gridtable.GTA
>>> ggregateScanner$AggregationCache$2.next(GTAggregateScanner.java:342) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.scanAndAg
>>> gregateGridTable(InMemCubeBuilder.java:436) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.aggregate
>>> Cuboid(InMemCubeBuilder.java:399) at org.apache.kylin.cube.inmemcub
>>> ing.InMemCubeBuilder.buildCuboid(InMemCubeBuilder.java:391) at
>>> org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.access$300(InMemCubeBuilder.java:65)
>>> at org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$CuboidTas
>>> kThread.run(InMemCubeBuilder.java:270)
>>>
>>>
>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>>
>>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message