kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vsevolod Ostapenko (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3068) HiveColumnCardinalityJob.java is using deprecated parameter name for HDFS block size
Date Wed, 29 Nov 2017 22:44:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vsevolod Ostapenko updated KYLIN-3068:
--------------------------------------
    Description: 
While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter
name for HDFS block size.
Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing
code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated
parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)


  was:
While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter
name for HDFS block size.
Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing
code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated
parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)

As the result users have to use deprecated name in kylin.properties, if job parameters need
to be tuned.


> HiveColumnCardinalityJob.java is using deprecated parameter name for HDFS block size
> ------------------------------------------------------------------------------------
>
>                 Key: KYLIN-3068
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3068
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v2.2.0
>         Environment: HDP 2.5.3, Kylin 2.2.0
>            Reporter: Vsevolod Ostapenko
>            Assignee: Dong Li
>            Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> While setting MR job configuration HiveColumnCardinalityJob.java uses deprecated parameter
name for HDFS block size.
> Since Hadoop 2.5 (at least) recommended parameter name is dfs.blocksize, while the existing
code (2.2.0 and earlier) uses dfs.block.size (please refer to the list of Hadoop deprecated
parameters - http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message