drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5062) External sort refers to the deprecated HDFS fs.default.name param
Date Tue, 22 Nov 2016 00:20:58 GMT
Paul Rogers created DRILL-5062:
----------------------------------

             Summary: External sort refers to the deprecated HDFS fs.default.name param
                 Key: DRILL-5062
                 URL: https://issues.apache.org/jira/browse/DRILL-5062
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.8.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
            Priority: Minor


Running a query that uses the external sort produces the following message in the log file:

{code}
[org.apache.hadoop.conf.Configuration.deprecation] - fs.default.name is deprecated. Instead,
use fs.defaultFS
{code}

External sort has the following line in the {{ExternalSortBatch}} constructor:

{code}
    conf.set("fs.default.name", config.getString(ExecConstants.EXTERNAL_SORT_SPILL_FILESYSTEM));
{code}

The {{TestParquetScan}} class has the same deprecated parameter name.

Looking elsewhere in Drill, it appears that the proper way to configure HDFS is as follows:

{code}
    fsConf.set(FileSystem.FS_DEFAULT_NAME_KEY, ...
{code}

That is, use the constant provided by HDFS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message