drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dave Kincaid (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5205) hdfs file storage configuration inflexible
Date Thu, 19 Jan 2017 20:33:27 GMT
Dave Kincaid created DRILL-5205:

             Summary: hdfs file storage configuration inflexible
                 Key: DRILL-5205
                 URL: https://issues.apache.org/jira/browse/DRILL-5205
             Project: Apache Drill
          Issue Type: Improvement
            Reporter: Dave Kincaid

When running in dynamic environments like EMR where the cluster that Drill is running on is
transient the ip address of the Hadoop name node is different from one day to the next. This
makes it very difficult to configure a storage plugin/workspace that points to the HDFS file
system. Everytime we startup a new EMR cluster we have to manually open the dfs storage plugin
config and change the ip address in the hdfs:/// connection field to the currently running
instance. It would be very useful to be able to have Drill figure out this IP address itself.

This message was sent by Atlassian JIRA

View raw message