hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Zhuge (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13972) Access multiple Azure Data Lake stores with different SPIs
Date Wed, 11 Jan 2017 07:53:58 GMT
John Zhuge created HADOOP-13972:
-----------------------------------

             Summary: Access multiple Azure Data Lake stores with different SPIs
                 Key: HADOOP-13972
                 URL: https://issues.apache.org/jira/browse/HADOOP-13972
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/adl
    Affects Versions: 3.0.0-alpha2
            Reporter: John Zhuge


Useful when distcp needs to access 2 Data Lake stores with different SPIs.

Of course, a workaround is to grant the same SPI access permission to both stores, but sometimes
it might not be feasible.

One idea is to embed the store name in the configuration property names, e.g., {{dfs.adls.oauth2.<store>.client.id}}.
Per-store keys will be consulted first, then fall back to the global keys.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org


Mime
View raw message