accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (ACCUMULO-3212) Configuration objects created with CredentialProvider load defaults unnecessarily
Date Mon, 20 Oct 2014 20:19:34 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177411#comment-14177411
] 

Josh Elser edited comment on ACCUMULO-3212 at 10/20/14 8:18 PM:
----------------------------------------------------------------

It seems like the internal parsing might have actually changed, but I'm still trying to figure
out exactly what changed. I can make a test with MiniDFSCluster which works but I have to
include the NN:port in the authority of the credential provider URI (e.g. {{jceks://hdfs@localhost:port}}).

{noformat}
Caused by: java.io.IOException: Incomplete HDFS URI, no host: hdfs:///accumulo.jceks
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:142)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
        at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:88)
        at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:65)
        at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:291)
        at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:59)
{noformat}


was (Author: elserj):
It seems like the internal parsing might have actually changed, but I'm still trying to figure
out exactly what changed. I can make a test with MiniDFSCluster which works but I have to
include the NN:port in the authority of the credential provider URI (e.g. {{jceks://hdfs@localhost:port}}).

> Configuration objects created with CredentialProvider load defaults unnecessarily
> ---------------------------------------------------------------------------------
>
>                 Key: ACCUMULO-3212
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3212
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: tserver
>    Affects Versions: 1.6.1
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>            Priority: Minor
>             Fix For: 1.6.2, 1.7.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Jstack'ed a tserver and caught it in the middle of doing a bunch of URLClassloader and
Jar stuff when creating a Hadoop Configuration. Obviously, this struck me as odd (given that
I know those aren't "fast" methods).
> Looking at it some more, when I created the Configuration objects, I didn't pass in {{false}}
so the defaults were getting loaded. Regardless of how expensive it actually is, it's unnecessary.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message