hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Zhuge (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-14205) No FileSystem for scheme: adl
Date Mon, 20 Mar 2017 19:46:41 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John Zhuge updated HADOOP-14205:
--------------------------------
    Attachment: HADOOP-14205.branch-2.001

Patch branch-2.001
- Add property fs.adl.impl and fs.AbstractFileSystem.adl.impl to core-default.xml
- Copy ADLS jars for hadoop-dist

Testing done
- Manual tests in single node setup
- Live unit tests

The following live unit tests failed:
{noformat}
Failed tests: 
  TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.testListStatus:257
expected:<1> but was:<10>

Tests in error: 
  TestAdlFileContextMainOperationsLive>FileContextMainOperationsBaseTest.testMkdirsFailsForSubdirectoryOfExistingFile:254
» AccessControl
  TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.testMkdirsFailsForSubdirectoryOfExistingFile:190
» AccessControl
{noformat}

The 2 testMkdirsFailsForSubdirectoryOfExistingFile errors are fixed by HDFS-11132.
Test testListStatus passes if the file system is empty, thus a test code problem.

> No FileSystem for scheme: adl
> -----------------------------
>
>                 Key: HADOOP-14205
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14205
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/adl
>    Affects Versions: 2.8.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>         Attachments: HADOOP-14205.branch-2.001
>
>
> {noformat}
> $ bin/hadoop fs -ls /
> ls: No FileSystem for scheme: adl
> {noformat}
> The problem is {{core-default.xml}} misses property {{fs.adl.impl}} and {{fs.AbstractFileSystem.adl.impl}}.
> After adding these 2 properties to {{etc/hadoop/core-sitex.xml}}, got this error:
> {noformat}
> $ bin/hadoop fs -ls /
> -ls: Fatal internal error
> java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.adl.AdlFileSystem
not found
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2231)
> 	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3207)
> 	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3239)
> 	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121)
> 	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3290)
> 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3258)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:470)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:223)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:454)
> 	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
> 	at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:325)
> 	at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:245)
> 	at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:228)
> 	at org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:103)
> 	at org.apache.hadoop.fs.shell.Command.run(Command.java:175)
> 	at org.apache.hadoop.fs.FsShell.run(FsShell.java:315)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
> 	at org.apache.hadoop.fs.FsShell.main(FsShell.java:378)
> Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.adl.AdlFileSystem
not found
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2137)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2229)
> 	... 18 more
> {noformat}
> The problem is ADLS jars are not copied to {{share/hadoop/tools/lib}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message