hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13792) Stackoverflow for schemeless defaultFS with trailing slash
Date Fri, 04 Nov 2016 00:29:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634772#comment-15634772
] 

Mingliang Liu commented on HADOOP-13792:
----------------------------------------

{quote}
Uri abc.com/ is parsed into scheme=null, authority=null, path=abc.com/; while abc.com into
scheme=hdfs, authority=abc.com, path=.
{quote}
The {{fixName()}} will fix the scheme name for the URI and the default is hdfs.

I think the patch makes sense. Let's commit to {{trunk}} and {{branch-2}}, though the error
case is incompatible, which should not be a real problem. I want to ping [~aw] for 2nd opinion.

In order to really break compatibility, in the long term I think we can refuse any non fully-qualified
URI so we don't have to {{fixName()}}.

The checkstyle warnings are related.

> Stackoverflow for schemeless defaultFS with trailing slash
> ----------------------------------------------------------
>
>                 Key: HADOOP-13792
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13792
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.7.2
>            Reporter: Darius Murawski
>            Assignee: John Zhuge
>             Fix For: 3.0.0-alpha2
>
>         Attachments: HADOOP-13792.001.patch
>
>
> Command: hadoop fs -fs 172.16.12.79/ -mkdir -p /usr/hduser
> Results in a Stack Overflow
> {code}
> Exception in thread "main" java.lang.StackOverflowError
> 	at java.lang.String.indexOf(String.java:1503)
> 	at java.net.URI$Parser.scan(URI.java:2951)
> 	at java.net.URI$Parser.parseHierarchical(URI.java:3104)
> 	at java.net.URI$Parser.parse(URI.java:3063)
> 	at java.net.URI.<init>(URI.java:588)
> 	at java.net.URI.create(URI.java:850)
> 	at org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:180)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:172)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:357)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:172)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:357)
>         (...)
> {code}
> The Problem is the Slash at the End of the IP Address. When I remove it, the command
is executed correctly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message