hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-14423) Percent (%) and plus (+) characters no longer work in WebHDFS
Date Tue, 13 Aug 2019 23:52:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906737#comment-16906737
] 

Hudson commented on HDFS-14423:
-------------------------------

FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17108 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/17108/])
HDFS-14423. Percent (%) and plus (+) characters no longer work in (iwasakims: rev da0006fe0473e353ee2d489156248a01aa982dfd)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/webhdfs/WebHdfsHandler.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java
* (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java


> Percent (%) and plus (+) characters no longer work in WebHDFS
> -------------------------------------------------------------
>
>                 Key: HDFS-14423
>                 URL: https://issues.apache.org/jira/browse/HDFS-14423
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: webhdfs
>    Affects Versions: 3.2.0, 3.1.2
>         Environment: Ubuntu 16.04, but I believe this is irrelevant.
>            Reporter: Jing Wang
>            Assignee: Masatake Iwasaki
>            Priority: Major
>         Attachments: HDFS-14423.001.patch, HDFS-14423.002.patch, HDFS-14423.003.patch,
HDFS-14423.004.patch
>
>
> The following commands with percent (%) no longer work starting with version 3.1:
> {code:java}
> $ hadoop/bin/hdfs dfs -touchz webhdfs://localhost/%
> $ hadoop/bin/hdfs dfs -cat webhdfs://localhost/%
> cat: URLDecoder: Incomplete trailing escape (%) pattern
> {code}
> Also, plus (+ ) characters get turned into spaces when doing DN operations:
> {code:java}
> $ hadoop/bin/hdfs dfs -touchz webhdfs://localhost/a+b
> $ hadoop/bin/hdfs dfs -mkdir webhdfs://localhost/c+d
> $ hadoop/bin/hdfs dfs -ls /
> Found 4 items
> -rw-r--r--   1 jing supergroup          0 2019-04-12 11:20 /a b
> drwxr-xr-x   - jing supergroup          0 2019-04-12 11:21 /c+d
> {code}
> I can confirm that these commands work correctly on 2.9 and 3.0. Also, the usual hdfs://
client works as expected.
> I suspect a relation with HDFS-13176 or HDFS-13582, but I'm not sure what the right fix
is. Note that Hive uses % to escape special characters in partition values, so banning % might
not be a good option. For example, Hive will create a paths like {{table_name/partition_key=%2F}}
when {{partition_key='/'}}.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message