Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 30319104BF for ; Wed, 17 Jul 2013 21:58:53 +0000 (UTC) Received: (qmail 80641 invoked by uid 500); 17 Jul 2013 21:58:51 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 80597 invoked by uid 500); 17 Jul 2013 21:58:50 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 80560 invoked by uid 99); 17 Jul 2013 21:58:50 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Jul 2013 21:58:50 +0000 Date: Wed, 17 Jul 2013 21:58:50 +0000 (UTC) From: "Kihwal Lee (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-4943) WebHdfsFileSystem does not work when original file path has encoded chars MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4943: ----------------------------- Fix Version/s: 0.23.10 > WebHdfsFileSystem does not work when original file path has encoded chars > -------------------------------------------------------------------------- > > Key: HDFS-4943 > URL: https://issues.apache.org/jira/browse/HDFS-4943 > Project: Hadoop HDFS > Issue Type: Bug > Components: webhdfs > Affects Versions: 1.2.0, 1.1.2, 2.0.4-alpha, 0.23.10 > Reporter: Jerry He > Assignee: Jerry He > Priority: Minor > Fix For: 2.1.0-beta, 0.23.10 > > Attachments: HDFS-4943-b023.patch, HDFS-4943-trunk.patch, HDFS-4943-trunk-v2.patch > > > In HBase, the WAL (hlog) file name on hdfs is URL encoded. For example, > hdtest010%2C60020%2C1371000602151.1371058984668 > When we use webhdfs client to access the hlog file via httpfs, it does not work in this case. > $ hadoop fs -ls hdfs:///user/biadmin/hbase_hlogs > Found 1 items > -rw-r--r-- 3 biadmin supergroup 15049470 2013-06-12 10:45 /user/biadmin/hbase_hlogs/hdtest010%2C60020%2C1371000602151.1371058984668 > $ hadoop fs -ls hdfs:///user/biadmin/hbase_hlogs/hdtest010%2C60020%2C1371000602151.1371058984668 > Found 1 items > -rw-r--r-- 3 biadmin supergroup 15049470 2013-06-12 10:45 /user/biadmin/hbase_hlogs/hdtest010%2C60020%2C1371000602151.1371058984668 > $ hadoop fs -ls webhdfs://hdtest010:14000/user/biadmin/hbase_hlogs > Found 1 items > -rw-r--r-- 3 biadmin supergroup 15049470 2013-06-12 10:45 /user/biadmin/hbase_hlogs/hdtest010%2C60020%2C1371000602151.1371058984668 > $ > $ hadoop fs -ls webhdfs://hdtest010:14000/user/biadmin/hbase_hlogs/hdtest010%2C60020%2C1371000602151.1371058984668 > 13/06/27 18:36:08 DEBUG web.WebHdfsFileSystem: Original exception is > org.apache.hadoop.ipc.RemoteException:java.io.FileNotFoundException:File does not exist: /user/biadmin/hbase_hlogs/hdtest010,60020,1371000602151.1371058984668 > at org.apache.hadoop.hdfs.web.JsonUtil.toRemoteException(JsonUtil.java:114) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:299) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$500(WebHdfsFileSystem.java:104) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$Runner.getResponse(WebHdfsFileSystem.java:641) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$Runner.run(WebHdfsFileSystem.java:538) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.run(WebHdfsFileSystem.java:468) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.getHdfsFileStatus(WebHdfsFileSystem.java:662) > at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.getFileStatus(WebHdfsFileSystem.java:673) > at org.apache.hadoop.fs.FileSystem.getFileStatus(FileSystem.java:1365) > at org.apache.hadoop.fs.FileSystem.globStatusInternal(FileSystem.java:1048) > at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:987) > at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:965) > at org.apache.hadoop.fs.FsShell.ls(FsShell.java:573) > at org.apache.hadoop.fs.FsShell.doall(FsShell.java:1571) > at org.apache.hadoop.fs.FsShell.run(FsShell.java:1789) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) > at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895) > ls: Cannot access webhdfs://hdtest010:14000/user/biadmin/hbase_hlogs/hdtest010%2C60020%2C1371000602151.1371058984668: No such file or directory. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira