reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shouheng Yi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (REEF-1827) new Uri(path) in REEF.NET IO Returns Lowercase String
Date Thu, 13 Jul 2017 16:45:00 GMT
Shouheng Yi created REEF-1827:
---------------------------------

             Summary: new Uri(path) in REEF.NET IO Returns Lowercase String
                 Key: REEF-1827
                 URL: https://issues.apache.org/jira/browse/REEF-1827
             Project: REEF
          Issue Type: Bug
          Components: REEF.NET IO
    Affects Versions: 0.15
            Reporter: Shouheng Yi
            Priority: Minor


In the [Org.Apache.REEF.IO.FileSystem.IFileSystem|https://github.com/apache/reef/blob/3531944f11cc115b105a6bec4268713766425034/lang/cs/Org.Apache.REEF.IO/FileSystem/IFileSystem.cs],
we have many methods that are based on C#'s Uri. For example:

{code:none}
void CopyToLocal(Uri remoteFileUri, string localName);
void CreateDirectory(Uri directoryUri);
...
{code}

>From the logging and my experiments, this converts path to lowercase characters. For example:
{code:none}
new Uri("hdfs://XYZ123/mypath/data.txt") // Returns "hdfs://xyz123/mypath/data.txt"
{code}

If we are interacting with hdfs, in the subsequent dfs command in [Org.Apache.REEF.IO.FileSystem.Hadoop|https://github.com/apache/reef/blob/3531944f11cc115b105a6bec4268713766425034/lang/cs/Org.Apache.REEF.IO/FileSystem/Hadoop/HadoopFileSystem.cs]:
{code:none}
public void CopyToLocal(Uri remoteFileUri, string localName)
{
    _commandRunner.Run("dfs -get " + remoteFileUri + " " + localName);
}
{code}
this will fail, since hdfs is case-sensitive. I'm wondering if we are open to the idea of
having some string based APIs that ensure users that they are passing the exact path as they
specified in their code. Thanks!




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message