hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andy Isaacson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9193) hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script
Date Tue, 15 Jan 2013 20:24:16 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13554284#comment-13554284
] 

Andy Isaacson commented on HADOOP-9193:
---------------------------------------

The TestZKFailoverController failure is unrelated.  There does not seem to be any existing
test code for the {{hadoop dfs}} shell scripts, so adding tests for this condition is challenging.
                
> hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script
> ----------------------------------------------------------------------------------------
>
>                 Key: HADOOP-9193
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9193
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: scripts
>    Affects Versions: 2.0.2-alpha, 0.23.5
>            Reporter: Jason Lowe
>            Assignee: Andy Isaacson
>            Priority: Minor
>         Attachments: hadoop9193.diff
>
>
> The hadoop front-end script will print a deprecation warning and defer to the hdfs front-end
script for certain commands, like fsck, dfs.  If a wildcard appears as an argument then it
can be inadvertently expanded by the shell to match a local filesystem path before being sent
to the hdfs script, which can be very confusing to the end user.
> For example, the following two commands usually perform very different things, even though
they should be equivalent:
> {code}
> hadoop fs -ls /tmp/\*
> hadoop dfs -ls /tmp/\*
> {code}
> The former lists everything in the default filesystem under /tmp, while the latter expands
/tmp/\* into everything in the *local* filesystem under /tmp and passes those as arguments
to try to list in the default filesystem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message