hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Hodges (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3557) provide means of escaping special characters to `hadoop fs` command
Date Fri, 29 Jun 2012 19:52:44 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404157#comment-13404157
] 

Jeff Hodges commented on HDFS-3557:
-----------------------------------

Sigh, I thought I had removed all the user specific stuff. Not able to edit it, so I'll just
repost with it.

$ hdfs -ls '/user/jhodges/NOPE_\{INPUT\}'
ls: Illegal file pattern: Expecting set closure character or end of range, or } for glob {INPUT
at 6
$ hdfs -ls '/user/jhodges/NOPE_{INPUT}'
ls: Cannot access /user/jhodges/NOPE_{INPUT}: No such file or directory.
$ hdfs -ls /user/jhodges/NOPE_\{INPUT\}
ls: Cannot access /user/jhodges/NOPE_{INPUT}: No such file or directory.

Proof of existence:

$ hdfs -ls /user/jhodges | grep NOPE
drwxr-xr-x   - jhodges supergroup          0 2012-06-29 19:47 /user/jhodges/NOPE_{INPUT}
                
> provide means of escaping special characters to `hadoop fs` command
> -------------------------------------------------------------------
>
>                 Key: HDFS-3557
>                 URL: https://issues.apache.org/jira/browse/HDFS-3557
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Jeff Hodges
>            Priority: Minor
>
> When running an investigative job, I used a date parameter that selected multiple directories
for the input (e.g. "my_data/2012/06/{18,19,20}"). It used this same date parameter when creating
the output directory.
> But `hadoop fs` was unable to ls, getmerge, or rmr it until I used the regex operator
"?" and mv to change the name (that is, `-mv output/2012/06/?18,19,20? foobar").
> Shells and filesystems for other systems provide a means of escaping "special characters"
generically, but there seems to be no such means in HDFS/`hadoop fs`. Providing one would
be a great way to make accessing HDFS more robust.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message