hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6202) harchive: Har doesn't work on files having '%' character
Date Tue, 18 Aug 2009 19:26:14 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Koji Noguchi updated HADOOP-6202:
---------------------------------

    Description: 
If I have a harchive file test.har that contain 
/a/b <dir> 
/a/b/abc%cde <file>
/a/b/fgh <file>

{noformat}
$ hadoop dfs -cat test.har/_masterindex
1 
0 2046275926 0 244 
$ hadoop dfs -cat test.har/_index
/ dir none 0 0 user 
/user dir none 0 0 knoguchi 
/user/knoguchi/a/b dir none 0 0 abc%cde fgh 
/user/knoguchi dir none 0 0 a 
/user/knoguchi/a dir none 0 0 b 
/user/knoguchi/a/b/fgh file part-0 8 10 
/user/knoguchi/a/b/abc%cde file part-0 0 8 
$ hadoop dfs -lsr har:///user/knoguchi/test.har/
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi/a
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi/a/b
lsr: could not get get listing for 'har:/user/knoguchi/test.har/user/knoguchi/a/b' : File:
har://hdfs-aaa.bbb.ccc.com:8020/user/knoguchi/test.har/user/knoguchi/a/b/abc%cde does not
exist in har:///user/knoguchi/test.har
$
{noformat}


  was:
If I have a harchive file test.har that contain 
/a/b <dir> 
/a/b/abc%cde <file>
/a/b/fgh <file>

{noformat}
$ hadoop dfs -cat test.har/_masterindex
1 
0 2046275926 0 244 
$ hadoop dfs -cat test.har/_index
/ dir none 0 0 user 
/user dir none 0 0 knoguchi 
/user/knoguchi/a/b dir none 0 0 abc%cde fgh 
/user/knoguchi dir none 0 0 a 
/user/knoguchi/a dir none 0 0 b 
/user/knoguchi/a/b/fgh file part-0 8 10 
/user/knoguchi/a/b/abc%cde file part-0 0 8 
$ hadoop dfs -lsr har:///user/knoguchi/test.har/
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi/a
drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi/a/b
lsr: could not get get listing for 'har:/user/knoguchi/test.har/user/knoguchi/a/b' : File:
har://hdfs-mithrilgold-nn1.gold.ygrid.yahoo.com:8020/user/knoguchi/test.har/user/knoguchi/a/b/abc%cde
does not exist in har:///user/knoguchi/test.har
$
{noformat}



> harchive:   Har doesn't work on files having '%' character
> ----------------------------------------------------------
>
>                 Key: HADOOP-6202
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6202
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Koji Noguchi
>
> If I have a harchive file test.har that contain 
> /a/b <dir> 
> /a/b/abc%cde <file>
> /a/b/fgh <file>
> {noformat}
> $ hadoop dfs -cat test.har/_masterindex
> 1 
> 0 2046275926 0 244 
> $ hadoop dfs -cat test.har/_index
> / dir none 0 0 user 
> /user dir none 0 0 knoguchi 
> /user/knoguchi/a/b dir none 0 0 abc%cde fgh 
> /user/knoguchi dir none 0 0 a 
> /user/knoguchi/a dir none 0 0 b 
> /user/knoguchi/a/b/fgh file part-0 8 10 
> /user/knoguchi/a/b/abc%cde file part-0 0 8 
> $ hadoop dfs -lsr har:///user/knoguchi/test.har/
> drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user
> drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi
> drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi/a
> drw-r--r--   - knoguchi users          0 2009-08-18 18:52 /user/knoguchi/test.har/user/knoguchi/a/b
> lsr: could not get get listing for 'har:/user/knoguchi/test.har/user/knoguchi/a/b' :
File: har://hdfs-aaa.bbb.ccc.com:8020/user/knoguchi/test.har/user/knoguchi/a/b/abc%cde does
not exist in har:///user/knoguchi/test.har
> $
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message