hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6601) HarFileSystem shows incorrect replication numbers and permissions
Date Sat, 27 Feb 2010 00:24:05 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tsz Wo (Nicholas), SZE updated HADOOP-6601:
-------------------------------------------

    Description: 
In the har dir, the replication # of part-0 is 3.
{noformat}
-bash-3.1$ hadoop fs -ls  ${DIR}.har
Found 3 items
-rw-------   5 tsz users       1141 2010-02-10 18:34 /user/tsz/t20.har/_index
-rw-------   5 tsz users         24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
-rw-------   3 tsz users      15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
{noformat}
but the replication # of the individual har:// files is shown as 5.
{noformat}
-bash-3.1$ hadoop fs -lsr  ${HAR_FULL}/
drw-------   - tsz users          0 2010-02-10 18:34 /user/tsz/t20.har/t20
-rw-------   5 tsz users        723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
-rw-------   5 tsz users        779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
-rw-------   5 tsz users        818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
...
{noformat}
The permission also has similar problem.  Clearly, the permission of t20.har/t20 shown above
is incorrect.

  was:
In the har dir, the replication # of part-0 is 3.
{noformat}
-bash-3.1$ hadoop fs -ls  ${DIR}.har
Found 3 items
-rw-------   5 tsz users       1141 2010-02-10 18:34 /user/tsz/t20.har/_index
-rw-------   5 tsz users         24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
-rw-------   3 tsz users      15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
{noformat}
but the replication # of the individual har:// files is shown as 5.
{noformat}
-bash-3.1$ hadoop fs -ls  ${HAR_FULL}/${DIR}
Found 20 items
-rw-------   5 tsz users        723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
-rw-------   5 tsz users        779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
-rw-------   5 tsz users        818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
-rw-------   5 tsz users        811 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000003
...
{noformat}

        Summary: HarFileSystem shows incorrect replication numbers and permissions  (was:
HarFileSystem shows incorrect replication numbers)

> HarFileSystem shows incorrect replication numbers and permissions
> -----------------------------------------------------------------
>
>                 Key: HADOOP-6601
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6601
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Mahadev konar
>
> In the har dir, the replication # of part-0 is 3.
> {noformat}
> -bash-3.1$ hadoop fs -ls  ${DIR}.har
> Found 3 items
> -rw-------   5 tsz users       1141 2010-02-10 18:34 /user/tsz/t20.har/_index
> -rw-------   5 tsz users         24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
> -rw-------   3 tsz users      15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
> {noformat}
> but the replication # of the individual har:// files is shown as 5.
> {noformat}
> -bash-3.1$ hadoop fs -lsr  ${HAR_FULL}/
> drw-------   - tsz users          0 2010-02-10 18:34 /user/tsz/t20.har/t20
> -rw-------   5 tsz users        723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
> -rw-------   5 tsz users        779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
> -rw-------   5 tsz users        818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
> ...
> {noformat}
> The permission also has similar problem.  Clearly, the permission of t20.har/t20 shown
above is incorrect.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message