hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-14086) Failure in test_libhdfs_ops
Date Tue, 12 Feb 2019 21:06:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766459#comment-16766459

Sahil Takiar commented on HDFS-14086:

The issue here is that out of the box, the {{test_libhdfs_ops.c}} runs agains the local filesystem.
However, the test was written to run against a mini DFS cluster. Modifying the test to run
against a {{NativeMiniDfsCluster}} fixes most of the failures seen when running this file.

More details can be found in HDFS-14267. However, I suggest we close this JIRA in favor of HDFS-14267
which fixes the issues with {{test_libhdfs_ops.c}} and does some additional test cleanup.

> Failure in test_libhdfs_ops
> ---------------------------
>                 Key: HDFS-14086
>                 URL: https://issues.apache.org/jira/browse/HDFS-14086
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: native
>    Affects Versions: 3.0.3
>            Reporter: Pranay Singh
>            Priority: Minor
>              Labels: test
> test_libhdfs_ops hdfs_static test was not getting executed,  the issue that I have fixed
in HDFS-14083 is 
> seen because this test program is not getting executed so I had to change the below file
> execute this test binary as a part of normal run. There are some failures that are seen
when this
> test program is run. This jira tracks those failures.
> Details of change to enable this test
> ------------------------------------------------
> hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/CMakeLists.txt
> add_libhdfs_test(test_libhdfs_ops hdfs_static) --->
> Failures that are seen when this test is run.
> ---------------------------------------------------------
> Name: file:/tmp/hsperfdata_root, Type: D, Replication: 1, BlockSize: 33554432, Size:
0, LastMod: Tue Nov 13 18:03:20 2018
> Owner: root, Group: root, Permissions: 493 (rwxr-xr-x)
> hdfsGetHosts - SUCCESS! ... 
> hdfsChown(path=/tmp/testfile.txt, owner=(null), group=users): FileSystem#setOwner error:
> Shell.ExitCodeException: chown: changing group of '/tmp/testfile.txt': Operation not
> ExitCodeException exitCode=1: chown: changing group of '/tmp/testfile.txt': Operation
not permitted
> 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:1008)
> 	at org.apache.hadoop.util.Shell.run(Shell.java:901)
> 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1213)
> 	at org.apache.hadoop.util.Shell.execCommand(Shell.java:1307)
> 	at org.apache.hadoop.util.Shell.execCommand(Shell.java:1289)
> 	at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1350)
> 	at org.apache.hadoop.fs.FileUtil.setOwner(FileUtil.java:1152)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.setOwner(RawLocalFileSystem.java:851)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$2.apply(ChecksumFileSystem.java:520)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:489)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.setOwner(ChecksumFileSystem.java:523)
> hdfsChown: Failed!

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message