hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuan Gao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15723) ABFS: Ranger Support
Date Wed, 19 Sep 2018 17:44:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620938#comment-16620938
] 

Yuan Gao commented on HADOOP-15723:
-----------------------------------

gayua@gayua-ubuntu:~/src/hadoop-15407/hadoop-tools/hadoop-azure$ mvn -T 1C -Dparallel-tests
-Dscale -DtestsThreadCount=8 clean
[INFO] Scanning for projects...
[INFO]
[INFO] Using the MultiThreadedBuilder implementation with a thread count of 2
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Azure support 3.2.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-azure ---
[INFO] Deleting /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/target
[INFO] Deleting /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure (includes = [dependency-reduced-pom.xml],
excludes = []
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-azure ---
[INFO] Executing tasks

main:
    [mkdir] Created dir: /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/target/test-dir
[INFO] Executed tasks
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hadoop-azure ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-azure ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 2 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-azure ---
[INFO] Compiling 152 source files to /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/target/classes
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/SecureStorageInterfa
verride a deprecated API.
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/SecureStorageInterfa
recation for details.
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/security/TokenUtils.
oop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/security/TokenUtils.java uses
unchecked or unsafe operations.
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/security/TokenUtils.
for details.
[INFO]
[INFO] --- maven-dependency-plugin:3.0.2:list (deplist) @ hadoop-azure ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hadoop-azure
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO] Copying 2 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hadoop-azure ---
[INFO] Compiling 136 source files to /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/target/test-classes
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestShel
ua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestShellDecryptionKeyProvi
d API.
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestShel
 with -Xlint:deprecation for details.
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/TestAccountConfig
5407/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/TestAccountConfiguration.java
uses unchecked or uns
[WARNING] /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/TestAccountConfig
checked for details.
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @ hadoop-azure ---
[INFO]
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemAuthorization
[INFO] Tests run: 59, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 176.898 s - in org.apache.hadoop.fs.azure.TestNativeAz
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked
[WARNING] Tests run: 43, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 1.75 s - in org.apache.hadoop.fs.azure.TestNativeAz
[INFO] Running org.apache.hadoop.fs.azure.TestBlobMetadata
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.881 s - in org.apache.hadoop.fs.azure.TestBlobMetadat
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked
[INFO] Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.676 s - in org.apache.hadoop.fs.azure.TestNativeAzu
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.451 s - in org.apache.hadoop.fs.azure.TestNativeAzure
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.944 s - in org.apache.hadoop.fs.azure.TestNativeAzure
[INFO] Running org.apache.hadoop.fs.azure.metrics.TestBandwidthGaugeUpdater
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.453 s - in org.apache.hadoop.fs.azure.metrics.TestBan
[INFO] Running org.apache.hadoop.fs.azure.metrics.TestRollingWindowAverage
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.252 s - in org.apache.hadoop.fs.azure.metrics.TestRol
[INFO] Running org.apache.hadoop.fs.azure.metrics.TestNativeAzureFileSystemMetricsSystem
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.854 s - in org.apache.hadoop.fs.azure.metrics.TestNat
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemUploadLogic
[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 0.091 s - in org.apache.hadoop.fs.azure.TestNativeAz
[INFO] Running org.apache.hadoop.fs.azure.TestWasbFsck
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.749 s - in org.apache.hadoop.fs.azure.TestWasbFsck
[INFO] Running org.apache.hadoop.fs.azure.TestClientThrottlingAnalyzer
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.811 s - in org.apache.hadoop.fs.azure.TestClientThro
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked
[INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.01 s - in org.apache.hadoop.fs.azure.TestNativeAzure
[INFO] Running org.apache.hadoop.fs.azure.TestShellDecryptionKeyProvider
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.162 s - in org.apache.hadoop.fs.azure.TestShellDec
[INFO] Running org.apache.hadoop.fs.azure.TestNativeAzureFileSystemBlockCompaction
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.872 s - in org.apache.hadoop.fs.azure.TestNativeAzur
[INFO] Running org.apache.hadoop.fs.azure.TestBlobOperationDescriptor
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.804 s - in org.apache.hadoop.fs.azure.TestBlobOperati
[INFO] Running org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.021 s - in org.apache.hadoop.fs.azure.TestOutOfBandAz
[INFO] Running org.apache.hadoop.fs.azurebfs.utils.TestUriUtils
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.115 s - in org.apache.hadoop.fs.azurebfs.utils.TestUr
[INFO] Running org.apache.hadoop.fs.azurebfs.diagnostics.TestConfigurationValidators
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.114 s - in org.apache.hadoop.fs.azurebfs.diagnostics
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestQueryParams
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.069 s - in org.apache.hadoop.fs.azurebfs.services.Tes
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestOauthFailOverHttp
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.571 s - in org.apache.hadoop.fs.azurebfs.services.Tes
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsClientThrottlingAnalyzer
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 35.839 s - in org.apache.hadoop.fs.azurebfs.services.Te
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestAbfsClient
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.455 s - in org.apache.hadoop.fs.azurebfs.services.Tes
[INFO] Running org.apache.hadoop.fs.azurebfs.services.TestShellDecryptionKeyProvider
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.184 s - in org.apache.hadoop.fs.azurebfs.services.Tes
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAbfsConfigurationFieldsValidation
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.334 s - in org.apache.hadoop.fs.azurebfs.TestAbfsConf
[INFO] Running org.apache.hadoop.fs.azurebfs.TestAccountConfiguration
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.306 s - in org.apache.hadoop.fs.azurebfs.TestAccountC
[INFO]
[INFO] Results:
[INFO]
[WARNING] Tests run: 277, Failures: 0, Errors: 0, Skipped: 11
[INFO]
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-azure ---
[INFO] Building jar: /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/target/hadoop-azure-3.2.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.6:attach-descriptor (attach-descriptor) @ hadoop-azure ---
[INFO] Skipping because packaging 'jar' is not pom.
[INFO]
[INFO] --- maven-jar-plugin:2.5:test-jar (default) @ hadoop-azure ---
[INFO] Building jar: /home/gayua/src/hadoop-15407/hadoop-tools/hadoop-azure/target/hadoop-azure-3.2.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- animal-sniffer-maven-plugin:1.16:check (signature-check) @ hadoop-azure ---
[INFO] Checking unresolved references to org.codehaus.mojo.signature:java18:1.0
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (depcheck) @ hadoop-azure ---
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:22 min (Wall Clock)
[INFO] Finished at: 2018-09-19T00:24:10Z
[INFO] Final Memory: 45M/459M
[INFO] ------------------------------------------------------------------------

> ABFS: Ranger Support
> --------------------
>
>                 Key: HADOOP-15723
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15723
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure
>    Affects Versions: HADOOP-15407
>            Reporter: Thomas Marquardt
>            Assignee: Da Zhou
>            Priority: Major
>         Attachments: HADOOP-15273-HADOOP-15407-001.patch, HADOOP-15273-HADOOP-15407-002.patch,
HADOOP-15273-HADOOP-15407-003.patch
>
>
> Add support for Ranger



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message