hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16292) SparkUtilities upload to HDFS doesn't work with viewfs
Date Fri, 24 Mar 2017 18:36:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940899#comment-15940899
] 

Hive QA commented on HIVE-16292:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12860387/HIVE-16292.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 10511 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[comments] (batchId=35)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4342/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4342/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4342/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12860387 - PreCommit-HIVE-Build

> SparkUtilities upload to HDFS doesn't work with viewfs
> ------------------------------------------------------
>
>                 Key: HIVE-16292
>                 URL: https://issues.apache.org/jira/browse/HIVE-16292
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Jimmy Xiang
>            Assignee: Jimmy Xiang
>            Priority: Minor
>         Attachments: HIVE-16292.1.patch
>
>
> If scratchdir is set to viewfs, HoS fails with exception like
> {noformt}
> java.lang.IllegalArgumentException: Wrong FS: viewfs://ns-default/tmp/hive_scratch/hive/hive/_spark_session_dir/f4031fca-2885-4e7a-9b05-764d25d0e488/hive-exec-1.1.0-cdh5.7.2.jar,
expected: hdfs://nameservice1
>         at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:657)
>         at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:194)
>         at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:106)
>         at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1215)
>         at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1211)
>         at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
>         at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1211)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1412)
>         at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:499)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:351)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:341)
>         at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1949)
>         at org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.uploadToHDFS(SparkUtilities.java:86)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message