hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "john lilley (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-12459) Tez startup dislikes spaces in classpath on Windows
Date Thu, 19 Nov 2015 00:16:10 GMT

     [ https://issues.apache.org/jira/browse/HIVE-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

john lilley updated HIVE-12459:
-------------------------------
    Affects Version/s:     (was: 0.14.0)
                       1.2.1

> Tez startup dislikes spaces in classpath on Windows
> ---------------------------------------------------
>
>                 Key: HIVE-12459
>                 URL: https://issues.apache.org/jira/browse/HIVE-12459
>             Project: Hive
>          Issue Type: Bug
>          Components: Tez
>    Affects Versions: 1.2.1
>            Reporter: john lilley
>            Assignee: Vikram Dixit K
>
> We are seeing an issue that I summarize as “Tez doesn’t like spaces in the classpath”,
but I wanted to check with the group before submitting a JIRA.  This is showing when we try
to access Hive on HDP 2.3 from a Windows client, where we’ve put the client jars in a classpath
that contains spaces.  
> The causing line in our code is:
> 	    state = SessionState.start(hiveConf);
> where SessionState is in org.apache.hadoop.hive.ql.session
> The exception stack is:
> net/redpoint/hiveclient/DMHCatClient.newInstance:java.lang.RuntimeException: java.io.FileNotFoundException:
File file:/C:/Program%20Files/RedPointDM7/hadoop/clusters/hds-cent6/lib/hive-exec-1.2.1.2.3.0.0-2557.jar
does not exist
> Additional message: 
>     org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535)
>     org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:466)
>     net.redpoint.hiveclient.DMHCatClient.<init>(DMHCatClient.java:255)
>     net.redpoint.hiveclient.DMHCatClient.newInstance(DMHCatClient.java:59)
> Caused by: java.io.FileNotFoundException: File file:/C:/Program%20Files/RedPointDM7/hadoop/clusters/hds-cent6/lib/hive-exec-1.2.1.2.3.0.0-2557.jar
does not exist
>     org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:606)
>     org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:819)
>     org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:596)
>     org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
>     org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:140)
>     org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
>     org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
>     org.apache.hadoop.hive.ql.exec.tez.TezSessionState.getSha(TezSessionState.java:356)
>     org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createJarLocalResource(TezSessionState.java:332)
>     org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:151)
>     org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
>     org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532)
>     org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:466)
>     net.redpoint.hiveclient.DMHCatClient.<init>(DMHCatClient.java:255)
>     net.redpoint.hiveclient.DMHCatClient.newInstance(DMHCatClient.java:59)
> It sure looks like something in the client code is turning “C:/Program Files” into
“C:/Program%20Files”.  I am certain that it is not our code, because we otherwise access
all of the jars and Java classes just fine.
> Furthermore, disabling Tez for client-side Hive query in the configuration seems to fix
or avoid the issue:
> theConfiguration.set("hive.execution.engine", "mr");
> The stack trace doesn’t make sense to me, because we use FileSystem all over the place
and it doesn’t run into this problem when accessing HDFS, only when connecting to Hive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message