ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-8016) Cannot run hive tez query using HDP 2.1 stack
Date Wed, 29 Oct 2014 18:38:36 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188767#comment-14188767
] 

Hudson commented on AMBARI-8016:
--------------------------------

SUCCESS: Integrated in Ambari-trunk-Commit-docker #49 (See [https://builds.apache.org/job/Ambari-trunk-Commit-docker/49/])
AMBARI-8016 Cannot run hive tez query using HDP 2.1 stack (dsen) (dsen: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=957077c5c986272db4715b1ea98c2c4bb7fcb917)
* ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py
* ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/install_jars.py
* ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py
* ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py


> Cannot run hive tez query using HDP 2.1 stack
> ---------------------------------------------
>
>                 Key: AMBARI-8016
>                 URL: https://issues.apache.org/jira/browse/AMBARI-8016
>             Project: Ambari
>          Issue Type: Bug
>          Components: stacks
>    Affects Versions: 1.7.0
>         Environment: HDP2.1
>            Reporter: Dmytro Sen
>            Assignee: Dmytro Sen
>            Priority: Critical
>             Fix For: 1.7.0
>
>
> [root@c6401 views]# ambari-server --hash
> 5e1796a9d8d32eeaa24f13d29b81c437fef5acd8
> 1) Install HDP 2.1 (hdfs, yarn, mr, tez, zk, hive)
> 2) set Hive engine to tez
> 3) attempt to run hive query, get the error below;
> {code}
> [root@c6401 yum.repos.d]# su - hive
> [hive@c6401 ~]$ cd /tmp
> [hive@c6401 tmp]$ wget http://seanlahman.com/files/database/lahman591-csv.zip
> --2014-10-29 01:28:52--  http://seanlahman.com/files/database/lahman591-csv.zip
> Resolving seanlahman.com... 208.113.136.74
> Connecting to seanlahman.com|208.113.136.74|:80... connected.
> HTTP request sent, awaiting response... 200 OK
> Length: 8337421 (8.0M) [application/zip]
> Saving to: “lahman591-csv.zip”
> 100%[======================================>] 8,337,421   3.45M/s   in 2.3s    
> 2014-10-29 01:28:54 (3.45 MB/s) - “lahman591-csv.zip” saved [8337421/8337421]
> [hive@c6401 tmp]$ unzip lahman591-csv.zip
> Archive:  lahman591-csv.zip
>   inflating: Managers.csv            
>   inflating: ManagersHalf.csv        
>   inflating: Pitching.csv            
>   inflating: Salaries.csv            
>   inflating: Schools.csv             
>   inflating: SchoolsPlayers.csv      
>   inflating: Teams.csv               
>   inflating: TeamsFranchises.csv     
>   inflating: TeamsHalf.csv           
>   inflating: AllstarFull.csv         
>   inflating: AwardsManagers.csv      
>   inflating: AwardsPlayers.csv       
>   inflating: AwardsShareManagers.csv  
>   inflating: AwardsSharePlayers.csv  
>   inflating: Batting.csv             
>   inflating: Fielding.csv            
>   inflating: FieldingOF.csv          
>   inflating: readme59.txt            
>   inflating: Master.csv              
>   inflating: FieldingPost.csv        
>   inflating: HallOfFame.csv          
>   inflating: Appearances.csv         
>   inflating: PitchingPost.csv        
>   inflating: BattingPost.csv         
>   inflating: SeriesPost.csv          
> [hive@c6401 tmp]$ hadoop fs -copyFromLocal Schools.csv /tmp
> [hive@c6401 tmp]$ hive
> Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties
> Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException:
File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:358)
> 	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> Caused by: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
> 	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1120)
> 	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1120)
> 	at org.apache.hadoop.fs.FileSystem.resolvePath(FileSystem.java:748)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem$15.<init>(DistributedFileSystem.java:736)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.listLocatedStatus(DistributedFileSystem.java:727)
> 	at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1662)
> 	at org.apache.hadoop.fs.FileSystem$5.<init>(FileSystem.java:1724)
> 	at org.apache.hadoop.fs.FileSystem.listFiles(FileSystem.java:1721)
> 	at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:164)
> 	at org.apache.tez.client.TezSession.start(TezSession.java:105)
> 	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:185)
> 	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:123)
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:356)
> 	... 7 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message