ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Sen" <d...@hortonworks.com>
Subject Review Request 27328: Cannot run hive tez query using HDP 2.1 stack
Date Wed, 29 Oct 2014 13:52:27 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27328/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, and Mahadev Konar.


Bugs: AMBARI-8016
    https://issues.apache.org/jira/browse/AMBARI-8016


Repository: ambari


Description
-------

[root@c6401 views]# ambari-server --hash
5e1796a9d8d32eeaa24f13d29b81c437fef5acd8
1) Install HDP 2.1 (hdfs, yarn, mr, tez, zk, hive)
2) set Hive engine to tez
3) attempt to run hive query, get the error below;
[root@c6401 yum.repos.d]# su - hive
[hive@c6401 ~]$ cd /tmp
[hive@c6401 tmp]$ wget http://seanlahman.com/files/database/lahman591-csv.zip
--2014-10-29 01:28:52--  http://seanlahman.com/files/database/lahman591-csv.zip
Resolving seanlahman.com... 208.113.136.74
Connecting to seanlahman.com|208.113.136.74|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8337421 (8.0M) [application/zip]
Saving to: “lahman591-csv.zip”

100%[======================================>] 8,337,421   3.45M/s   in 2.3s    

2014-10-29 01:28:54 (3.45 MB/s) - “lahman591-csv.zip” saved [8337421/8337421]

[hive@c6401 tmp]$ unzip lahman591-csv.zip
Archive:  lahman591-csv.zip
  inflating: Managers.csv            
  inflating: ManagersHalf.csv        
  inflating: Pitching.csv            
  inflating: Salaries.csv            
  inflating: Schools.csv             
  inflating: SchoolsPlayers.csv      
  inflating: Teams.csv               
  inflating: TeamsFranchises.csv     
  inflating: TeamsHalf.csv           
  inflating: AllstarFull.csv         
  inflating: AwardsManagers.csv      
  inflating: AwardsPlayers.csv       
  inflating: AwardsShareManagers.csv  
  inflating: AwardsSharePlayers.csv  
  inflating: Batting.csv             
  inflating: Fielding.csv            
  inflating: FieldingOF.csv          
  inflating: readme59.txt            
  inflating: Master.csv              
  inflating: FieldingPost.csv        
  inflating: HallOfFame.csv          
  inflating: Appearances.csv         
  inflating: PitchingPost.csv        
  inflating: BattingPost.csv         
  inflating: SeriesPost.csv          
[hive@c6401 tmp]$ hadoop fs -copyFromLocal Schools.csv /tmp
[hive@c6401 tmp]$ hive

Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: File
does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:358)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
	at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py
4e55cfb 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/install_jars.py
PRE-CREATION 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py
2bfbdc1 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 0abc438 

Diff: https://reviews.apache.org/r/27328/diff/


Testing
-------

manual deployment

+

Ran 242 tests in 3.754s

OK
----------------------------------------------------------------------
Total run:679
Total errors:0
Total failures:0
OK


Thanks,

Dmytro Sen


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message