Return-Path: X-Original-To: apmail-ambari-dev-archive@www.apache.org Delivered-To: apmail-ambari-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 487A6172C0 for ; Wed, 29 Oct 2014 17:17:34 +0000 (UTC) Received: (qmail 65757 invoked by uid 500); 29 Oct 2014 17:17:34 -0000 Delivered-To: apmail-ambari-dev-archive@ambari.apache.org Received: (qmail 65724 invoked by uid 500); 29 Oct 2014 17:17:34 -0000 Mailing-List: contact dev-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list dev@ambari.apache.org Received: (qmail 65460 invoked by uid 99); 29 Oct 2014 17:17:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Oct 2014 17:17:34 +0000 Date: Wed, 29 Oct 2014 17:17:33 +0000 (UTC) From: "Dmytro Sen (JIRA)" To: dev@ambari.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (AMBARI-8016) Cannot run hive tez query using HDP 2.1 stack MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/AMBARI-8016?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Sen resolved AMBARI-8016. -------------------------------- Resolution: Fixed Committed to trunk and branch-1.7.0 > Cannot run hive tez query using HDP 2.1 stack > --------------------------------------------- > > Key: AMBARI-8016 > URL: https://issues.apache.org/jira/browse/AMBARI-8016 > Project: Ambari > Issue Type: Bug > Components: stacks > Affects Versions: 1.7.0 > Environment: HDP2.1 > Reporter: Dmytro Sen > Assignee: Dmytro Sen > Priority: Critical > Fix For: 1.7.0 > > > [root@c6401 views]# ambari-server --hash > 5e1796a9d8d32eeaa24f13d29b81c437fef5acd8 > 1) Install HDP 2.1 (hdfs, yarn, mr, tez, zk, hive) > 2) set Hive engine to tez > 3) attempt to run hive query, get the error below; > {code} > [root@c6401 yum.repos.d]# su - hive > [hive@c6401 ~]$ cd /tmp > [hive@c6401 tmp]$ wget http://seanlahman.com/files/database/lahman591-csv= .zip > --2014-10-29 01:28:52-- http://seanlahman.com/files/database/lahman591-c= sv.zip > Resolving seanlahman.com... 208.113.136.74 > Connecting to seanlahman.com|208.113.136.74|:80... connected. > HTTP request sent, awaiting response... 200 OK > Length: 8337421 (8.0M) [application/zip] > Saving to: =E2=80=9Clahman591-csv.zip=E2=80=9D > 100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 8,337,421 3.45M/s in= 2.3s =20 > 2014-10-29 01:28:54 (3.45 MB/s) - =E2=80=9Clahman591-csv.zip=E2=80=9D sav= ed [8337421/8337421] > [hive@c6401 tmp]$ unzip lahman591-csv.zip > Archive: lahman591-csv.zip > inflating: Managers.csv =20 > inflating: ManagersHalf.csv =20 > inflating: Pitching.csv =20 > inflating: Salaries.csv =20 > inflating: Schools.csv =20 > inflating: SchoolsPlayers.csv =20 > inflating: Teams.csv =20 > inflating: TeamsFranchises.csv =20 > inflating: TeamsHalf.csv =20 > inflating: AllstarFull.csv =20 > inflating: AwardsManagers.csv =20 > inflating: AwardsPlayers.csv =20 > inflating: AwardsShareManagers.csv =20 > inflating: AwardsSharePlayers.csv =20 > inflating: Batting.csv =20 > inflating: Fielding.csv =20 > inflating: FieldingOF.csv =20 > inflating: readme59.txt =20 > inflating: Master.csv =20 > inflating: FieldingPost.csv =20 > inflating: HallOfFame.csv =20 > inflating: Appearances.csv =20 > inflating: PitchingPost.csv =20 > inflating: BattingPost.csv =20 > inflating: SeriesPost.csv =20 > [hive@c6401 tmp]$ hadoop fs -copyFromLocal Schools.csv /tmp > [hive@c6401 tmp]$ hive > Logging initialized using configuration in file:/etc/hive/conf.dist/hive-= log4j.properties > Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFou= ndException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/= tez > =09at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.j= ava:358) > =09at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) > =09at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:57) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:43) > =09at java.lang.reflect.Method.invoke(Method.java:606) > =09at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.io.FileNotFoundException: File does not exist: hdfs://c64= 01.ambari.apache.org:8020/apps/tez > =09at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedF= ileSystem.java:1128) > =09at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedF= ileSystem.java:1120) > =09at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkR= esolver.java:81) > =09at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(Distribu= tedFileSystem.java:1120) > =09at org.apache.hadoop.fs.FileSystem.resolvePath(FileSystem.java:748) > =09at org.apache.hadoop.hdfs.DistributedFileSystem$15.(DistributedF= ileSystem.java:736) > =09at org.apache.hadoop.hdfs.DistributedFileSystem.listLocatedStatus(Dist= ributedFileSystem.java:727) > =09at org.apache.hadoop.fs.FileSystem.listLocatedStatus(FileSystem.java:1= 662) > =09at org.apache.hadoop.fs.FileSystem$5.(FileSystem.java:1724) > =09at org.apache.hadoop.fs.FileSystem.listFiles(FileSystem.java:1721) > =09at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(Tez= ClientUtils.java:164) > =09at org.apache.tez.client.TezSession.start(TezSession.java:105) > =09at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionS= tate.java:185) > =09at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionS= tate.java:123) > =09at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.j= ava:356) > =09... 7 more > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)