hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yu Azuryy <azur...@outlook.com>
Subject RE: [VOTE] Apache Hive 0.13.1 Release Candidate 3
Date Thu, 05 Jun 2014 09:14:11 GMT
Hive-0.13.0 works well under both tez and mr.
 
 
> From: azuryyu@outlook.com
> To: dev@hive.apache.org
> Subject: RE: [VOTE] Apache Hive 0.13.1 Release Candidate 3
> Date: Thu, 5 Jun 2014 09:07:41 +0000
> 
> Unfortunately,   I got the same error.
>  
> Hadoop-2.4.0(HA enabled),  Hive-0.13.1-rc3,  tez-0.4
>  
> If I set 'hive.execution.engine' to mr by default, then Hive does work. but if changed
it to 'tez', I got the followig error.
>  
> please look at here for hive and tez configuration:
> http://pastebin.com/hid1AA83
>  
> 
>  
> > From: azuryyu@outlook.com
> > To: dev@hive.apache.org
> > Subject: RE: [VOTE] Apache Hive 0.13.1 Release Candidate 3
> > Date: Thu, 5 Jun 2014 08:27:27 +0000
> > 
> > Ok, I'll try it today. and post back.  
> >  
> > > Date: Thu, 5 Jun 2014 01:20:10 -0700
> > > Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate 3
> > > From: vgumashta@hortonworks.com
> > > To: dev@hive.apache.org
> > > 
> > > Yu,
> > > 
> > > I don't think tez-0.5 has been released yet. Can you try with tez-0.4 (
> > > http://www.apache.org/dyn/closer.cgi/incubator/tez/tez-0.4.0-incubating/)?
> > > 
> > > Thanks,
> > > --Vaibhav
> > > 
> > > 
> > > On Thu, Jun 5, 2014 at 1:16 AM, Yu Azuryy <azuryyu@outlook.com> wrote:
> > > 
> > > > I just changed ConnectionURL and warehouse in hive-site.xml,
> > > >
> > > > As for tez-0.5-snapshot,
> > > >   <property>
> > > >     <name>tez.lib.uris</name>
> > > >      <value>${fs.defaultFS}/data/tez/lib</value>
> > > >   </property>
> > > >   <property>
> > > >     <name>tez.am.resource.memory.mb</name>
> > > >     <value>1280</value>
> > > >   </property>
> > > >
> > > >
> > > > None others.
> > > >
> > > >
> > > > > Date: Wed, 4 Jun 2014 23:28:07 -0700
> > > > > Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate 3
> > > > > From: thejas@hortonworks.com
> > > > > To: dev@hive.apache.org
> > > > >
> > > > > Yu,
> > > > > I am not able to reproduce this issue with hadoop 2.4.0 and tez 0.4
.
> > > > > I tried it with both file system cache enabled and disabled.
> > > > > What are the non default configurations you have on your machine
?
> > > > >
> > > > > Thanks,
> > > > > Thejas
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Jun 4, 2014 at 10:56 PM, Yu Azuryy <azuryyu@outlook.com>
wrote:
> > > > > > Hive-0.13.0 works well in my test cluster.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > -1
> > > > > >
> > > > > > Verified with hadoop-2.4.0 and tez-0.5-snapshot,
> > > > > > Hive cannot start?
> > > > > >
> > > > > > And I also built hive branch-0.13, the same error.
> > > > > >
> > > > > > [test@vm-10-154-** tmp]$ hive
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.input.dir.recursive is deprecated. Instead, use
> > > > mapreduce.input.fileinputformat.input.dir.recursive
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.max.split.size is deprecated. Instead, use
> > > > mapreduce.input.fileinputformat.split.maxsize
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.min.split.size is deprecated. Instead, use
> > > > mapreduce.input.fileinputformat.split.minsize
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.min.split.size.per.node is deprecated. Instead, use
> > > > mapreduce.input.fileinputformat.split.minsize.per.node
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.min.split.size.per.rack is deprecated. Instead, use
> > > > mapreduce.input.fileinputformat.split.minsize.per.rack
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation: mapred.reduce.tasks
> > > > is deprecated. Instead, use mapreduce.job.reduces
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.reduce.tasks.speculative.execution is deprecated. Instead, use
> > > > mapreduce.reduce.speculative
> > > > > > 14/06/05 13:53:45 INFO Configuration.deprecation:
> > > > mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use
> > > > mapreduce.job.committer.setup.cleanup.needed
> > > > > > 14/06/05 13:53:45 WARN conf.HiveConf: DEPRECATED:
> > > > hive.metastore.ds.retry.* no longer has any effect.  Use
> > > > hive.hmshandler.retry.* instead
> > > > > > Logging initialized using configuration in
> > > > jar:file:/letv/hive-0.13.0/lib/hive-common-0.13.1.jar!/hive-log4j.properties
> > > > > > Exception in thread "main" java.lang.RuntimeException:
> > > > java.io.IOException: Filesystem closed
> > > > > >  at
> > > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:357)
> > > > > >  at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
> > > > > >  at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> > > > > >  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > > >  at
> > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > > > > >  at
> > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > > >  at java.lang.reflect.Method.invoke(Method.java:606)
> > > > > >  at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> > > > > > Caused by: java.io.IOException: Filesystem closed
> > > > > >  at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:727)
> > > > > >  at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1780)
> > > > > >  at
> > > > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1066)
> > > > > >  at
> > > > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1062)
> > > > > >  at
> > > > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> > > > > >  at
> > > > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1062)
> > > > > >  at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398)
> > > > > >  at org.apache.hadoop.fs.FileSystem.deleteOnExit(FileSystem.java:1353)
> > > > > >  at
> > > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createTezDir(TezSessionState.java:297)
> > > > > >  at
> > > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:144)
> > > > > >  at
> > > > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:123)
> > > > > >  at
> > > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:355)
> > > > > >  ... 7 more
> > > > > >
> > > > > >> Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate
3
> > > > > >> From: hbutani@hortonworks.com
> > > > > >> Date: Wed, 4 Jun 2014 22:42:32 -0700
> > > > > >> To: dev@hive.apache.org
> > > > > >>
> > > > > >> +1
> > > > > >>
> > > > > >> - Verified signature and checksum
> > > > > >> - Checked release notes
> > > > > >> - built source
> > > > > >> - ran a few unit tests
> > > > > >> - ran a few queries in local mode
> > > > > >>
> > > > > >> On Jun 2, 2014, at 7:20 PM, Thejas Nair <thejas@hortonworks.com>
> > > > wrote:
> > > > > >>
> > > > > >> > +1
> > > > > >> >
> > > > > >> > - Verified signatures and checksum of both packages
> > > > > >> > - Checked release notes
> > > > > >> > - Build source package
> > > > > >> > - Ran simple hive queries on newly built package in
local mode
> > > > > >> > - Ran simple queries on package on single node cluster
with both tez
> > > > > >> > and mr as execution engines
> > > > > >> > - Ran unit tests
> > > > > >> >
> > > > > >> >
> > > > > >> > On Mon, Jun 2, 2014 at 1:02 PM, Sushanth Sowmyan <
> > > > khorgath@apache.org> wrote:
> > > > > >> >> Apache Hive 0.13.1 Release Candidate 3 is available
here:
> > > > > >> >>
> > > > > >> >> http://people.apache.org/~khorgath/releases/0.13.1_RC3/artifacts/
> > > > > >> >>
> > > > > >> >> Maven artifacts are available here:
> > > > > >> >>
> > > > > >> >>
> > > > https://repository.apache.org/content/repositories/orgapachehive-1015
> > > > > >> >>
> > > > > >> >> Source tag for RC3 is at:
> > > > > >> >>
> > > > > >> >> http://svn.apache.org/viewvc/hive/tags/release-0.13.1-rc3/
> > > > > >> >>
> > > > > >> >> Voting will remain open for 72 hours.
> > > > > >> >>
> > > > > >> >> Hive PMC Members: Please test and vote.
> > > > > >> >>
> > > > > >> >> Thanks,
> > > > > >> >> -Sushanth
> > > > > >> >
> > > > > >> > --
> > > > > >> > CONFIDENTIALITY NOTICE
> > > > > >> > NOTICE: This message is intended for the use of the
individual or
> > > > entity to
> > > > > >> > which it is addressed and may contain information that
is
> > > > confidential,
> > > > > >> > privileged and exempt from disclosure under applicable
law. If the
> > > > reader
> > > > > >> > of this message is not the intended recipient, you
are hereby
> > > > notified that
> > > > > >> > any printing, copying, dissemination, distribution,
disclosure or
> > > > > >> > forwarding of this communication is strictly prohibited.
If you have
> > > > > >> > received this communication in error, please contact
the sender
> > > > immediately
> > > > > >> > and delete it from your system. Thank You.
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> CONFIDENTIALITY NOTICE
> > > > > >> NOTICE: This message is intended for the use of the individual
or
> > > > entity to
> > > > > >> which it is addressed and may contain information that is
> > > > confidential,
> > > > > >> privileged and exempt from disclosure under applicable law.
If the
> > > > reader
> > > > > >> of this message is not the intended recipient, you are hereby
> > > > notified that
> > > > > >> any printing, copying, dissemination, distribution, disclosure
or
> > > > > >> forwarding of this communication is strictly prohibited.
If you have
> > > > > >> received this communication in error, please contact the
sender
> > > > immediately
> > > > > >> and delete it from your system. Thank You.
> > > > > >
> > > > >
> > > > > --
> > > > > CONFIDENTIALITY NOTICE
> > > > > NOTICE: This message is intended for the use of the individual or
entity
> > > > to
> > > > > which it is addressed and may contain information that is confidential,
> > > > > privileged and exempt from disclosure under applicable law. If the
reader
> > > > > of this message is not the intended recipient, you are hereby notified
> > > > that
> > > > > any printing, copying, dissemination, distribution, disclosure or
> > > > > forwarding of this communication is strictly prohibited. If you have
> > > > > received this communication in error, please contact the sender
> > > > immediately
> > > > > and delete it from your system. Thank You.
> > > >
> > > >
> > > 
> > > -- 
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or entity to

> > > which it is addressed and may contain information that is confidential, 
> > > privileged and exempt from disclosure under applicable law. If the reader 
> > > of this message is not the intended recipient, you are hereby notified that

> > > any printing, copying, dissemination, distribution, disclosure or 
> > > forwarding of this communication is strictly prohibited. If you have 
> > > received this communication in error, please contact the sender immediately

> > > and delete it from your system. Thank You.
> >  		 	   		  
>  		 	   		  
 		 	   		  
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message