Return-Path: X-Original-To: apmail-drill-dev-archive@www.apache.org Delivered-To: apmail-drill-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F0A8318D7F for ; Fri, 1 May 2015 00:16:44 +0000 (UTC) Received: (qmail 16454 invoked by uid 500); 1 May 2015 00:16:44 -0000 Delivered-To: apmail-drill-dev-archive@drill.apache.org Received: (qmail 16403 invoked by uid 500); 1 May 2015 00:16:44 -0000 Mailing-List: contact dev-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list dev@drill.apache.org Received: (qmail 16387 invoked by uid 99); 1 May 2015 00:16:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 May 2015 00:16:44 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: message received from 54.191.145.13 which is an MX secondary for dev@drill.apache.org) Received: from [54.191.145.13] (HELO mx1-us-west.apache.org) (54.191.145.13) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 May 2015 00:16:39 +0000 Received: from mail-ie0-f177.google.com (mail-ie0-f177.google.com [209.85.223.177]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 6596C262C1 for ; Fri, 1 May 2015 00:16:19 +0000 (UTC) Received: by iejt8 with SMTP id t8so80423291iej.2 for ; Thu, 30 Apr 2015 17:16:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=HxbkCZ3Euz/E5zRRJHAv5pMOnJADIufNab1cp2QnxiI=; b=xnEKEB8SW/Iozck6jCsSY+4XcsqhUePigb7SLRBMY/dWTJSWHh0UqphmgD3Zn0Axnl Mf5r+zoIT7n7PsTqGq6MNJoHtBWxKRdbtX3bidNPcQwCHJ4MIazrCX2fhJrsdgbN4tNr /I7MNel1GQ2wS0cv7rg1sVP/YAi+pS5ZIiApiNlNFdDUnoZ+mBKqM9Rf8DL9ScUclhbQ NmRwILpEaYtvLFtyf2CVc8SOkNjpD0bZ+92oKZwuOOPge0kpL6seZbBRA3yw3FAT4Fr0 ZTvkRQmpZAYu+r+E5dXPl3WEx0GGB0y6eeiJ3UpBevGLoGRnVDsfg42xqlohfuYdKSxG 8NGQ== MIME-Version: 1.0 X-Received: by 10.50.30.138 with SMTP id s10mr7107487igh.3.1430439378885; Thu, 30 Apr 2015 17:16:18 -0700 (PDT) Received: by 10.50.154.132 with HTTP; Thu, 30 Apr 2015 17:16:18 -0700 (PDT) In-Reply-To: References: <9810E406-FAD2-4FC9-817D-CF2EA4C25F44@gmail.com> Date: Thu, 30 Apr 2015 17:16:18 -0700 Message-ID: Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1) From: Alexander Zarei To: dev@drill.apache.org Content-Type: multipart/alternative; boundary=047d7bdc9f500d23df0514fa1feb X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc9f500d23df0514fa1feb Content-Type: text/plain; charset=UTF-8 Thanks very much Venki! Your suggestion resolved the issue and worked successfully. Thanks, Alex On Thu, Apr 30, 2015 at 4:02 PM, Venki Korukanti wrote: > It looks like your existing storage plugin config has MapRDB as one of the > supported format plugin, but it can't find the implementation in your > current Drill installation. The .tar.gz file you got/built from apache.org > doesn't have the MapRDB plugin. > > Two options: > 1. Either remove the plugin info from storage conf (may need to modify the > files manually) or > 2. Get the jar from your previous installation (look under jars folder - > assuming your prev installation is from a rpm/deb downloaded from mapr.com > ) > (I prefer this option) > > Thanks > Venki > > On Thu, Apr 30, 2015 at 3:50 PM, Alexander Zarei < > alexanderz.simba@gmail.com > > wrote: > > > Thanks Venki. I did and it went ahead one more step but now it cannot > > figure out the maprdb type; Marked below in bold. > > > > I googled it but not much relevant information was found. I wonder if you > > could suggest a direction to look into it. > > > > log4j:WARN No appenders could be found for logger > > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils). > > log4j:WARN Please initialize the log4j system properly. > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for > > more info. > > Exception in thread "main" > > org.apache.drill.exec.exception.DrillbitStartupException: Failure during > > initial startup of Drillbit. > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87) > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66) > > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166) > > *Caused by: java.lang.RuntimeException: > > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve > type > > id 'maprdb' into a subtype of [simple type, class > > org.apache.drill.common.logical.FormatPluginConfig]* > > at [Source: [B@927297a; line: 55, column: 7] (through reference chain: > > > > > org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"]) > > at > > > > > org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197) > > at > > > > > org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168) > > at > > > > > org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132) > > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244) > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84) > > ... 2 more > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not > > resolve type id 'maprdb' into a subtype of [simple type, class > > org.apache.drill.common.logical.FormatPluginConfig] > > at [Source: [B@927297a; line: 55, column: 7] (through reference chain: > > > > > org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"]) > > at > > > > > com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148) > > at > > > > > com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) > > at > > > > > com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) > > at > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:453) > > at > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:311) > > at > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26) > > at > > > > > com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:538) > > at > > > > > com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:106) > > at > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:238) > > at > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151) > > at > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113) > > at > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84) > > at > > > > > com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132) > > at > > > > > com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41) > > at > > > > > com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269) > > at > > > > > com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912) > > at > > > > > org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44) > > at > > > > > org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195) > > > > Thanks, > > Alex > > > > > > On Thu, Apr 30, 2015 at 3:29 PM, Venki Korukanti < > > venki.korukanti@gmail.com> > > wrote: > > > > > MapR specific FileSystem implementation the requires following in JVM > > > options: > > > > > > export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS > > > -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf > > > -Dzookeeper.sasl.client=false " > > > > > > (You can put this in conf/drill-env.sh) > > > > > > Thanks > > > Venki > > > > > > On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei < > > > alexanderz.simba@gmail.com > > > > wrote: > > > > > > > Hi, > > > > > > > > I downloaded a new MapR sandbox; > > > > Stopped the default Drillbit; > > > > Built form source and changed the zookeeper port from the default > 2181 > > to > > > > 5181 like the default drillbit. > > > > > > > > The new Drillbit does not start and throws the following error: > > > > > > > > > > > > > > > > log4j:WARN No appenders could be found for logger > > > > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils). > > > > log4j:WARN Please initialize the log4j system properly. > > > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig > > for > > > > more info. > > > > Exception in thread "main" > > > > org.apache.drill.exec.exception.DrillbitStartupException: Failure > while > > > > initializing values in Drillbit. > > > > at > > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80) > > > > at > > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66) > > > > at > > org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166) > > > > Caused by: > org.apache.drill.common.exceptions.ExecutionSetupException: > > A > > > > System Table provider was either not specified or could not be found > or > > > > instantiated > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60) > > > > at > > > org.apache.drill.exec.server.Drillbit.(Drillbit.java:198) > > > > at > > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78) > > > > ... 2 more > > > > Caused by: java.lang.reflect.InvocationTargetException > > > > at > > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > > > > Method) > > > > at > > > > > > > > > > > > > > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > > > > at > > > > > > > > > > > > > > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > > > > at > > > java.lang.reflect.Constructor.newInstance(Constructor.java:526) > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56) > > > > ... 4 more > > > > Caused by: org.apache.drill.exec.exception.DrillbitStartupException: > > > > Failure while attempting to set up blob store. > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.(ZkPStoreProvider.java:65) > > > > ... 9 more > > > > Caused by: java.io.IOException: failure to login: No LoginModules > > > > configured for hadoop_simple > > > > at > > > > > > > > > > > > > > org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654) > > > > at > > > > > > > > > > > > > > org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606) > > > > at > > > > > > > > > > > > > > org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519) > > > > at > > > > > org.apache.hadoop.fs.FileSystem$Cache$Key.(FileSystem.java:2590) > > > > at > > > > > org.apache.hadoop.fs.FileSystem$Cache$Key.(FileSystem.java:2582) > > > > at > > > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448) > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404) > > > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169) > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.dfs.DrillFileSystem.(DrillFileSystem.java:103) > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.dfs.DrillFileSystem.(DrillFileSystem.java:99) > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85) > > > > at > > > > > > > > > > > > > > org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.(ZkPStoreProvider.java:63) > > > > ... 9 more > > > > Caused by: javax.security.auth.login.LoginException: No LoginModules > > > > configured for hadoop_simple > > > > at > > > > javax.security.auth.login.LoginContext.init(LoginContext.java:272) > > > > at > > > > javax.security.auth.login.LoginContext.(LoginContext.java:389) > > > > at > > > > > > > > > > > > > > org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408) > > > > at > > > > > > > > > > > > > > org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626) > > > > ... 20 more > > > > > > > > > > > > I wonder if I need to change any configuration? > > > > > > > > Thanks, > > > > Alex > > > > > > > > > > > > On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips < > > sphillips@maprtech.com > > > > > > > > wrote: > > > > > > > > > I just committed another fix, and I also included an option to > revert > > > to > > > > > the old assignment code, in case further issues are found. > > > > > > > > > > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau < > jacques@apache.org> > > > > > wrote: > > > > > > > > > > > I just ran across another instance of DRILL-2916. That sinks > this > > > > > release > > > > > > candidate. Steven, can you take another look? > > > > > > > > > > > > > > > > > > > > > > > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning < > > ted.dunning@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > Somebody needs to check signatures an checksums. Also the > NOTICE > > > and > > > > > > > LICENSE files. > > > > > > > > > > > > > > Repeating the tests others have done has some value but > actually > > > > > walking > > > > > > > through the tutorial or intro documentation step by step has > the > > > > virtue > > > > > > of > > > > > > > breaking new ground. > > > > > > > > > > > > > > Sent from my iPhone > > > > > > > > > > > > > > > On Apr 30, 2015, at 11:31, Norris Lee > > wrote: > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > Downloaded source and built on Linux. Ran Hive, HBase, DFS > > > queries > > > > > > > through ODBC. > > > > > > > > > > > > > > > > Norris > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > > From: Jacques Nadeau [mailto:jacques@apache.org] > > > > > > > > Sent: Wednesday, April 29, 2015 10:47 PM > > > > > > > > Cc: dev@drill.apache.org > > > > > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1) > > > > > > > > > > > > > > > > Just to clarify, this incorporates a critical bug *FIX* found > > in > > > > rc0. > > > > > > > > > > > > > > > > :) > > > > > > > > > > > > > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau < > > > > > jacques@apache.org> > > > > > > > wrote: > > > > > > > >> > > > > > > > >> Good evening, > > > > > > > >> > > > > > > > >> I would like to propose the release of Apache Drill, version > > > > 0.9.0. > > > > > > > >> This is the second release candidate (rc1) and incorporates > a > > > > > critical > > > > > > > >> bug found in rc0 (DRILL-2916). > > > > > > > >> > > > > > > > >> This release includes 200 resolved JIRAs [1]. > > > > > > > >> > > > > > > > >> The artifacts are hosted at [2]. > > > > > > > >> > > > > > > > >> The vote will be open for ~72 hours, ending 22:00 Pacific, > May > > > 2, > > > > > 2015 > > > > > > > >> > > > > > > > >> [ ] +1 > > > > > > > >> [ ] +0 > > > > > > > >> [ ] -1 > > > > > > > >> > > > > > > > >> > > > > > > > >> Thank you, > > > > > > > >> Jacques > > > > > > > >> > > > > > > > >> [1] > > > > > > > >> > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881 > > > > > > > >> 3&projectId=12313820 [2] > > > > > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/ > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Steven Phillips > > > > > Software Engineer > > > > > > > > > > mapr.com > > > > > > > > > > > > > > > --047d7bdc9f500d23df0514fa1feb--