drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Zarei <alexanderz.si...@gmail.com>
Subject Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
Date Fri, 01 May 2015 00:16:18 GMT
Thanks very much Venki! Your suggestion resolved the issue and worked
successfully.

Thanks,
Alex


On Thu, Apr 30, 2015 at 4:02 PM, Venki Korukanti <venki.korukanti@gmail.com>
wrote:

> It looks like your existing storage plugin config has MapRDB as one of the
> supported format plugin, but it can't find the implementation in your
> current Drill installation. The .tar.gz file you got/built from apache.org
> doesn't have the MapRDB plugin.
>
> Two options:
> 1. Either remove the plugin info from storage conf (may need to modify the
> files manually) or
> 2. Get the jar from your previous installation (look under jars folder -
> assuming your prev installation is from a rpm/deb downloaded from mapr.com
> )
> (I prefer this option)
>
> Thanks
> Venki
>
> On Thu, Apr 30, 2015 at 3:50 PM, Alexander Zarei <
> alexanderz.simba@gmail.com
> > wrote:
>
> > Thanks Venki. I did and it went ahead one more step but now it cannot
> > figure out the maprdb type; Marked below in bold.
> >
> > I googled it but not much relevant information was found. I wonder if you
> > could suggest a direction to look into it.
> >
> > log4j:WARN No appenders could be found for logger
> > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> > more info.
> > Exception in thread "main"
> > org.apache.drill.exec.exception.DrillbitStartupException: Failure during
> > initial startup of Drillbit.
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87)
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> >         at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > *Caused by: java.lang.RuntimeException:
> > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve
> type
> > id 'maprdb' into a subtype of [simple type, class
> > org.apache.drill.common.logical.FormatPluginConfig]*
> >  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
> >
> >
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
> >         at
> >
> >
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197)
> >         at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168)
> >         at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132)
> >         at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244)
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84)
> >         ... 2 more
> > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not
> > resolve type id 'maprdb' into a subtype of [simple type, class
> > org.apache.drill.common.logical.FormatPluginConfig]
> >  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
> >
> >
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
> >         at
> >
> >
> com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148)
> >         at
> >
> >
> com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:453)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:311)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:538)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:106)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:238)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41)
> >         at
> >
> >
> com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269)
> >         at
> >
> >
> com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195)
> >
> > Thanks,
> > Alex
> >
> >
> > On Thu, Apr 30, 2015 at 3:29 PM, Venki Korukanti <
> > venki.korukanti@gmail.com>
> > wrote:
> >
> > > MapR specific FileSystem implementation the requires following in JVM
> > > options:
> > >
> > > export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS
> > > -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf
> > > -Dzookeeper.sasl.client=false "
> > >
> > > (You can put this in conf/drill-env.sh)
> > >
> > > Thanks
> > > Venki
> > >
> > > On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei <
> > > alexanderz.simba@gmail.com
> > > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I downloaded a new MapR sandbox;
> > > > Stopped the default Drillbit;
> > > > Built form source and changed the zookeeper port from the default
> 2181
> > to
> > > > 5181 like the default drillbit.
> > > >
> > > > The new Drillbit does not start and throws the following error:
> > > >
> > > >
> > > >
> > > > log4j:WARN No appenders could be found for logger
> > > > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > > > log4j:WARN Please initialize the log4j system properly.
> > > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> > for
> > > > more info.
> > > > Exception in thread "main"
> > > > org.apache.drill.exec.exception.DrillbitStartupException: Failure
> while
> > > > initializing values in Drillbit.
> > > >         at
> > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
> > > >         at
> > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> > > >         at
> > org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > > > Caused by:
> org.apache.drill.common.exceptions.ExecutionSetupException:
> > A
> > > > System Table provider was either not specified or could not be found
> or
> > > > instantiated
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
> > > >         at
> > > org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
> > > >         at
> > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
> > > >         ... 2 more
> > > > Caused by: java.lang.reflect.InvocationTargetException
> > > >         at
> > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > > Method)
> > > >         at
> > > >
> > > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > >         at
> > > >
> > > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > >         at
> > > java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
> > > >         ... 4 more
> > > > Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
> > > > Failure while attempting to set up blob store.
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
> > > >         ... 9 more
> > > > Caused by: java.io.IOException: failure to login: No LoginModules
> > > > configured for hadoop_simple
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
> > > >         at
> > > >
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
> > > >         at
> > > >
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
> > > >         at
> > > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
> > > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
> > > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
> > > >         ... 9 more
> > > > Caused by: javax.security.auth.login.LoginException: No LoginModules
> > > > configured for hadoop_simple
> > > >         at
> > > > javax.security.auth.login.LoginContext.init(LoginContext.java:272)
> > > >         at
> > > > javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
> > > >         ... 20 more
> > > >
> > > >
> > > > I wonder if I need to change any configuration?
> > > >
> > > > Thanks,
> > > > Alex
> > > >
> > > >
> > > > On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <
> > sphillips@maprtech.com
> > > >
> > > > wrote:
> > > >
> > > > > I just committed another fix, and I also included an option to
> revert
> > > to
> > > > > the old assignment code, in case further issues are found.
> > > > >
> > > > > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <
> jacques@apache.org>
> > > > > wrote:
> > > > >
> > > > > > I just ran across another instance of DRILL-2916.  That sinks
> this
> > > > > release
> > > > > > candidate.  Steven, can you take another look?
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <
> > ted.dunning@gmail.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > Somebody needs to check signatures an checksums.  Also
the
> NOTICE
> > > and
> > > > > > > LICENSE files.
> > > > > > >
> > > > > > > Repeating the tests others have done has some value but
> actually
> > > > > walking
> > > > > > > through the tutorial or intro documentation step by step
has
> the
> > > > virtue
> > > > > > of
> > > > > > > breaking new ground.
> > > > > > >
> > > > > > > Sent from my iPhone
> > > > > > >
> > > > > > > > On Apr 30, 2015, at 11:31, Norris Lee <norrisl@simba.com>
> > wrote:
> > > > > > > >
> > > > > > > > +1 (non-binding)
> > > > > > > >
> > > > > > > > Downloaded source and built on Linux. Ran Hive, HBase,
DFS
> > > queries
> > > > > > > through ODBC.
> > > > > > > >
> > > > > > > > Norris
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > > > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > > > > > Cc: dev@drill.apache.org
> > > > > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > > > > > >
> > > > > > > > Just to clarify, this incorporates a critical bug
*FIX* found
> > in
> > > > rc0.
> > > > > > > >
> > > > > > > > :)
> > > > > > > >
> > > > > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau
<
> > > > > jacques@apache.org>
> > > > > > > wrote:
> > > > > > > >>
> > > > > > > >> Good evening,
> > > > > > > >>
> > > > > > > >> I would like to propose the release of Apache
Drill, version
> > > > 0.9.0.
> > > > > > > >> This is the second release candidate (rc1) and
incorporates
> a
> > > > > critical
> > > > > > > >> bug found in rc0 (DRILL-2916).
> > > > > > > >>
> > > > > > > >> This release includes 200 resolved JIRAs [1].
> > > > > > > >>
> > > > > > > >> The artifacts are hosted at [2].
> > > > > > > >>
> > > > > > > >> The vote will be open for ~72 hours, ending 22:00
Pacific,
> May
> > > 2,
> > > > > 2015
> > > > > > > >>
> > > > > > > >> [ ] +1
> > > > > > > >> [ ] +0
> > > > > > > >> [ ] -1
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> Thank you,
> > > > > > > >> Jacques
> > > > > > > >>
> > > > > > > >> [1]
> > > > > > > >>
> > > > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > > > > > >> 3&projectId=12313820 [2]
> > > > > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >  Steven Phillips
> > > > >  Software Engineer
> > > > >
> > > > >  mapr.com
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message