drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Venki Korukanti <venki.koruka...@gmail.com>
Subject Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
Date Thu, 30 Apr 2015 23:02:52 GMT
It looks like your existing storage plugin config has MapRDB as one of the
supported format plugin, but it can't find the implementation in your
current Drill installation. The .tar.gz file you got/built from apache.org
doesn't have the MapRDB plugin.

Two options:
1. Either remove the plugin info from storage conf (may need to modify the
files manually) or
2. Get the jar from your previous installation (look under jars folder -
assuming your prev installation is from a rpm/deb downloaded from mapr.com)
(I prefer this option)

Thanks
Venki

On Thu, Apr 30, 2015 at 3:50 PM, Alexander Zarei <alexanderz.simba@gmail.com
> wrote:

> Thanks Venki. I did and it went ahead one more step but now it cannot
> figure out the maprdb type; Marked below in bold.
>
> I googled it but not much relevant information was found. I wonder if you
> could suggest a direction to look into it.
>
> log4j:WARN No appenders could be found for logger
> (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> Exception in thread "main"
> org.apache.drill.exec.exception.DrillbitStartupException: Failure during
> initial startup of Drillbit.
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87)
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
>         at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> *Caused by: java.lang.RuntimeException:
> com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type
> id 'maprdb' into a subtype of [simple type, class
> org.apache.drill.common.logical.FormatPluginConfig]*
>  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
>
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
>         at
>
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197)
>         at
>
> org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168)
>         at
>
> org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132)
>         at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244)
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84)
>         ... 2 more
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not
> resolve type id 'maprdb' into a subtype of [simple type, class
> org.apache.drill.common.logical.FormatPluginConfig]
>  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
>
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
>         at
>
> com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148)
>         at
>
> com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
>         at
>
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
>         at
>
> com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:453)
>         at
>
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:311)
>         at
>
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
>         at
>
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:538)
>         at
>
> com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:106)
>         at
>
> com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:238)
>         at
>
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151)
>         at
>
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
>         at
>
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
>         at
>
> com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41)
>         at
>
> com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269)
>         at
>
> com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912)
>         at
>
> org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
>         at
>
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195)
>
> Thanks,
> Alex
>
>
> On Thu, Apr 30, 2015 at 3:29 PM, Venki Korukanti <
> venki.korukanti@gmail.com>
> wrote:
>
> > MapR specific FileSystem implementation the requires following in JVM
> > options:
> >
> > export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS
> > -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf
> > -Dzookeeper.sasl.client=false "
> >
> > (You can put this in conf/drill-env.sh)
> >
> > Thanks
> > Venki
> >
> > On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei <
> > alexanderz.simba@gmail.com
> > > wrote:
> >
> > > Hi,
> > >
> > > I downloaded a new MapR sandbox;
> > > Stopped the default Drillbit;
> > > Built form source and changed the zookeeper port from the default 2181
> to
> > > 5181 like the default drillbit.
> > >
> > > The new Drillbit does not start and throws the following error:
> > >
> > >
> > >
> > > log4j:WARN No appenders could be found for logger
> > > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > > log4j:WARN Please initialize the log4j system properly.
> > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for
> > > more info.
> > > Exception in thread "main"
> > > org.apache.drill.exec.exception.DrillbitStartupException: Failure while
> > > initializing values in Drillbit.
> > >         at
> org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
> > >         at
> org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> > >         at
> org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > > Caused by: org.apache.drill.common.exceptions.ExecutionSetupException:
> A
> > > System Table provider was either not specified or could not be found or
> > > instantiated
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
> > >         at
> > org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
> > >         at
> org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
> > >         ... 2 more
> > > Caused by: java.lang.reflect.InvocationTargetException
> > >         at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > Method)
> > >         at
> > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > >         at
> > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > >         at
> > java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
> > >         ... 4 more
> > > Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
> > > Failure while attempting to set up blob store.
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
> > >         ... 9 more
> > > Caused by: java.io.IOException: failure to login: No LoginModules
> > > configured for hadoop_simple
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
> > >         at
> > > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
> > >         at
> > > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
> > >         at
> > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
> > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
> > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
> > >         ... 9 more
> > > Caused by: javax.security.auth.login.LoginException: No LoginModules
> > > configured for hadoop_simple
> > >         at
> > > javax.security.auth.login.LoginContext.init(LoginContext.java:272)
> > >         at
> > > javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
> > >         ... 20 more
> > >
> > >
> > > I wonder if I need to change any configuration?
> > >
> > > Thanks,
> > > Alex
> > >
> > >
> > > On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <
> sphillips@maprtech.com
> > >
> > > wrote:
> > >
> > > > I just committed another fix, and I also included an option to revert
> > to
> > > > the old assignment code, in case further issues are found.
> > > >
> > > > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <jacques@apache.org>
> > > > wrote:
> > > >
> > > > > I just ran across another instance of DRILL-2916.  That sinks this
> > > > release
> > > > > candidate.  Steven, can you take another look?
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <
> ted.dunning@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > Somebody needs to check signatures an checksums.  Also the NOTICE
> > and
> > > > > > LICENSE files.
> > > > > >
> > > > > > Repeating the tests others have done has some value but actually
> > > > walking
> > > > > > through the tutorial or intro documentation step by step has
the
> > > virtue
> > > > > of
> > > > > > breaking new ground.
> > > > > >
> > > > > > Sent from my iPhone
> > > > > >
> > > > > > > On Apr 30, 2015, at 11:31, Norris Lee <norrisl@simba.com>
> wrote:
> > > > > > >
> > > > > > > +1 (non-binding)
> > > > > > >
> > > > > > > Downloaded source and built on Linux. Ran Hive, HBase,
DFS
> > queries
> > > > > > through ODBC.
> > > > > > >
> > > > > > > Norris
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > > > > Cc: dev@drill.apache.org
> > > > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > > > > >
> > > > > > > Just to clarify, this incorporates a critical bug *FIX*
found
> in
> > > rc0.
> > > > > > >
> > > > > > > :)
> > > > > > >
> > > > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau <
> > > > jacques@apache.org>
> > > > > > wrote:
> > > > > > >>
> > > > > > >> Good evening,
> > > > > > >>
> > > > > > >> I would like to propose the release of Apache Drill,
version
> > > 0.9.0.
> > > > > > >> This is the second release candidate (rc1) and incorporates
a
> > > > critical
> > > > > > >> bug found in rc0 (DRILL-2916).
> > > > > > >>
> > > > > > >> This release includes 200 resolved JIRAs [1].
> > > > > > >>
> > > > > > >> The artifacts are hosted at [2].
> > > > > > >>
> > > > > > >> The vote will be open for ~72 hours, ending 22:00 Pacific,
May
> > 2,
> > > > 2015
> > > > > > >>
> > > > > > >> [ ] +1
> > > > > > >> [ ] +0
> > > > > > >> [ ] -1
> > > > > > >>
> > > > > > >>
> > > > > > >> Thank you,
> > > > > > >> Jacques
> > > > > > >>
> > > > > > >> [1]
> > > > > > >>
> > > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > > > > >> 3&projectId=12313820 [2]
> > > > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >  Steven Phillips
> > > >  Software Engineer
> > > >
> > > >  mapr.com
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message