giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Storey <storey.j...@gmail.com>
Subject Re: Datanucleus NullPointerException when using HiveGiraphRunner
Date Sat, 26 Oct 2013 21:28:13 GMT
It turns out I had an incorrect URI for the metastore, and it looks like
the datanucleus error was masking the real error. While not quite the same,
I wonder if it's something similar to
http://www.datanucleus.org/servlet/jira/browse/NUCRDBMS-539.


On Thu, Oct 24, 2013 at 5:55 PM, Jeff Storey <storey.jeff@gmail.com> wrote:

> I'm submitting a giraph job that through the HiveGiraphRunner, and the
> mapper fails with the error below from the datanucleus code.
>
> I'm using hadoop 0.23 and hive 0.8 because the giraph-hive code (built
> using the facebook profile) specifies that version. In similar posts, I've
> seen that people suggested that aspectj being on the classpath twice was
> the issue, but I verified that is not the case here.
>
> This error isn't giving me much information - is there anything more I can
> do to diagnose this?
>
> Thanks,
> Jeff
>
> Caused by: javax.jdo.JDOFatalInternalException: Unexpected exception caught.
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
> 	at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1186)
> 	at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803)
> 	at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:698)
> 	at org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:262)
> 	at org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:291)
> 	at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:224)
> 	at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:199)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.hive.metastore.RetryingRawStore.<init>(RetryingRawStore.java:62)
> 	at org.apache.hadoop.hive.metastore.RetryingRawStore.getProxy(RetryingRawStore.java:71)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:413)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:401)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:439)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:325)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.<init>(HiveMetaStore.java:285)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:53)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:58)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4102)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:121)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:104)
> 	at com.facebook.hiveio.common.HiveMetastores.createfromReflection(HiveMetastores.java:146)
> 	at com.facebook.hiveio.common.HiveMetastores.create(HiveMetastores.java:109)
> 	at com.facebook.hiveio.schema.HiveTableSchemas$2.idempotentTask(HiveTableSchemas.java:127)
> 	at com.facebook.hiveio.schema.HiveTableSchemas$2.idempotentTask(HiveTableSchemas.java:124)
> 	at com.facebook.hiveio.common.BackoffRetryTask.run(BackoffRetryTask.java:96)
> 	... 19 more
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at javax.jdo.JDOHelper$16.run(JDOHelper.java:1958)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.jdo.JDOHelper.invoke(JDOHelper.java:1953)
> 	at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1159)
> 	... 44 more
> Caused by: java.lang.NullPointerException
> 	at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(NonManagedPluginRegistry.java:443)
> 	at org.datanucleus.plugin.NonManagedPluginRegistry.registerBundle(NonManagedPluginRegistry.java:355)
> 	at org.datanucleus.plugin.NonManagedPluginRegistry.registerExtensions(NonManagedPluginRegistry.java:215)
> 	at org.datanucleus.plugin.NonManagedPluginRegistry.registerExtensionPoints(NonManagedPluginRegistry.java:156)
> 	at org.datanucleus.plugin.PluginManager.registerExtensionPoints(PluginManager.java:82)
> 	at org.datanucleus.OMFContext.<init>(OMFContext.java:156)
> 	at org.datanucleus.OMFContext.<init>(OMFContext.java:137)
> 	at org.datanucleus.ObjectManagerFactoryImpl.initialiseOMFContext(ObjectManagerFactoryImpl.java:132)
> 	at org.datanucleus.jdo.JDOPersistenceManagerFactory.initialiseProperties(JDOPersistenceManagerFactory.java:363)
> 	at org.datanucleus.jdo.JDOPersistenceManagerFactory.<init>(JDOPersistenceManagerFactory.java:307)
> 	at org.datanucleus.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:255)
> 	at org.datanucleus.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:182)
> 	... 52 more
>
>
>

Mime
View raw message