reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrey Meleshko <andr...@microsoft.com>
Subject IMRU: Validating IMRU configuration: input vs map function configuraiton
Date Wed, 06 Jul 2016 17:30:33 GMT
While playing with IMRU tests locally, I misconfigured (intentionally) input data set partition
to have different type from MapFunction constructor parameter.

Input Data configuration : IInputPartition<string[]>
MapFunction configuration: MapFunction(IInputPartition<Stream> dataPartition)

As expected, I got an exception at runtime from OnNext(AllocatedEvaluator) - stack trace below.
But this error could probably be prevented by validation of provided configuration.
Should there be validation of IMRU Application before starting the execution?
If yes, which component should be responsible for it? ConfigBuilder?



Error stack trace

Jul 06, 2016 9:31:46 AM org.apache.reef.javabridge.NativeBridge onError
SEVERE: Bridge received error from CLR: Exception in Call_clrSystemAllocatedEvaluatorHandler_OnNext:
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Org.Apache.REEF.Utilities.Diagnostics.Exceptions.Throw(Exception exception, String message,
Logger logger)
   at Org.Apache.REEF.Utilities.Diagnostics.Exceptions.Throw(Exception exception, Logger logger)
   at Org.Apache.REEF.Tang.Implementations.Configuration.ConfigurationBuilderImpl.BindImplementation(IClassNode
n, IClassNode m)
   at Org.Apache.REEF.Tang.Implementations.Configuration.CsConfigurationBuilderImpl.BindImplementation(Type
iface, Type impl)
   at Org.Apache.REEF.Tests.Functional.IMRU.IMRU_NGramCountTest.RandomDocumentInput.RandomDocumentPartitionDescriptor.GetPartitionConfiguration()
   at Org.Apache.REEF.IMRU.OnREEF.Driver.ServiceAndContextConfigurationProvider`3.GetDataLoadingContextAndServiceConfiguration(IPartitionDescriptor
partitionDescriptor, String evaluatorId)
   at Org.Apache.REEF.IMRU.OnREEF.Driver.ServiceAndContextConfigurationProvider`3.GetDataLoadingConfigurationForEvaluatorById(String
evaluatorId)
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Org.Apache.REEF.Utilities.Diagnostics.Exceptions.Throw(Exception exception, String message,
Logger logger)
   at Org.Apache.REEF.IMRU.OnREEF.Driver.ServiceAndContextConfigurationProvider`3.GetDataLoadingConfigurationForEvaluatorById(String
evaluatorId)
   at Org.Apache.REEF.IMRU.OnREEF.Driver.IMRUDriver`4.SubmitContextAndService(IAllocatedEvaluator
allocatedEvaluator)
   at Org.Apache.REEF.IMRU.OnREEF.Driver.IMRUDriver`4.OnNext(IAllocatedEvaluator allocatedEvaluator)
   at Org.Apache.REEF.Driver.Bridge.ClrSystemHandler`1.OnNext(T value)
   at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSystemAllocatedEvaluatorHandler_OnNext(UInt64
handle, IAllocatedEvaluatorClr2Java clr2Java)
   at Java_org_apache_reef_javabridge_NativeInterop_clrSystemAllocatedEvaluatorHandlerOnNext(JNIEnv_*
env, _jclass* cls, Int64 handle, _jobject* jallocatedEvaluatorBridge, _jobject* jlogger)
Jul 06, 2016 9:31:46 AM org.apache.reef.javabridge.generic.JobDriver$AllocatedEvaluatorHandler
onNext


Thank you
Andrey

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message