reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anupam <anupam...@gmail.com>
Subject Re: issues with latest reef bits
Date Sun, 24 Jan 2016 09:34:43 GMT
Thanks Andrew. I will take a look.

On 23 January 2016 at 10:27, Andrew Chung <afchung90@gmail.com> wrote:
> Anupam, this seems like the change in avro schema for
> AvroYarnJobSubmissionParameters for only allowing literal "NULL" strings.
> Seems like we forgot to change the default value for dfsJobSubmissionFolder
> in AvroYarnJobSubmissionParameters.cs to "NULL".
>
> Thanks,
> Andrew
>
> On Fri, Jan 22, 2016 at 11:00 PM, Markus Weimer <markus@weimo.de> wrote:
>
>> Hi,
>>
>> this could be related to the new client bits that got merged today. Anupam
>> and Andrew can comment on that.
>>
>> Markus
>>
>>
>>
>> On 2016-01-22 18:11, Dhruv Mahajan wrote:
>>
>>> I got the latest reef bits and tried using it to run some application. I
>>> got the following errors and job did not even launch. Any idea?
>>>
>>>
>>>
>>> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information: 0
>>> : 2016-01-22T17:52:20.4140996-08:00 0001
>>>
>>> INFO: Done preparing Driver filesystem layout in
>>>
>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
>>> 2016-01-22T17:52:20.4453525-08:00 0001
>>>
>>> INFO: Launch Java with command: C:\java\bin\java.exe -cp
>>> c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com
>>>
>>>
>>> mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo
>>>
>>>
>>> p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar
>>>
>>>
>>> e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-
>>>
>>> client-0.14.0-SNAPSHOT-shaded.jar
>>> org.apache.reef.bridge.client.YarnJobSubmissionClient
>>> C:\Users\dhrumaha\AppData\Local\Temp\2\ree
>>>
>>> f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
>>> Expected string. Got VALUE_NULL
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at org.apache.avro.io
>>> .JsonDecoder.readString(JsonDecoder.java:227)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at org.apache.avro.io
>>> .JsonDecoder.readString(JsonDecoder.java:214)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>> org.apache.avro.io
>>> .ValidatingDecoder.readString(ValidatingDecoder.java:107)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub
>>>
>>> missionFromCS.java:206)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j
>>>
>>> ava:196)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)
>>>
>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
>>> 2016-01-22T17:52:21.0234992-08:00 0001
>>>
>>> INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP
>>>
>>> 1/22/2016 5:52:21 PM     Time elapsed(s): 2.461
>>>
>>>
>>>
>>> ***** Unexpected failure. Please contact 'tlcsupp' with details *****
>>>
>>> ===== Begin detailed dump =====
>>>
>>> (1) Unexpected exception: File
>>>
>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t
>>>
>>> xt deosn't exist while trying to get tracking Uri,
>>> 'System.ApplicationException'
>>>
>>>     at
>>>
>>> Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
>>> filepath) in c:\Users\dhrumaha\Desktop\projec
>>>
>>>
>>> ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
>>> 42
>>>
>>>     at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
>>> reefClient, String filePath) in c:\Users\dhrumaha\Deskto
>>>
>>>
>>> p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
>>> 60
>>>
>>>     at
>>>
>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
>>> jobSubmission) in c:\Users\dhrumaha\Desktop\
>>>
>>> projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line
>>> 100
>>>
>>>     at
>>> Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org
>>> .Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](
>>>
>>> IMRUJobDefinition jobDefinition) in
>>>
>>> c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli
>>>
>>> ent.cs:line 151
>>>
>>>     at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
>>> c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95
>>>
>>>     at DTLC.RunTLCPlusPlus.MainCore(String args) in
>>> c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62
>>>
>>> ====== End detailed dump =====
>>>
>>>



-- 
Anupam
Bellevue, WA
Ph: +1 (425)-777-5570

Mime
View raw message