reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anupam <anupam...@gmail.com>
Subject Re: issues with latest reef bits
Date Mon, 25 Jan 2016 21:41:05 GMT
Just to confirm, I am looking into this will get back with a reply by
EOD 2015-01-25 (PST).

On 24 January 2016 at 01:34, Anupam <anupam128@gmail.com> wrote:
> Thanks Andrew. I will take a look.
>
> On 23 January 2016 at 10:27, Andrew Chung <afchung90@gmail.com> wrote:
>> Anupam, this seems like the change in avro schema for
>> AvroYarnJobSubmissionParameters for only allowing literal "NULL" strings.
>> Seems like we forgot to change the default value for dfsJobSubmissionFolder
>> in AvroYarnJobSubmissionParameters.cs to "NULL".
>>
>> Thanks,
>> Andrew
>>
>> On Fri, Jan 22, 2016 at 11:00 PM, Markus Weimer <markus@weimo.de> wrote:
>>
>>> Hi,
>>>
>>> this could be related to the new client bits that got merged today. Anupam
>>> and Andrew can comment on that.
>>>
>>> Markus
>>>
>>>
>>>
>>> On 2016-01-22 18:11, Dhruv Mahajan wrote:
>>>
>>>> I got the latest reef bits and tried using it to run some application. I
>>>> got the following errors and job did not even launch. Any idea?
>>>>
>>>>
>>>>
>>>> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information:
0
>>>> : 2016-01-22T17:52:20.4140996-08:00 0001
>>>>
>>>> INFO: Done preparing Driver filesystem layout in
>>>>
>>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
>>>> 2016-01-22T17:52:20.4453525-08:00 0001
>>>>
>>>> INFO: Launch Java with command: C:\java\bin\java.exe -cp
>>>> c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com
>>>>
>>>>
>>>> mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo
>>>>
>>>>
>>>> p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar
>>>>
>>>>
>>>> e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-
>>>>
>>>> client-0.14.0-SNAPSHOT-shaded.jar
>>>> org.apache.reef.bridge.client.YarnJobSubmissionClient
>>>> C:\Users\dhrumaha\AppData\Local\Temp\2\ree
>>>>
>>>> f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
>>>> Expected string. Got VALUE_NULL
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at org.apache.avro.io
>>>> .JsonDecoder.readString(JsonDecoder.java:227)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at org.apache.avro.io
>>>> .JsonDecoder.readString(JsonDecoder.java:214)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>> org.apache.avro.io
>>>> .ValidatingDecoder.readString(ValidatingDecoder.java:107)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub
>>>>
>>>> missionFromCS.java:206)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j
>>>>
>>>> ava:196)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)
>>>>
>>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
>>>> 2016-01-22T17:52:21.0234992-08:00 0001
>>>>
>>>> INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP
>>>>
>>>> 1/22/2016 5:52:21 PM     Time elapsed(s): 2.461
>>>>
>>>>
>>>>
>>>> ***** Unexpected failure. Please contact 'tlcsupp' with details *****
>>>>
>>>> ===== Begin detailed dump =====
>>>>
>>>> (1) Unexpected exception: File
>>>>
>>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t
>>>>
>>>> xt deosn't exist while trying to get tracking Uri,
>>>> 'System.ApplicationException'
>>>>
>>>>     at
>>>>
>>>> Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
>>>> filepath) in c:\Users\dhrumaha\Desktop\projec
>>>>
>>>>
>>>> ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
>>>> 42
>>>>
>>>>     at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
>>>> reefClient, String filePath) in c:\Users\dhrumaha\Deskto
>>>>
>>>>
>>>> p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
>>>> 60
>>>>
>>>>     at
>>>>
>>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
>>>> jobSubmission) in c:\Users\dhrumaha\Desktop\
>>>>
>>>> projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line
>>>> 100
>>>>
>>>>     at
>>>> Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org
>>>> .Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](
>>>>
>>>> IMRUJobDefinition jobDefinition) in
>>>>
>>>> c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli
>>>>
>>>> ent.cs:line 151
>>>>
>>>>     at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
>>>> c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95
>>>>
>>>>     at DTLC.RunTLCPlusPlus.MainCore(String args) in
>>>> c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62
>>>>
>>>> ====== End detailed dump =====
>>>>
>>>>
>
>
>
> --
> Anupam
> Bellevue, WA
> Ph: +1 (425)-777-5570



-- 
Anupam
Bellevue, WA
Ph: +1 (425)-777-5570

Mime
View raw message