Return-Path: X-Original-To: apmail-reef-dev-archive@minotaur.apache.org Delivered-To: apmail-reef-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0CFF419635 for ; Tue, 12 Apr 2016 23:23:18 +0000 (UTC) Received: (qmail 82323 invoked by uid 500); 12 Apr 2016 23:23:18 -0000 Delivered-To: apmail-reef-dev-archive@reef.apache.org Received: (qmail 82293 invoked by uid 500); 12 Apr 2016 23:23:18 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 82281 invoked by uid 99); 12 Apr 2016 23:23:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Apr 2016 23:23:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 469E2C0227 for ; Tue, 12 Apr 2016 23:23:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id PfbyhR_4slLX for ; Tue, 12 Apr 2016 23:23:14 +0000 (UTC) Received: from mail-yw0-f176.google.com (mail-yw0-f176.google.com [209.85.161.176]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id B0C1C5F46D for ; Tue, 12 Apr 2016 23:23:13 +0000 (UTC) Received: by mail-yw0-f176.google.com with SMTP id d68so46256357ywe.1 for ; Tue, 12 Apr 2016 16:23:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=VEQoYqyFv+Jim8ZUYwky92gQ01AlsrSPgwibuQ4fVIs=; b=ljiOZ4VnKmYybkXPEk4Jmq15u2fBL1SsXYl7bE4iGyBkWqDs+o1aKO0nyjs3ybo2Kf AiW09X8LKmW3EwBg18YzgDAhlLaDbC4fSYO30XH5Xx2VVVVgEHBqXXbx4uolFqpsPl6b +YHUkAvA75xG3d1BTl/8eUg7SvdHBk8bXlt85yP4QQ3f3IoLD+Ly96lNtZXv/UAkHcfX n4AKV1qe7F7LZN8yFulnlJLp2d8+LQQh/xJYJEp6RimCP5Zch4QBc1gPLBO/grtUgEQ1 fkxT1c9w7y1nzGxfsBR2EbSI83qedBikn6j2AY3kg63fmMPdSSnK51U6Ogs24GzvXw0p nQug== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=VEQoYqyFv+Jim8ZUYwky92gQ01AlsrSPgwibuQ4fVIs=; b=Cru2GT+VBD4Ln2Y36pbofceYrCyqGh/sYRXIisymavi4EjbBsftQKa06v/ZcbB6VMU Ech2/eUtR6zvpywtkefFNencJJ9LHsT4uEt28dOAEITUKnwSFCOhOM44XKmY6chpQbQh QsuiKz+XPuu7xlU+3MhrE+Yvlee4hw4utsZ6okRnB/7TdNOb71ZBDdM0SnMY5ERd4bki 0P8BH2xLiwTirM2ukCU9nFjjVDrvKWouA97LQW37shEZNPBH9OkGX4Y+6TQT0HC6KnMZ uDQ0OTQoLffyxyWT2nC3iMn/KS2MIUnXwsjWWUnGuxNK01rh6kfQrIQZ/WnYFMQSqztN g1Xg== X-Gm-Message-State: AOPr4FXbGH2yX2LDYX1fOMco+Ind+PulRNfKfb2OKkwojddX0J8iIOGm6yK8BPAwZgbiH+pTzlnLka9autJ4BQ== MIME-Version: 1.0 X-Received: by 10.37.230.212 with SMTP id d203mr3163421ybh.139.1460503387501; Tue, 12 Apr 2016 16:23:07 -0700 (PDT) Received: by 10.37.208.9 with HTTP; Tue, 12 Apr 2016 16:23:07 -0700 (PDT) In-Reply-To: References: Date: Tue, 12 Apr 2016 16:23:07 -0700 Message-ID: Subject: Re: Issues with running on yarn From: Dhruv Mahajan To: dev@reef.apache.org Content-Type: multipart/alternative; boundary=94eb2c0a79ca9afc97053051f163 --94eb2c0a79ca9afc97053051f163 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Got same errors om local runtime too. On Tue, Apr 12, 2016 at 4:20 PM, Dhruv Mahajan wrote: > Hi > > I just did merge with master and I got errors in driver. I am attaching > the errors. I had updated branch 1-2 days ago and it was all fine. I am > attaching stderr and stdout logs below. > > stdout: > > START: EvaluatorRequestorClr2Java::GetDefinedRuntimes > jmidGetDefinedRuntimes is NULL > InteropUtil Error: 0 : 2016-04-12T16:09:14.7757809-07:00 0001 > ERROR: Exceptions in Java_org_apache_reef_javabridge_NativeInterop_callCl= rSystemOnStartHandlerencountered error [System.ArgumentNullException: Buffe= r cannot be null. > Parameter name: buffer > at System.IO.MemoryStream..ctor(Byte[] buffer, Boolean writable) > at Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBy= tes(Byte[] serializedData) > at Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEval= uatorRequestorClr2Java clr2Java) > at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSyste= mStartHandler_OnStart(DateTime startTime, String httpServerPort, IEvaluator= RequestorClr2Java evaluatorRequestorClr2Java) > at Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartH= andler(JNIEnv_* env, _jclass* jclassx, _jstring* dateTimeString, _jstring* = httpServerPort, _jobject* jbridgeHandlerManager, _jobject* jevaluatorReques= torBridge)] with mesage [Buffer cannot be null. > Parameter name: buffer] and stack trace [ at System.IO.MemoryStream..ct= or(Byte[] buffer, Boolean writable) > at Org.Apache.REEF.Driver.Bridge.Avro.DefinedRuntimesSerializer.FromBy= tes(Byte[] serializedData) > at Org.Apache.REEF.Driver.Bridge.Events.EvaluatorRequestor..ctor(IEval= uatorRequestorClr2Java clr2Java) > at Org.Apache.REEF.Driver.Bridge.ClrSystemHandlerWrapper.Call_ClrSyste= mStartHandler_OnStart(DateTime startTime, String httpServerPort, IEvaluator= RequestorClr2Java evaluatorRequestorClr2Java) > at Java_org_apache_reef_javabridge_NativeInterop_callClrSystemOnStartH= andler(JNIEnv_* env, _jclass* jclassx, _jstring* dateTimeString, _jstring* = httpServerPort, _jobject* jbridgeHandlerManager, _jobject* jevaluatorReques= torBridge)] > > > stderr: > > INFO: Clock.close() > Apr 12, 2016 4:09:14 PM org.apache.reef.runtime.common.launch.REEFErrorHa= ndler onNext > SEVERE: Uncaught exception. > java.lang.NoSuchMethodError: getDefinedRuntimes > at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(= Native Method) > at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.= getClrHandlers(DriverStartClrHandlersInitializer.java:47) > at org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.ja= va:196) > at org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.ja= va:66) > at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobD= river.java:583) > at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobD= river.java:577) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(Driv= erStartHandler.java:93) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(Drive= rStartHandler.java:71) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(Drive= rStartHandler.java:40) > at org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandle= r.java:98) > at org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:= 217) > at org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:17= 5) > at org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(YarnBoot= strapREEFLauncher.java:65) > > Apr 12, 2016 4:09:14 PM org.apache.reef.runtime.common.launch.REEFErrorHa= ndler onNext > SEVERE: Caught an exception from Wake we cannot send upstream because the= re is no upstream > Apr 12, 2016 4:09:14 PM org.apache.reef.runtime.common.REEFLauncher fatal > SEVERE: Unable to instantiate the clock > java.lang.NoSuchMethodError: getDefinedRuntimes > at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(= Native Method) > at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.= getClrHandlers(DriverStartClrHandlersInitializer.java:47) > at org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.ja= va:196) > at org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.ja= va:66) > at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobD= river.java:583) > at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobD= river.java:577) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(Driv= erStartHandler.java:93) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(Drive= rStartHandler.java:71) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(Drive= rStartHandler.java:40) > at org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandle= r.java:98) > at org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:= 217) > at org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:17= 5) > at org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(YarnBoot= strapREEFLauncher.java:65) > > java.lang.RuntimeException: Unable to instantiate the clock > at org.apache.reef.runtime.common.REEFLauncher.fatal(REEFLauncher.java:1= 20) > at org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:17= 9) > at org.apache.reef.bridge.client.YarnBootstrapREEFLauncher.main(YarnBoot= strapREEFLauncher.java:65) > Caused by: java.lang.NoSuchMethodError: getDefinedRuntimes > at org.apache.reef.javabridge.NativeInterop.callClrSystemOnStartHandler(= Native Method) > at org.apache.reef.javabridge.generic.DriverStartClrHandlersInitializer.= getClrHandlers(DriverStartClrHandlersInitializer.java:47) > at org.apache.reef.javabridge.generic.JobDriver.setupBridge(JobDriver.ja= va:196) > at org.apache.reef.javabridge.generic.JobDriver.access$1500(JobDriver.ja= va:66) > at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobD= river.java:583) > at org.apache.reef.javabridge.generic.JobDriver$StartHandler.onNext(JobD= river.java:577) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onStart(Driv= erStartHandler.java:93) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(Drive= rStartHandler.java:71) > at org.apache.reef.runtime.common.driver.DriverStartHandler.onNext(Drive= rStartHandler.java:40) > at org.apache.reef.wake.impl.PubSubEventHandler.onNext(PubSubEventHandle= r.java:98) > at org.apache.reef.wake.time.runtime.RuntimeClock.run(RuntimeClock.java:= 217) > at org.apache.reef.runtime.common.REEFLauncher.main(REEFLauncher.java:17= 5) > ... 1 more > > > Thanks > Dhruv > --94eb2c0a79ca9afc97053051f163--