From dev-return-11290-archive-asf-public=cust-asf.ponee.io@samza.apache.org Wed Jan 15 17:41:41 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id BAA9A18065E for ; Wed, 15 Jan 2020 18:41:40 +0100 (CET) Received: (qmail 12504 invoked by uid 500); 15 Jan 2020 17:41:39 -0000 Mailing-List: contact dev-help@samza.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@samza.apache.org Delivered-To: mailing list dev@samza.apache.org Received: (qmail 12492 invoked by uid 99); 15 Jan 2020 17:41:39 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jan 2020 17:41:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 1EB731A3411 for ; Wed, 15 Jan 2020 17:41:38 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.199 X-Spam-Level: X-Spam-Status: No, score=-0.199 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=helixeducation.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id n1aRZ9US9yvX for ; Wed, 15 Jan 2020 17:41:33 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=64.78.52.187; helo=relayvx12c.securemail.intermedia.net; envelope-from=jadams@helixeducation.com; receiver= Received: from relayvx12c.securemail.intermedia.net (relayvx12c.securemail.intermedia.net [64.78.52.187]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 84C2B7DDE8 for ; Wed, 15 Jan 2020 17:41:32 +0000 (UTC) Received: from relayvx12a.securemail.intermedia.net (localhost [127.0.0.1]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id 25AB753F80 for ; Wed, 15 Jan 2020 09:41:25 -0800 (PST) Received: from MBX080-W7-CO-1.exch080.serverpod.net ([10.224.117.200]) by MBX080-W7-CO-1.exch080.serverpod.net ([10.224.117.200]) with mapi id 15.00.1497.000; Wed, 15 Jan 2020 09:41:24 -0800 Received: from MBX080-W7-CO-1.exch080.serverpod.net (10.224.117.200) by MBX080-W7-CO-6.exch080.serverpod.net (10.224.117.210) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 15 Jan 2020 09:41:19 -0800 Received: from MBX080-W4-CO-5.exch080.serverpod.net (unknown [10.224.117.172]) by aesomt-co-1-1.serverpod.net (Postfix) with ESMTP id 2AA2F140039 for ; Wed, 15 Jan 2020 09:41:24 -0800 (PST) Received: from aesoc-co-1-1.serverpod.net (aesoc-co-1-1.serverpod.net [10.224.97.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id D099A53F80 for ; Wed, 15 Jan 2020 09:41:24 -0800 (PST) Received: from relayvx12c.securemail.intermedia.net ([64.78.52.187]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 681 for ; Wed, 15 Jan 2020 09:41:25 -0800 (PST) Date: Wed, 15 Jan 2020 17:41:24 +0000 From: Jeremiah Adams To: "dev@samza.apache.org" Message-ID: <1915055611.757104.1579110085142@emg-ca-1-2.securemail.intermedia.net> Subject: Nullpointer After Upgrade from samza 1.0.0 to 1.3.0 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_000_157911008353328499helixeducationcom_" x-echoworx-msg-id: 8934fe3e-fdb6-4838-ac66-301cdc1a0451 x-echoworx-emg-received: Wed, 15 Jan 2020 09:41:25.092 -0800 x-echoworx-spool-arrive-time: Wed, 15 Jan 2020 09:41:25.075 -0800 x-echoworx-message-code-hashed: 3c80862692bfe2d9e33baa21bbdcdf62c5204304cdd9df16bcda8b42f425d2b2 x-echoworx-action: delivered Thread-Topic: Nullpointer After Upgrade from samza 1.0.0 to 1.3.0 Thread-Index: AQHVy8paPfz0G9lutUqEpPs+eyQ+1g== Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [71.205.82.220] x-source-routing-agent: Processed X-CMAE-Score: 0 X-CMAE-Analysis: v=2.2 cv=T/3OdLCQ c=1 sm=1 tr=0 a=rCHmKhYV7AiI7cP55KUvpw==:117 a=E2s1ylUO3RkA:10 a=Jdjhy38mL1oA:10 a=qpGa4XEkAAAA:8 a=JqEG_dyiAAAA:8 a=3j4BkbkPAAAA:8 a=jU4qhlNgAAAA:8 a=z_agkf8u6qdhU0l6-EwA:9 a=wPNLvfGTeEIA:10 a=lO3UBJ_DdZU9_yNS:21 a=frz4AuCg-hUA:10 a=_W_S_7VecoQA:10 a=qyqkYeNZaJfiT5APyiol:22 Spam-Stopper-Id: 83017d7e-4b9b-4d02-8008-d48bc03800f7 Spam-Stopper-v2: Yes X-Spam-Reasons: {'verdict': 'clean', 'spamcause': 'gggruggvucftvghtrhhoucdtuddrgedugedrtdefgddutdduucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecutddurdegudegrddttddpkffpvffgtffogfffkfetpdggtfgfnhhsuhgsshgtrhhisggvnecuuegrihhlohhuthemuceftddtnecunecujfgurhephffvufhtfffkihgtggesrgdtreertddtudenucfhrhhomheplfgvrhgvmhhirghhucetuggrmhhsuceolfetuggrmhhssehhvghlihigvgguuhgtrghtihhonhdrtghomheqnecuffhomhgrihhnpehsrghmiigrrdhsthhorhgrghgvpdhruhhnlhhoohhprdhruhhnpdhsrghmiigrtghonhhtrghinhgvrhdrrhhunhdpfhhuthhurhgvthgrshhkrdhruhhnpdhthhhrvggrugdrrhhunhdphhgvlhhigigvughutggrthhiohhnrdgtohhmpdhtfihithhtvghrrdgtohhmpdhfrggtvggsohhokhdrtghomhdplhhinhhkvgguihhnrdgtohhmnecukfhppeejuddrvddthedrkedvrddvvddtnecurfgrrhgrmhepihhnvghtpefpohhnvgdpmhgrihhlfhhrohhmpefltegurghmsheshhgvlhhigigvughutggrthhiohhnrdgtohhmpdhrtghpthhtohepuggvvhesshgrmhiirgdrrghprggthhgvrdhorhhgnecuvehluhhsthgvrhfuihiivgeptd', 'internal': ['To="dev@samza.apache.org" ', 'From=Jeremiah Adams '], '-': 'ihhnvghtpefpohhnvgbspbhmrghilhhfrhhomheplfetuggrmhhssehhvghlihigvgguuhgtrghtihhonhdrtghomhbspbhrtghpthhtohepuggvvhesshgrmhiirgdrrghprggthhgvrdhorhhgsbbp', 'elapsed': '19ms'} X-Spam-Category: LEGIT X-AES-Category: LEGIT X-ASF-DKIM-Sig: v=1; a=rsa-sha256; c=relaxed/simple; d=helixeducation.com; s=2019021120035099; t=1579110085; bh=0Oh6bVjPLm3ji/h8mjYYcZNLWWYevTk7hK6Z2UxSIrg=; h=Date:From:To:Subject; b=asEV10evlit/8ZOFJdRW0I8DSJpw1JvAX0+gR6xrnMXhWRHlkuC9BAZNQqwwXONmA 0Zm8bakzQknSFEvb9UMH0aueIf+M/Qq9x/pqxyQ7wDKrWOcLV2303Hgx6flPRGr2VG r4Ci3LQseW4NPUX7DQ3PQ4fHvIGdHS+X7PX1Hnro= --_000_157911008353328499helixeducationcom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I am updating our jobs to use samza 1.3.0. I'm getting a null pointer when = manually committing via taskCoordinator.commit(). Below is the stack trace - can anyone point me in the right direction? Thanks. 2020-01-15 10:33:35 RunLoop [ERROR] Task Partition 0 commit failed java.lang.NullPointerException at scala.collection.mutable.ArrayOps$ofRef$.newBuilder$extension(ArrayO= ps.scala:190) at scala.collection.mutable.ArrayOps$ofRef.newBuilder(ArrayOps.scala:18= 6) at scala.collection.TraversableLike$class.filterImpl(TraversableLike.sc= ala:246) at scala.collection.TraversableLike$class.filter(TraversableLike.scala:= 259) at scala.collection.mutable.ArrayOps$ofRef.filter(ArrayOps.scala:186) at org.apache.samza.storage.TransactionalStateTaskStorageManager$$anonf= un$removeOldCheckpoints$2.apply(TransactionalStateTaskStorageManager.scala:= 94) at org.apache.samza.storage.TransactionalStateTaskStorageManager$$anonf= un$removeOldCheckpoints$2.apply(TransactionalStateTaskStorageManager.scala:= 86) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimiz= ed.scala:33) at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) at org.apache.samza.storage.TransactionalStateTaskStorageManager.remove= OldCheckpoints(TransactionalStateTaskStorageManager.scala:86) at org.apache.samza.container.TaskInstance.commit(TaskInstance.scala:27= 7) at org.apache.samza.container.RunLoop$AsyncTaskWorker$5.run(RunLoop.jav= a:547) at org.apache.samza.container.RunLoop$AsyncTaskWorker.commit(RunLoop.ja= va:566) at org.apache.samza.container.RunLoop$AsyncTaskWorker.run(RunLoop.java:= 432) at org.apache.samza.container.RunLoop$AsyncTaskWorker.access$300(RunLoo= p.java:357) at org.apache.samza.container.RunLoop.runTasks(RunLoop.java:244) at org.apache.samza.container.RunLoop.run(RunLoop.java:176) at org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:7= 68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:5= 11) at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) at java.util.concurrent.FutureTask.run(FutureTask.java) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor= .java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecuto= r.java:624) at java.lang.Thread.run(Thread.java:748) 2020-01-15 10:33:35 RunLoop [ERROR] Caught throwable and stopping run loop java.lang.NullPointerException at scala.collection.mutable.ArrayOps$ofRef$.newBuilder$extension(ArrayO= ps.scala:190) at scala.collection.mutable.ArrayOps$ofRef.newBuilder(ArrayOps.scala:18= 6) at scala.collection.TraversableLike$class.filterImpl(TraversableLike.sc= ala:246) at scala.collection.TraversableLike$class.filter(TraversableLike.scala:= 259) at scala.collection.mutable.ArrayOps$ofRef.filter(ArrayOps.scala:186) at org.apache.samza.storage.TransactionalStateTaskStorageManager$$anonf= un$removeOldCheckpoints$2.apply(TransactionalStateTaskStorageManager.scala:= 94) at org.apache.samza.storage.TransactionalStateTaskStorageManager$$anonf= un$removeOldCheckpoints$2.apply(TransactionalStateTaskStorageManager.scala:= 86) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimiz= ed.scala:33) at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) at org.apache.samza.storage.TransactionalStateTaskStorageManager.remove= OldCheckpoints(TransactionalStateTaskStorageManager.scala:86) at org.apache.samza.container.TaskInstance.commit(TaskInstance.scala:27= 7) at org.apache.samza.container.RunLoop$AsyncTaskWorker$5.run(RunLoop.jav= a:547) at org.apache.samza.container.RunLoop$AsyncTaskWorker.commit(RunLoop.ja= va:566) at org.apache.samza.container.RunLoop$AsyncTaskWorker.run(RunLoop.java:= 432) at org.apache.samza.container.RunLoop$AsyncTaskWorker.access$300(RunLoo= p.java:357) at org.apache.samza.container.RunLoop.runTasks(RunLoop.java:244) at org.apache.samza.container.RunLoop.run(RunLoop.java:176) at org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:7= 68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:5= 11) at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) at java.util.concurrent.FutureTask.run(FutureTask.java) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor= .java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecuto= r.java:624) at java.lang.Thread.run(Thread.java:748) Jeremiah Adams Software Engineer www.helixeducation.com Blog | Twitter | Facebook | LinkedIn= --_000_157911008353328499helixeducationcom_--