Return-Path: X-Original-To: apmail-ignite-user-archive@minotaur.apache.org Delivered-To: apmail-ignite-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0A6BB18C92 for ; Wed, 12 Aug 2015 07:07:02 +0000 (UTC) Received: (qmail 74422 invoked by uid 500); 12 Aug 2015 07:07:01 -0000 Delivered-To: apmail-ignite-user-archive@ignite.apache.org Received: (qmail 74383 invoked by uid 500); 12 Aug 2015 07:07:01 -0000 Mailing-List: contact user-help@ignite.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.incubator.apache.org Delivered-To: mailing list user@ignite.incubator.apache.org Received: (qmail 74373 invoked by uid 99); 12 Aug 2015 07:07:01 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Aug 2015 07:07:01 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5FFE61A9D91 for ; Wed, 12 Aug 2015 07:07:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id EjF0sLXx3mlt for ; Wed, 12 Aug 2015 07:06:53 +0000 (UTC) Received: from mail-lb0-f177.google.com (mail-lb0-f177.google.com [209.85.217.177]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 35F3742AAA for ; Wed, 12 Aug 2015 07:06:53 +0000 (UTC) Received: by lbbpu9 with SMTP id pu9so4392802lbb.3 for ; Wed, 12 Aug 2015 00:06:52 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-type :content-transfer-encoding; bh=5aKA5Rv2IMfyeBizSu21o4VIlA/Z2ZIsV/JKhxebjXI=; b=kfWPRIMXLfjkSbZIkX/6LjgrUScOk9jg/e5QazqlR8+FcJJx7RWHN5LwbYJHCek91p LzpnNjrmwwnCjywGWwaRwbAram61MtujpKuGx42473mOz9krV5ALaYahyd1Qd0lHGh8l Eku8GSQWJdDPODlDKVId0F/0Xyz+GL9X7TYOG8fqFhnlX5QXdZxp92lMHXf1oN+q9nB4 3bCos7You0cvloebUgTHW8aswQ/2doLtKDQiY2eN1KIPuQShfSeFXRrWfZ0n0yiFqiTb p8owD0IMzDb6rbDZAlOo9fGkhWJuxVsO/brUshznal6L1DdRPC3ij8JjGtD0OKYCOk0Q 6szQ== X-Gm-Message-State: ALoCoQmv+7e1m87aeoxOuKVzTdBFGpdmeDCu8sl7vdJ0PqjOGGA/YVHxuGCZlSVeT6TOzKC0bX9c X-Received: by 10.112.210.6 with SMTP id mq6mr30805913lbc.83.1439363212125; Wed, 12 Aug 2015 00:06:52 -0700 (PDT) Received: from [10.0.0.2] ([94.72.60.102]) by smtp.googlemail.com with ESMTPSA id u3sm997113laj.31.2015.08.12.00.06.51 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 12 Aug 2015 00:06:51 -0700 (PDT) Subject: Re: Serialization exception on Ignite class To: user@ignite.incubator.apache.org References: <1439313391362-908.post@n6.nabble.com> <55CAEE4F.8040202@gridgain.com> From: Denis Magda Message-ID: <55CAF072.9060200@gridgain.com> Date: Wed, 12 Aug 2015 10:06:26 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.1.0 MIME-Version: 1.0 In-Reply-To: <55CAEE4F.8040202@gridgain.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Hi, Most probably you submit an anonymous class or closure to the Executor. This causes serialization of an enclosing class with all its fields. If this is your case, try to submit a compute task as a static inner class. -- Denis > > On 8/11/2015 8:16 PM, hueb1 wrote: >> I have two nodes, and I'm using Executor to run some compute tasks that run >> code in my proprietary library. I've serialized everything, but am getting >> the following exception. Why would it complain about >> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl? That's >> a class packaged with Ignite and I did not modify it, and I do not have a >> class called C4. >> >> [17:07:14,650][SEVERE][main][GridTaskWorker] Failed to send job request: >> null >> class org.apache.ignite.IgniteCheckedException: Failed to serialize object: >> C4 [] >> at >> org.apache.ignite.marshaller.optimized.OptimizedMarshaller.marshal(OptimizedMarshaller.java:186) >> at >> org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1127) >> at >> org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:540) >> at >> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:432) >> at >> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:108) >> at >> org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:618) >> at >> org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:344) >> at >> org.apache.ignite.internal.processors.closure.GridClosureProcessor.runAsync(GridClosureProcessor.java:195) >> at >> org.apache.ignite.internal.processors.closure.GridClosureProcessor.runAsync(GridClosureProcessor.java:169) >> at >> org.apache.ignite.internal.executor.GridExecutorService.submit(GridExecutorService.java:285) >> at ignite_poc.S3DataProcessor.loadFile(S3DataProcessor.java:123) >> at ignite_poc.S3DataProcessor.process(S3DataProcessor.java:105) >> at ignite_poc.S3DataProcessor.main(S3DataProcessor.java:170) >> Caused by: java.io.NotSerializableException: Must implement >> java.io.Serializable or set OptimizedMarshaller.setRequireSerializable() to >> false (note that performance may degrade if object is not Serializable): >> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl >> at >> org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.write(OptimizedClassDescriptor.java:703) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeObject0(OptimizedObjectOutputStream.java:217) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeFields(OptimizedObjectOutputStream.java:509) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeSerializable(OptimizedObjectOutputStream.java:321) >> at >> org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.write(OptimizedClassDescriptor.java:710) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeObject0(OptimizedObjectOutputStream.java:217) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeFields(OptimizedObjectOutputStream.java:509) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeSerializable(OptimizedObjectOutputStream.java:321) >> at >> org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.write(OptimizedClassDescriptor.java:710) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeObject0(OptimizedObjectOutputStream.java:217) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeObjectOverride(OptimizedObjectOutputStream.java:131) >> at >> java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:343) >> at >> org.apache.ignite.internal.processors.closure.GridClosureProcessor$C4.writeExternal(GridClosureProcessor.java:1810) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeExternalizable(OptimizedObjectOutputStream.java:289) >> at >> org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.write(OptimizedClassDescriptor.java:697) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeObject0(OptimizedObjectOutputStream.java:217) >> at >> org.apache.ignite.marshaller.optimized.OptimizedObjectOutputStream.writeObjectOverride(OptimizedObjectOutputStream.java:131) >> at >> java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:343) >> at >> org.apache.ignite.marshaller.optimized.OptimizedMarshaller.marshal(OptimizedMarshaller.java:181) >> ... 12 more >> >> >> >> >> -- >> View this message in context:http://apache-ignite-users.70518.x6.nabble.com/Serialization-exception-on-Ignite-class-tp908.html >> Sent from the Apache Ignite Users mailing list archive at Nabble.com. >