Return-Path: X-Original-To: apmail-avro-dev-archive@www.apache.org Delivered-To: apmail-avro-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AABD7109C5 for ; Thu, 5 Dec 2013 09:04:14 +0000 (UTC) Received: (qmail 57885 invoked by uid 500); 5 Dec 2013 09:04:12 -0000 Delivered-To: apmail-avro-dev-archive@avro.apache.org Received: (qmail 57156 invoked by uid 500); 5 Dec 2013 09:04:07 -0000 Mailing-List: contact dev-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@avro.apache.org Delivered-To: mailing list dev@avro.apache.org Received: (qmail 57140 invoked by uid 99); 5 Dec 2013 09:04:06 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Dec 2013 09:04:06 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FH_FROM_START_YOU,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of houkeny@gmail.com designates 209.85.219.41 as permitted sender) Received: from [209.85.219.41] (HELO mail-oa0-f41.google.com) (209.85.219.41) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Dec 2013 09:04:01 +0000 Received: by mail-oa0-f41.google.com with SMTP id j17so18253331oag.28 for ; Thu, 05 Dec 2013 01:03:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=/ZVP3/KyyWgHrcq7b85bus84VpgeRDqwtHGSvlm3Y58=; b=bcwiaR6/u5Wm1fsnhiIMqeIhiSg3t05xKb5s2Jazt//QGGx+nII1qzJyonPTfbaMZv uCWRte6vaON0Type/UWz5tot87hRsBesYb6+82V/JBTihp5rzF2VOpURSibPDBQp127n wmO4Tq6zSKtBqRIeNoTHbsjEoag1LISHRV41h3XZnCsDCEwqfjCjHwnktZIYAxteUdFC QP9PF4MhIwb+Mpn9kkHSbUd/bLS1NXWmlw2k+VGB2vXraplh3ORxcf6CnqGOvvj0X/GC 4c9Sb8upL3TqUSdxNQRWXUL4IoKQgD6yx5E01/H70wkhABq2ygUllxmJ86i2FgLmDpjS aNhA== MIME-Version: 1.0 X-Received: by 10.182.233.228 with SMTP id tz4mr367335obc.56.1386234220941; Thu, 05 Dec 2013 01:03:40 -0800 (PST) Received: by 10.182.66.196 with HTTP; Thu, 5 Dec 2013 01:03:40 -0800 (PST) Received: by 10.182.66.196 with HTTP; Thu, 5 Dec 2013 01:03:40 -0800 (PST) In-Reply-To: References: Date: Thu, 5 Dec 2013 18:03:40 +0900 Message-ID: Subject: Re: Avro RPC in Apache Flume fails with IBM JDK From: You Hoken To: user@avro.apache.org Cc: dev@avro.apache.org Content-Type: multipart/alternative; boundary=001a11c306005095ad04ecc5ce91 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c306005095ad04ecc5ce91 Content-Type: text/plain; charset=ISO-8859-1 Hi, Does anyone have the same problem? 2013/11/18 1:19 "You Hoken" : > Hi, > > I'm using Avro (1.7.2) RPC in Apache Flume 1.3.1 with the following environment. > > -OS > SUSE Linux Enterprise Server 11 (x86_64) > VERSION = 11 > PATCHLEVEL = 2 > > -IBM JDK > java version "1.6.0" > Java(TM) SE Runtime Environment (build pxi3260sr10fp1-20120321_01(SR10 > FP1)) > IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux x86-32 > jvmxi3260sr10fp1-20120202_101568 (JIT enabled, AOT enabled) > J9VM - 20120202_101568 > JIT - r9_20111107_21307ifx1 > GC - 20120202_AA) > JCL - 20120320_01 > > Avro RPC (AvroSource / AvroSink) is used to collect logs. > > My problem is that Avro RPC fails sometimes... > > in the case of success in Avro RPC, I could find the following messages in > "flume.log". > > ============================== > [TIME] INFO [lifecycleSupervisor-1-1] > (org.apache.flume.source.AvroSource.start:143) - Starting Avro source > avroSrc: { bindAddress: xxxxx, port: xxxx }... > [TIME] INFO [lifecycleSupervisor-1-3] > (org.apache.flume.source.AvroSource.start:185) - Avro source avroSrc > started. > ============================== > > but in the case of failure, I could not find " Avro source avroSrc started. > " message. > # though I found "Starting Avro source avroSrc". > > so, I think that the biggest problem is failure of starting Avro source. > > and furthermore, implemented debug log in the source code to trace in > detail, and start and stop repeatedly, > then I found that MessageDigest#getInstance("MD5") in > org.apache.avro.Protocol#getMD5() hang up. > > does anyone know the cause of this problem and how to solve ? > > I guess this problem might be caused when using IBM JDK. how do you think ? > is this problem related to [AVRO-1221]? > > and one more question, > when Avro source started successfully, I suppose that MD5 digest is same > value each time. > so, what does MD5 digest need for ? > > regards, > > You > > --001a11c306005095ad04ecc5ce91--