Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 414D110AAD for ; Sun, 14 Apr 2013 21:21:21 +0000 (UTC) Received: (qmail 9631 invoked by uid 500); 14 Apr 2013 21:21:18 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 9593 invoked by uid 500); 14 Apr 2013 21:21:18 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 9585 invoked by uid 99); 14 Apr 2013 21:21:18 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Apr 2013 21:21:18 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of john@disqus.com designates 209.85.223.172 as permitted sender) Received: from [209.85.223.172] (HELO mail-ie0-f172.google.com) (209.85.223.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Apr 2013 21:21:11 +0000 Received: by mail-ie0-f172.google.com with SMTP id c10so5167990ieb.3 for ; Sun, 14 Apr 2013 14:20:51 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=/WzGs5KkCf1PLAKFQeWRM9iXO4TOtkqy63NTL85glbc=; b=mkO5jb7rhaWUsi3tij9MtTOazeNsH54KU9mA0CFMweBPGLcB5gp/862GwiQBaAjkWu Cq7cHDaG86ppVBBTiPQ0w7yjI22s0c9wGe2uGqFv4eOsI4Z3uDzv12M8W+mz3yL8qKqe SO1sLhA33ZpG6aIuYd4Xs/uqhL1FAUTLLU7FG5QumxohuRIxBQbC+YiaHx012asQ9MtC 7cwzsp6J2ljv8C5vvcBpx5LhZjTpZASJVEtb3VN7pLYYNU69sWOkg5CVP/Zt6bodpnLM myuR+fSpY5DQiSZdj43gJbBp+MA7n76mmQDmc7Ah/+p3KgKY5DrqCC3IuCDbfQmyGoxF uGrg== MIME-Version: 1.0 X-Received: by 10.42.42.69 with SMTP id s5mr10653239ice.2.1365974451025; Sun, 14 Apr 2013 14:20:51 -0700 (PDT) Received: by 10.64.13.243 with HTTP; Sun, 14 Apr 2013 14:20:50 -0700 (PDT) Date: Sun, 14 Apr 2013 14:20:50 -0700 Message-ID: Subject: 1.1.9 to 1.2.3 upgrade issue From: John Watson To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=bcaec50fe5f5ed0dcc04da58b576 X-Gm-Message-State: ALoCoQm0Jhjof5VBEjZI3gqHz3NEmBNcoHE2W4dzAhXPllLsZbbKI6eUW8MhF7AeEIunzzO/snGM X-Virus-Checked: Checked by ClamAV on apache.org --bcaec50fe5f5ed0dcc04da58b576 Content-Type: text/plain; charset=UTF-8 Started doing a rolling upgrade of nodes from 1.1.9 to 1.2.3 and nodes on 1.1.9 started flooding this error: Exception in thread Thread[RequestResponseStage:19496,5,main] java.io.IOError: java.io.EOFException at org.apache.cassandra.service.AbstractRowResolver.preprocess(AbstractRowResolver.java:71) at org.apache.cassandra.service.ReadCallback.response(ReadCallback.java:155) at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:45) at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:59) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.io.EOFException at java.io.DataInputStream.readFully(DataInputStream.java:180) at org.apache.cassandra.db.ReadResponseSerializer.deserialize(ReadResponse.java:100) at org.apache.cassandra.db.ReadResponseSerializer.deserialize(ReadResponse.java:81) at org.apache.cassandra.service.AbstractRowResolver.preprocess(AbstractRowResolver.java:64) ... 6 more As I understand the Hints CF changed from 1.1.x to 1.2.x so I assume that's the cause of the 1.2.3 nodes flooding (for various IPs still being 1.1.9): Unable to store hint for host with missing ID, /10.37.62.71 (old node?) Is this a known issue? Or rolling upgrade form 1.1.x to 1.2.x not possible? Thanks, John --bcaec50fe5f5ed0dcc04da58b576 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Started doing a rolling upgrade of nodes from 1.1.9 to 1.2= .3 and nodes on 1.1.9 started flooding this error:

=C2=A0= =C2=A0 Exception in thread Thread[RequestResponseStage:19496,5,main]
=
=C2=A0 =C2=A0 java.io.IOError: java.io.EOFException
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.serv= ice.AbstractRowResolver.preprocess(AbstractRowResolver.java:71)
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.service.R= eadCallback.response(ReadCallback.java:155)
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.net.ResponseVerbHandler.doVerb= (ResponseVerbHandler.java:45)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.net.= MessageDeliveryTask.run(MessageDeliveryTask.java:59)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at java.util.concurrent.ThreadPoolExecutor$= Worker.runTask(ThreadPoolExecutor.java:886)
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run(= ThreadPoolExecutor.java:908)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at java.lang.Thread.run(Thre= ad.java:662)
=C2=A0 =C2=A0 Caused by: java.io.EOFException
<= div>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at java.io.DataInputStream.re= adFully(DataInputStream.java:180)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 at org.apache.cassandra.db.ReadResponseSerializer.deserialize(Re= adResponse.java:100)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.db.R= eadResponseSerializer.deserialize(ReadResponse.java:81)
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at org.apache.cassandra.service.Abstract= RowResolver.preprocess(AbstractRowResolver.java:64)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ... 6 more
=
As I understand the Hints CF changed from 1.1.x to 1.2= .x so I assume that's the cause of the 1.2.3 nodes flooding (for variou= s IPs still being 1.1.9):

=C2=A0 =C2=A0 Unable to store hint for host= with missing ID, /10.37.62.71 (old node= ?)

Is this a known issue? Or rolli= ng upgrade form 1.1.x to 1.2.x not possible?

Thanks,

John
--bcaec50fe5f5ed0dcc04da58b576--