Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of
 prvs=390ff4fb7=bburruss@expedia.com designates 216.251.112.223 as permitted
 sender)
From: Todd Burruss <bburruss@expedia.com>
To: "dev@cassandra.apache.org" <dev@cassandra.apache.org>
Date: Mon, 20 Feb 2012 14:52:34 -0800
Subject: hinted handoff - 1.1.0 beta1
Thread-Topic: hinted handoff - 1.1.0 beta1
Thread-Index: AczwIk/aFtlXTaWjTTCNaSuoLcXozw==
Message-ID: <CB680EB2.4856%bburruss@expedia.com>
Accept-Language: en-US
Content-Language: en-US
user-agent: Microsoft-MacOutlook/14.14.0.111121
acceptlanguage: en-US
Content-Type: multipart/alternative;
	boundary="_000_CB680EB24856bburrussexpediacom_"
MIME-Version: 1.0

--_000_CB680EB24856bburrussexpediacom_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I'm testing hinted handoff in 1.1 beta1 and cannot seem to get a hint deliv=
ered.  3 node cluster, RF =3D 3, writing with CL =3D ONE.  killed a host th=
en did the write using the CLI on another node.  I can see hint waiting usi=
ng CLI and I see the log messages at the end of this email.  this suggests =
the hints exist bu are not being delivered (and I'll see the log messages o=
ver and over.)

I did see tracing with debugger and see that in HintedHandoffManager.delive=
rHintsToEndpointInternal, this line will remove the hint because of the Int=
eger.MAX_VALUE


            ColumnFamily hintsPage =3D ColumnFamilyStore.removeDeleted(hint=
Store.getColumnFamily(filter), Integer.MAX_VALUE);

I'm not sure I quite understand while MAX is used when the same "remove" is=
 done in getColumnFamily(filter).  regardless if it is useful or not, it pr=
events the hints from delivery.

any thoughts?


[default@unknown] use system;
Authenticated to keyspace: system
[default@system] list hintscolumnfamily;
Using default limit of 100
-------------------
RowKey: 00
=3D> (super_column=3D493ecfa05c1411e100000da23097c7ff,
     (column=3D6b6579, value=3D6b35, timestamp=3D1329777799580, ttl=3D86400=
)
     (column=3D6d75746174696f6e, value=3D000662746f64646200026b350000000100=
0003e801000003e87fffffff80000000000000000000000100026335000004b96d055fd1300=
000000c68696e746564207772697465, timestamp=3D1329777799579, ttl=3D86400)
     (column=3D7461626c65, value=3D62746f646462, timestamp=3D1329777799580,=
 ttl=3D86400)
     (column=3D76657273696f6e, value=3D00000004, timestamp=3D1329777799580,=
 ttl=3D86400))

1 Row Returned.
Elapsed time: 58 msec(s).


 INFO [HintedHandoff:1] 2012-02-20 14:44:53,811 HintedHandOffManager.java (=
line 296) Started hinted handoff for token: 0 with IP: /192.168.56.1
 INFO [HintedHandoff:1] 2012-02-20 14:44:53,815 HintedHandOffManager.java (=
line 373) Finished hinted handoff of 0 rows to endpoint /192.168.56.1


I have a hint waiting to be deli

--_000_CB680EB24856bburrussexpediacom_--