Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 56760 invoked from network); 2 Mar 2010 20:51:45 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 2 Mar 2010 20:51:45 -0000 Received: (qmail 60475 invoked by uid 500); 2 Mar 2010 20:51:40 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 60459 invoked by uid 500); 2 Mar 2010 20:51:40 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 60451 invoked by uid 99); 2 Mar 2010 20:51:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 20:51:40 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sjcloud22@gmail.com designates 209.85.160.47 as permitted sender) Received: from [209.85.160.47] (HELO mail-pw0-f47.google.com) (209.85.160.47) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Mar 2010 20:51:31 +0000 Received: by pwi5 with SMTP id 5so372396pwi.6 for ; Tue, 02 Mar 2010 12:51:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=8RqXgfs18AAspV+MOg+AsRUAxKGKTYvROfw7mYbu8LY=; b=YHlkVh1fO2ioScy8y8/fVs7nDrVGZFGNCn2Lv/jqnInrjCJaI6BCJ/kVMccLiMkZD+ fYL0qPXAbP65pFKCezQrnpIVsu0aBs5fw/lcuspHBcb/nUNdW8pJYmF7+NCnlnOeOVbe PP+JmdDKejnyw3r72fH9WQAgmu2SAjbY9FNwI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=glM0/HcLPBOc03HipG/59HCKQ/AgkRBB6G+PsUUNJ/LVXM7mRAJi7Iea7L9qDSLA59 NBUb5luw77jHLcMuzXu0LrQHj6DeUbDuHrL+oFmoxx1pylMsR6P91W9Psu+0/AY2Lar4 rqPTu2yNi/T8Ii4rc7Ig64YtzfxI/SS24NyS4= MIME-Version: 1.0 Received: by 10.115.116.37 with SMTP id t37mr3698781wam.228.1267563069697; Tue, 02 Mar 2010 12:51:09 -0800 (PST) In-Reply-To: References: Date: Tue, 2 Mar 2010 12:51:09 -0800 Message-ID: Subject: Re: Adjusting Token Spaces and Rebalancing Data From: Jon Graham To: cassandra-user@incubator.apache.org Content-Type: multipart/alternative; boundary=0016e64ea1d67fefaa0480d786ad X-Virus-Checked: Checked by ClamAV on apache.org --0016e64ea1d67fefaa0480d786ad Content-Type: text/plain; charset=ISO-8859-1 Thanks! Switching to java 1.6.0_18 seems to have gotten past the 2GB file boundary. I now have a new ring token for the first node in my cluster. Can I run a "loadbalance" on nodes 2-6 to achive more data and token balancing? Should I perform a cleanup operation on node 1? During the loadbalance operation, the following changes occurred: node 1: changed token value ; data size change from 5.7 GB to 8.2 GB (loadbalance was performed on this node) node 2: no token ring changes ; data size remained at 5.7 GB ; again found the following warning(s) in log file java.io.IOException: Reached an EOL or something bizzare occured. Reading from: /node1 BufferSizeRemaining: 16 at org.apache.cassandra.net.io.StartState.doRead(StartState.java:44) at org.apache.cassandra.net.io.ProtocolState.read(ProtocolState.java:39) at org.apache.cassandra.net.io.TcpReader.read(TcpReader.java:95) at org.apache.cassandra.net.TcpConnection$ReadWorkItem.run(TcpConnection.java:445) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) node 3: no token ring changes ; data size remained at 5.7 GB node 4: no token ring changes ; data size change from 3KB to 5.7 GB (cassandra selected target of load balance) node 5: no token ring changes ; data size remained at 3 KB node 6: no token ring changes ; data size remained at 3 KB Thanks again, I really appreciate your help on this. Jon -------------------------------------------------------------------------------------------------------------------- On Tue, Mar 2, 2010 at 9:24 AM, Jon Graham wrote: > Thanks Jonathan, > > My 32-bit java version is at: 1.6.0_13-b03. I'll try a java upgrade. > This tracks well with the exact MaxInt -tmp- Data file size > > Jon > > On Tue, Mar 2, 2010 at 9:15 AM, Jonathan Ellis wrote: > >> Doing some googling, this is a different JRE bug than the on addressed >> by 795: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6253145. >> It is marked fixed in JDK 6u18, so try upgrading to that. >> >> -Jonathan >> >> On Tue, Mar 2, 2010 at 10:46 AM, Jon Graham wrote: >> > Hello, >> > >> > I am running a 32-bit linux version 2.6.27.24. My original data set was >> > copied from a 64-bit cassandra cluster to a 32-bit cassandra cluster. I >> am >> > trying to load balance the data on a 32-bit cluster. >> > >> > Is the cassandra-795 issue applicable for 32-linux too for the 0.5.0 >> > release? >> > >> > Thanks, >> > Jon >> > On Mon, Mar 1, 2010 at 4:55 PM, Jonathan Ellis >> wrote: >> >> >> >> On Mon, Mar 1, 2010 at 5:39 PM, Jon Graham >> wrote: >> >> > Reached an EOL or something bizzare occured. Reading from: / >> 192.168.2.13 >> >> > BufferSizeRemaining: 16 >> >> >> >> This one is harmless >> >> >> >> > java.io.IOException: Value too large for defined data type >> >> > at sun.nio.ch.FileChannelImpl.transferTo0(Native Method) >> >> > at sun.nio.ch.FileChannelImpl.transferToDirectly(Unknown Source) >> >> > at sun.nio.ch.FileChannelImpl.transferTo(Unknown Source) >> >> > at >> >> > org.apache.cassandra.net.TcpConnection.stream(TcpConnection.java:226) >> >> > at >> >> > org.apache.cassandra.net.FileStreamTask.run(FileStreamTask.java:55) >> >> > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown >> >> > Source) >> >> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown >> >> > Source) >> >> > at java.lang.Thread.run(Unknown Source) >> >> >> >> This one is killing you. >> >> >> >> Are you on windows? If so >> >> https://issues.apache.org/jira/browse/CASSANDRA-795 should fix it. >> >> That's in both 0.5.1 and 0.6 beta. >> >> >> >> -Jonathan >> > >> > >> > > --0016e64ea1d67fefaa0480d786ad Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks!
=A0
Switching to=A0java 1.6.0_18 seems to have gotten past the=A02GB file = boundary. I now have a new ring token for the first node in my cluster.
=A0
Can I run a "loadbalance" on nodes 2-6 to achive more data a= nd token balancing?
=A0
Should I=A0perform a cleanup operation on node 1?
=A0
During the loadbalance operation, the following changes occurred:
=A0
node 1: changed token value ; data size change from=A05.7 GB to 8.2 GB= (loadbalance was performed on this node)
node 2: no=A0token ring changes ; data size remained at 5.7 GB ;=A0aga= in found the following warning(s) in log file
=A0
java.io.IOException: Reached an EOL or something bizzare occured. Read= ing from: /node1 BufferSizeRemaining: 16
=A0=A0=A0=A0=A0=A0=A0 at org.ap= ache.cassandra.net.io.StartState.doRead(StartState.java:44)
=A0=A0=A0=A0= =A0=A0=A0 at org.apache.cassandra.net.io.ProtocolState.read(ProtocolState.j= ava:39)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.net.io.TcpReader.read(TcpRead= er.java:95)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.net.TcpConnect= ion$ReadWorkItem.run(TcpConnection.java:445)
=A0=A0=A0=A0=A0=A0=A0 at ja= va.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run= (Unknown Source)
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Unknown S= ource)
=A0
node 3:=A0no=A0token ring changes ; data size remained at 5.7 GB
node 4:=A0no token ring=A0changes ; data size change from 3KB to 5.7 G= B (cassandra selected target of load balance)
node=A05: no token ring=A0changes ;=A0data size remained at=A0=A03 KB<= /div>
node 6: no token ring=A0changes ;=A0data size remained at=A0=A03 KB
=A0
Thanks again, I really appreciate your help on this.
Jon
----------------------------------------------------------------------= ----------------------------------------------

On Tue, Mar 2, 2010 at 9:24 AM, Jon Graham <sjcloud22@gmail.com= > wrote:
Thanks Jonathan,
=A0
My 32-bit java version is at: 1.6.0_13-b03. I'll try a java upgrad= e.
This tracks well with the=A0exact MaxInt -tmp- Data=A0file size
=A0
Jon
On Tue, Mar 2, 2010 at 9:15 AM, Jonathan Ellis <= span dir=3D"ltr"><jbellis@gmail.com> wrote:
Doing some googling, this is a d= ifferent JRE bug than the on addressed
by 795: http://bu= gs.sun.com/bugdatabase/view_bug.do?bug_id=3D6253145.
It is marked fixed in JDK 6u18, so try upgrading to that.

-Jonathan

On Tue, Mar 2, 2010 at 10:46 AM, Jon Graham <sjcloud22@gmail.com> wrote:> Hello,
>
> I am running a 32-bit linux version 2.6.27.24= . My original data set was
> copied from a 64-bit cassandra cluster to a 32-bit cassandra cluster. = I am
> trying to load balance the data on a 32-bit cluster.
>> Is the cassandra-795 issue applicable for 32-linux too for the 0.5.0=
> release?
>
> Thanks,
> Jon
> On Mon, Mar 1, 20= 10 at 4:55 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
>>
>> On M= on, Mar 1, 2010 at 5:39 PM, Jon Graham <sjcloud22@gmail.com> wrote:
>> > Reached an EOL or something bizzare occured. Reading from: /<= a href=3D"http://192.168.2.13/" target=3D"_blank">192.168.2.13
>&= gt; > BufferSizeRemaining: 16
>>
>> This one is harmle= ss
>>
>> > java.io.IOException: Value too large for defined = data type
>> > =A0=A0=A0 at sun.nio.ch.FileChannelImpl.transfer= To0(Native Method)
>> > =A0=A0=A0 at sun.nio.ch.FileChannelImpl= .transferToDirectly(Unknown Source)
>> > =A0=A0=A0 at sun.nio.ch.FileChannelImpl.transferTo(Unknown So= urce)
>> > =A0=A0=A0 at
>> > org.apache.cassandra.n= et.TcpConnection.stream(TcpConnection.java:226)
>> > =A0=A0=A0 = at
>> > org.apache.cassandra.net.FileStreamTask.run(FileStreamT= ask.java:55)
>> > =A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.r= unTask(Unknown
>> > Source)
>> > =A0=A0=A0 at java.= util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> > Sour= ce)
>> > =A0=A0=A0 at java.lang.Thread.run(Unknown Source)
>>
>> This one is killing you.
>>
>> Are y= ou on windows? =A0If so
>> https://issues.apache.org/jira/b= rowse/CASSANDRA-795 should fix it.
>> That's in both 0.5.1 and 0.6 beta.
>>
>> -Jo= nathan
>
>


--0016e64ea1d67fefaa0480d786ad--