Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 77C55C476 for ; Thu, 10 May 2012 11:56:45 +0000 (UTC) Received: (qmail 10670 invoked by uid 500); 10 May 2012 11:56:42 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 10635 invoked by uid 500); 10 May 2012 11:56:42 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 10621 invoked by uid 99); 10 May 2012 11:56:41 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 May 2012 11:56:41 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_FRT_LOLITA1 X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of pieter.callewaert@be-mobile.be designates 216.32.181.184 as permitted sender) Received: from [216.32.181.184] (HELO ch1outboundpool.messaging.microsoft.com) (216.32.181.184) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 May 2012 11:56:27 +0000 Received: from mail13-ch1-R.bigfish.com (10.43.68.233) by CH1EHSOBE003.bigfish.com (10.43.70.53) with Microsoft SMTP Server id 14.1.225.23; Thu, 10 May 2012 11:56:06 +0000 Received: from mail13-ch1 (localhost [127.0.0.1]) by mail13-ch1-R.bigfish.com (Postfix) with ESMTP id 023514A040A for ; Thu, 10 May 2012 11:56:06 +0000 (UTC) X-SpamScore: -14 X-BigFish: PS-14(zzbb2dI9371Ic85fh1be0I98bK542M98dKzz1202hzz8275bh8275dhz2fh2a8h668h839hd25h) X-Forefront-Antispam-Report: CIP:157.56.248.213;KIP:(null);UIP:(null);IPV:NLI;H:AMXPRD0610HT004.eurprd06.prod.outlook.com;RD:none;EFVD:NLI Received-SPF: pass (mail13-ch1: domain of be-mobile.be designates 157.56.248.213 as permitted sender) client-ip=157.56.248.213; envelope-from=pieter.callewaert@be-mobile.be; helo=AMXPRD0610HT004.eurprd06.prod.outlook.com ;.outlook.com ; Received: from mail13-ch1 (localhost.localdomain [127.0.0.1]) by mail13-ch1 (MessageSwitch) id 1336650962633093_16327; Thu, 10 May 2012 11:56:02 +0000 (UTC) Received: from CH1EHSMHS023.bigfish.com (snatpool2.int.messaging.microsoft.com [10.43.68.235]) by mail13-ch1.bigfish.com (Postfix) with ESMTP id 953954E0054 for ; Thu, 10 May 2012 11:56:02 +0000 (UTC) Received: from AMXPRD0610HT004.eurprd06.prod.outlook.com (157.56.248.213) by CH1EHSMHS023.bigfish.com (10.43.70.23) with Microsoft SMTP Server (TLS) id 14.1.225.23; Thu, 10 May 2012 11:56:01 +0000 Received: from AMXPRD0610MB353.eurprd06.prod.outlook.com ([169.254.1.104]) by AMXPRD0610HT004.eurprd06.prod.outlook.com ([10.255.58.39]) with mapi id 14.16.0152.000; Thu, 10 May 2012 11:55:46 +0000 From: Pieter Callewaert To: "user@cassandra.apache.org" Subject: RE: sstableloader 1.1 won't stream Thread-Topic: sstableloader 1.1 won't stream Thread-Index: Ac0sXfDl0/C8lrL7SH2k/TRyDntZhgAMPPwAAB+JWzAALLsxgAAOGkCgACSQ6bAABdcvgAAAPv0Q Date: Thu, 10 May 2012 11:55:45 +0000 Message-ID: <0B2BF1E8E35731438C02772C683FB67B11F11EBD@AMXPRD0610MB353.eurprd06.prod.outlook.com> References: <0B2BF1E8E35731438C02772C683FB67B010FF900@AMXPRD0610MB353.eurprd06.prod.outlook.com> <0B2BF1E8E35731438C02772C683FB67B01100DC2@AMXPRD0610MB353.eurprd06.prod.outlook.com> <0B2BF1E8E35731438C02772C683FB67B11F10E12@AMXPRD0610MB353.eurprd06.prod.outlook.com> <0B2BF1E8E35731438C02772C683FB67B11F113B3@AMXPRD0610MB353.eurprd06.prod.outlook.com> In-Reply-To: Accept-Language: nl-BE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [81.82.202.11] Content-Type: multipart/alternative; boundary="_000_0B2BF1E8E35731438C02772C683FB67B11F11EBDAMXPRD0610MB353_" MIME-Version: 1.0 X-OriginatorOrg: be-mobile.be --_000_0B2BF1E8E35731438C02772C683FB67B11F11EBDAMXPRD0610MB353_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi Aaron, Thx for the suggestions. Telnet works perfectly: [root@bms-app1 ~]# telnet 10.10.10.101 7000 Trying 10.10.10.101... Connected to 10.10.10.101 (10.10.10.101). Escape character is '^]'. Connection closed by foreign host. The sstableloader uses the log4j-tools.properties, which is already on DEBU= G (so the logs I posted are with DEBUG level). It doesn't say a lot about t= he error. The server that is trying to load the tables to the cluster has IP 10.10.10= .11, but all network configuration seems OK. This was also a fully functionally system with 1.0.9. Since everything is u= pgraded to 1.1.0 I'm having troubles with the streaming. Kind regards, Pieter Callewaert From: aaron morton [mailto:aaron@thelastpickle.com] Sent: donderdag 10 mei 2012 13:43 To: user@cassandra.apache.org Subject: Re: sstableloader 1.1 won't stream It looks like a networking thing. Is there anything interesting in the netw= ork config ? Are the nodes using a broadcast_address ? Can you telnet from = the machine running sstableloader to port 7000 on 10.10.10.101 ? I *think* sstableload will use the log4j-server.properties log config. Can = you turn the logging up to debug and see what it days ? it looks like the sstableloader as connected to the cluster on the thrift /= listen port 9160. It's then tried to run the transfer, which is when this = happens.... WARN 10:53:18,575 Failed attempt 1 to connect to /10.10.10.101 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D2 progress=3D0/6566400 = - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address) Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 10/05/2012, at 9:01 PM, Pieter Callewaert wrote: Firstly I disabled ipv6 on the server to be sure it wasn't trying to use th= e ipv6, but no effect. I've tried using sstableloader on one of the cassandra nodes, no probem her= e, worked perfectly! So was doubting if the first server was corrupt or something, so I tried on= another server, CentOS 5.7 x64 with java 7 p04, which is not running a Cas= sandra instance, and again I'm having problems streaming: [root@bms-web2 ~]# ./apache-cassandra-1.1.0/bin/sstableloader --debug -d 10= .10.10.100 MapData024/HOS/ Streaming revelant part of MapData024/HOS/MapData024-HOS-hc-1-Data.db to [/= 10.10.10.102, /10.10.10.100, /10.10.10.101] progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/= 1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 10:53:18,575 Failed attempt 1 t= o connect to /10.10.10.101 to stream MapData024/HOS/MapData024-HOS-hc-1-Dat= a.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 4000 ms. (java.net= .SocketException: Invalid argument or cannot assign requested address) WARN 10:53:18,577 Failed attempt 1 to connect to /10.10.10.102 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 = - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address) WARN 10:53:18,594 Failed attempt 1 to connect to /10.10.10.100 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 = - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address) progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/= 1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 10:53:22,598 Failed attempt 2 t= o connect to /10.10.10.101 to stream MapData024/HOS/MapData024-HOS-hc-1-Dat= a.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 8000 ms. (java.net= .SocketException: Invalid argument or cannot assign requested address) WARN 10:53:22,601 Failed attempt 2 to connect to /10.10.10.102 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 = - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address) WARN 10:53:22,611 Failed attempt 2 to connect to /10.10.10.100 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 = - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address) progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/= 1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] [root@bms-web2 ~]# java -version java version "1.7.0_04" Java(TM) SE Runtime Environment (build 1.7.0_04-b20) Java HotSpot(TM) 64-Bit Server VM (build 23.0-b21, mixed mode) [root@bms-web2 ~]# cat /etc/redhat-release CentOS release 5.7 (Final) Is it possible the sstableloader only works now if a Cassandra instance is = also running on the same server? The only other difference I see is CentOS = 6.2 vs CentOS 5.x The new sstableloader, does it still use the Cassandra.yaml or is it comple= tely independent? Kind regards -----Original Message----- From: Pieter Callewaert [mailto:pieter.callewaert@be-mobile.be] Sent: woensdag 9 mei 2012 17:41 To: user@cassandra.apache.org Subject: RE: sstableloader 1.1 won't stream I don't see any entries in the logs of the nodes. I've disabled SELinux, to be sure this wasn't a blocking factor, and tried = adding -Djava.net.preferIPv4Stack=3Dtrue to bin/sstableloader, but no chang= e unfortunately. To summarize, I'm trying to use sstableloader from a server (CentOS release= 5.8 (Final)) not running Cassandra to a 3-node Cassandra cluster. All runn= ing 1.1. My next step will be to try to use sstableloader on one of the nodes from t= he cluster, to see if that works... If anyone has any other ideas, please share. Kind regards, Pieter Callewaert -----Original Message----- From: Sylvain Lebresne [mailto:sylvain@datastax.com] Sent: woensdag 9 mei 2012 10:45 To: user@cassandra.apache.org Subject: Re: sstableloader 1.1 won't stream Have you checked for errors in the servers' logs? -- Sylvain On Tue, May 8, 2012 at 1:24 PM, Pieter Callewaert > wrote: I've updated all nodes to 1.1 but I keep getting the same problem... Any other thoughts about this? Kind regards, Pieter -----Original Message----- From: Benoit Perroud [mailto:benoit@noisette.ch] Sent: maandag 7 mei 2012 22:21 To: user@cassandra.apache.org Subject: Re: sstableloader 1.1 won't stream You may want to upgrade all your nodes to 1.1. The streaming process connect to every living nodes of the cluster (you can= explicitely diable some nodes), so all nodes need to speak 1.1. 2012/5/7 Pieter Callewaert >: Hi, I'm trying to upgrade our bulk load process in our testing env. We use the SSTableSimpleUnsortedWriter to write tables, and use sstableloader to stream it into our cluster. I've changed the writer program to fit to the 1.1 api, but now I'm having troubles to load them to our cluster. The cluster exists out of one 1.1 node and two 1.0.9 nodes. I've enabled debug as parameter and in the log4j conf. [root@bms-app1 ~]# ./apache-cassandra/bin/sstableloader --debug -d 10.10.10.100 /tmp/201205071234/MapData024/HOS/ INFO 16:25:40,735 Opening /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1 (1588949 bytes) INFO 16:25:40,755 JNA not found. Native methods will be disabled. DEBUG 16:25:41,060 INDEX LOAD TIME for /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1: 327 ms. Streaming revelant part of /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to [/10.10.10.102, /10.10.10.100, /10.10.10.101] INFO 16:25:41,083 Stream context metadata [/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 - 0%], 1 sstables. DEBUG 16:25:41,084 Adding file /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to be streamed= . INFO 16:25:41,087 Streaming to /10.10.10.102 DEBUG 16:25:41,092 Files are /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 - 0% INFO 16:25:41,099 Stream context metadata [/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 - 0%], 1 sstables. DEBUG 16:25:41,100 Adding file /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to be streamed= . INFO 16:25:41,100 Streaming to /10.10.10.100 DEBUG 16:25:41,100 Files are /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 - 0% INFO 16:25:41,102 Stream context metadata [/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D2 progress=3D0/6566400 - 0%], 1 sstables. DEBUG 16:25:41,102 Adding file /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to be streamed= . INFO 16:25:41,102 Streaming to /10.10.10.101 DEBUG 16:25:41,102 Files are /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D2 progress=3D0/6566400 - 0% progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 16:25:41,107 Failed attempt 1 to connect to /10.10.10.101 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 16:25:41,108 Failed attempt 1 to connect to /10.10.10.102 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 16:25:41,108 Failed attempt 1 to connect to /10.10.10.100 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 16:25:45,109 Failed attempt 2 to connect to /10.10.10.101 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 16:25:45,110 Failed attempt 2 to connect to /10.10.10.102 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 16:25:45,110 Failed attempt 2 to connect to /10.10.10.100 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 16:25:53,113 Failed attempt 3 to connect to /10.10.10.101 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 16:25:53,114 Failed attempt 3 to connect to /10.10.10.102 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) WARN 16:25:53,115 Failed attempt 3 to connect to /10.10.10.100 to stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 - 0%. Retrying in 16000 ms. (java.net.SocketException: Invalid argument or cannot assign requested address) progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] ... Anyone any idea what I'm doing wrong? Kind regards, Pieter Callewaert -- sent from my Nokia 3210 --_000_0B2BF1E8E35731438C02772C683FB67B11F11EBDAMXPRD0610MB353_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi Aaron,<= o:p>

 = ;

Thx for th= e suggestions.

 = ;

Telnet wor= ks perfectly:

 = ;

[root@bms-= app1 ~]# telnet 10.10.10.101 7000

Trying 10.= 10.10.101...

Connected = to 10.10.10.101 (10.10.10.101).

Escape cha= racter is '^]'.

 = ;

Connection= closed by foreign host.

 = ;

The sstabl= eloader uses the log4j-tools.properties, which is already on DEBUG (so the = logs I posted are with DEBUG level). It doesn’t say a lot about the error.

 = ;

The server= that is trying to load the tables to the cluster has IP 10.10.10.11, but a= ll network configuration seems OK.

This was a= lso a fully functionally system with 1.0.9. Since everything is upgraded to= 1.1.0 I’m having troubles with the streaming.

 = ;

Kind regar= ds,

Pieter Cal= lewaert

 = ;

From: aaron morton [mailto:aaron@thelastpickle.com]
Sent: donderdag 10 mei 2012 13:43
To: user@cassandra.apache.org
Subject: Re: sstableloader 1.1 won't stream

 

It looks like a networking thing. Is there anything = interesting in the network config ? Are the nodes using a broadcast_address= ? Can you telnet from the machine running sstableloader to port 7000 on 10= .10.10.101 ?

 

I *think* sstableload will use the log4j-server.prop= erties log config. Can you turn the logging up to debug and see what it day= s ? 

 

it looks like the sstableloader as connected to the = cluster on the thrift / listen port 9160. It's then tried to run the transf= er, which is when this happens….

 

WARN 10:53:18,575 Failed attempt 1 to connect to /10= .10.10.101 to stream MapData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D= 2 progress=3D0/6566400 - 0%. Retrying in 4000 ms. (java.net.SocketException= : Invalid argument or cannot assign requested address)

 

Cheers

 

 

-----------------

Aaron Morton

Freelance Developer<= /o:p>

@aaronmorton

 

On 10/05/2012, at 9:01 PM, Pieter Callewaert wrote:<= o:p>



Firstly I disabled ipv6 on the server to be sure it = wasn't trying to use the ipv6, but no effect.

I've tried using sstableloader on one of the cassandra nodes, no probem her= e, worked perfectly!
So was doubting if the first server was corrupt or something, so I tried on= another server, CentOS 5.7 x64 with java 7 p04, which is not running a Cas= sandra instance, and again I'm having problems streaming:

[root@bms-web2 ~]# ./apache-cassandra-1.1.0/bin/sstableloader --debug -d 10= .10.10.100 MapData024/HOS/
Streaming revelant part of MapData024/HOS/MapData024-HOS-hc-1-Data.db to [/= 10.10.10.102, /10.10.10.100, /10.10.10.101]

progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/= 1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 10:53:18,575 Failed attempt 1 t= o connect to /10.10.10.101 to stream MapData024/HOS/MapData024-HOS-hc-1-Dat= a.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or = cannot assign requested address)
WARN 10:53:18,577 Failed attempt 1 to connect to /10.10.10.102 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 = - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address)
WARN 10:53:18,594 Failed attempt 1 to connect to /10.10.10.100 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 = - 0%. Retrying in 4000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address)
progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/= 1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 10:53:22,598 Failed attempt 2 t= o connect to /10.10.10.101 to stream MapData024/HOS/MapData024-HOS-hc-1-Dat= a.db sections=3D2 progress=3D0/6566400 - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or = cannot assign requested address)
WARN 10:53:22,601 Failed attempt 2 to connect to /10.10.10.102 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6557280 = - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address)
WARN 10:53:22,611 Failed attempt 2 to connect to /10.10.10.100 to stream Ma= pData024/HOS/MapData024-HOS-hc-1-Data.db sections=3D1 progress=3D0/6551840 = - 0%. Retrying in 8000 ms. (java.net.SocketException: Invalid argument or c= annot assign requested address)
progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] [/10.10.10.101 0/= 1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]
[root@bms-web2 ~]# java -version
java version "1.7.0_04"
Java(TM) SE Runtime Environment (build 1.7.0_04-b20)
Java HotSpot(TM) 64-Bit Server VM (build 23.0-b21, mixed mode)
[root@bms-web2 ~]# cat /etc/redhat-release
CentOS release 5.7 (Final)

Is it possible the sstableloader only works now if a Cassandra instance is = also running on the same server? The only other difference I see is CentOS = 6.2 vs CentOS 5.x
The new sstableloader, does it still use the Cassandra.yaml or is it comple= tely independent?

Kind regards

-----Original Message-----
From: Pieter Callewaert [mailto:pieter.callewaert@be-mobile.be]
Sent: woensdag 9 mei 2012 17:41
To: user@cassandra.apache.org<= /a>
Subject: RE: sstableloader 1.1 won't stream

I don't see any entries in the logs of the nodes.

I've disabled SELinux, to be sure this wasn't a blocking factor, and tried = adding -Djava.net.preferIPv4Stack=3Dtrue to bin/sstableloader, but no chang= e unfortunately.

To summarize, I'm trying to use sstableloader from a server (CentOS release= 5.8 (Final)) not running Cassandra to a 3-node Cassandra cluster. All runn= ing 1.1.
My next step will be to try to use sstableloader on one of the nodes from t= he cluster, to see if that works...

If anyone has any other ideas, please share.

Kind regards,
Pieter Callewaert

-----Original Message-----
From: Sylvain Lebresne [ma= ilto:sylvain@datastax.com]
Sent: woensdag 9 mei 2012 10:45
To: user@cassandra.apache.org<= /a>
Subject: Re: sstableloader 1.1 won't stream

Have you checked for errors in the servers' logs?

--
Sylvain

On Tue, May 8, 2012 at 1:24 PM, Pieter Callewaert <pieter.callewaert@be-mobile.be> wrote:<= br>

I've updated all nodes to 1.1 but I keep getting the= same problem...

Any other thoughts about this?

 

Kind regards,

Pieter

 

-----Original Message-----

From: Benoit Perroud [mailto:benoit@noisette.ch]

Sent: maandag 7 mei 2012 22:21

To: use= r@cassandra.apache.org

Subject: Re: sstableloader 1.1 won't stream

 

You may want to upgrade all your nodes to 1.1.<= /o:p>

 

The streaming process connect to every living nodes = of the cluster (you can explicitely diable some nodes), so all nodes need t= o speak 1.1.

 

 

 

2012/5/7 Pieter Callewaert <pieter.callewaert@be-mobile.be>:

Hi,

 

 

 

I'm trying to upgrade our bulk load process in our t= esting env.

 

We use the SSTableSimpleUnsortedWriter to write tabl= es, and use

sstableloader to stream it into our cluster.

 

I've changed the writer program to fit to the 1.1 ap= i, but now I'm

having troubles to load them to our cluster. The clu= ster exists out

of one 1.1 node and two 1.0.9 nodes.

 

 

 

I've enabled debug as parameter and in the log4j con= f.

 

 

 

[root@bms-app1 ~]# ./apache-cassandra/bin/sstableloa= der --debug -d

10.10.10.100 /tmp/201205071234/MapData024/HOS/<= /o:p>

 

INFO 16:25:40,735 Opening

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= (1588949 bytes)

 

INFO 16:25:40,755 JNA not found. Native methods will= be disabled.

 

DEBUG 16:25:41,060 INDEX LOAD TIME for

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= : 327 ms.

 

Streaming revelant part of

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db to

[/10.10.10.102, /10.10.10.100, /10.10.10.101]

 

INFO 16:25:41,083 Stream context metadata

[/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-= 1-Data.db

sections=3D1

progress=3D0/6557280 - 0%], 1 sstables.

 

DEBUG 16:25:41,084 Adding file

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db to be streamed.

 

INFO 16:25:41,087 Streaming to /10.10.10.102

 

DEBUG 16:25:41,092 Files are

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db

sections=3D1

progress=3D0/6557280 - 0%

 

INFO 16:25:41,099 Stream context metadata

[/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-= 1-Data.db

sections=3D1

progress=3D0/6551840 - 0%], 1 sstables.

 

DEBUG 16:25:41,100 Adding file

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db to be streamed.

 

INFO 16:25:41,100 Streaming to /10.10.10.100

 

DEBUG 16:25:41,100 Files are

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db

sections=3D1

progress=3D0/6551840 - 0%

 

INFO 16:25:41,102 Stream context metadata

[/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-= 1-Data.db

sections=3D2

progress=3D0/6566400 - 0%], 1 sstables.

 

DEBUG 16:25:41,102 Adding file

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db to be streamed.

 

INFO 16:25:41,102 Streaming to /10.10.10.101

 

DEBUG 16:25:41,102 Files are

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db

sections=3D2

progress=3D0/6566400 - 0%

 

 

 

progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1= (0)]

[/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/= s)] WARN

16:25:41,107 Failed attempt 1 to connect to /10.10.1= 0.101 to stream

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db

sections=3D2

progress=3D0/6566400 - 0%. Retrying in 4000 ms. (jav= a.net.SocketException:

Invalid argument or cannot assign requested address)=

 

WARN 16:25:41,108 Failed attempt 1 to connect to /10= .10.10.102 to

stream /tmp/201205071234/MapData024/HOS/MapData024-H= OS-hc-1-Data.db

sections=3D1

progress=3D0/6557280 - 0%. Retrying in 4000 ms. (jav= a.net.SocketException:

Invalid argument or cannot assign requested address)=

 

WARN 16:25:41,108 Failed attempt 1 to connect to /10= .10.10.100 to

stream /tmp/201205071234/MapData024/HOS/MapData024-H= OS-hc-1-Data.db

sections=3D1

progress=3D0/6551840 - 0%. Retrying in 4000 ms. (jav= a.net.SocketException:

Invalid argument or cannot assign requested address)=

 

progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1= (0)]

[/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/= s)] WARN

16:25:45,109 Failed attempt 2 to connect to /10.10.1= 0.101 to stream

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db

sections=3D2

progress=3D0/6566400 - 0%. Retrying in 8000 ms. (jav= a.net.SocketException:

Invalid argument or cannot assign requested address)=

 

WARN 16:25:45,110 Failed attempt 2 to connect to /10= .10.10.102 to

stream /tmp/201205071234/MapData024/HOS/MapData024-H= OS-hc-1-Data.db

sections=3D1

progress=3D0/6557280 - 0%. Retrying in 8000 ms. (jav= a.net.SocketException:

Invalid argument or cannot assign requested address)=

 

WARN 16:25:45,110 Failed attempt 2 to connect to /10= .10.10.100 to

stream /tmp/201205071234/MapData024/HOS/MapData024-H= OS-hc-1-Data.db

sections=3D1

progress=3D0/6551840 - 0%. Retrying in 8000 ms. (jav= a.net.SocketException:

Invalid argument or cannot assign requested address)=

 

progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1= (0)]

[/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/= s)] WARN

16:25:53,113 Failed attempt 3 to connect to /10.10.1= 0.101 to stream

/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1= -Data.db

sections=3D2

progress=3D0/6566400 - 0%. Retrying in 16000 ms. (ja= va.net.SocketException:

Invalid argument or cannot assign requested address)=

 

WARN 16:25:53,114 Failed attempt 3 to connect to /10= .10.10.102 to

stream /tmp/201205071234/MapData024/HOS/MapData024-H= OS-hc-1-Data.db

sections=3D1

progress=3D0/6557280 - 0%. Retrying in 16000 ms. (ja= va.net.SocketException:

Invalid argument or cannot assign requested address)=

 

WARN 16:25:53,115 Failed attempt 3 to connect to /10= .10.10.100 to

stream /tmp/201205071234/MapData024/HOS/MapData024-H= OS-hc-1-Data.db

sections=3D1

progress=3D0/6551840 - 0%. Retrying in 16000 ms. (ja= va.net.SocketException:

Invalid argument or cannot assign requested address)=

 

progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1= (0)]

[/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/= s)]

 

...

 

 

 

Anyone any idea what I'm doing wrong?

 

 

 

Kind regards,

 

Pieter Callewaert

 

 

 

--

sent from my Nokia 3210

 




 

--_000_0B2BF1E8E35731438C02772C683FB67B11F11EBDAMXPRD0610MB353_--