cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pieter Callewaert <pieter.callewa...@be-mobile.be>
Subject RE: sstableloader 1.1 won't stream
Date Tue, 08 May 2012 11:24:23 GMT
I've updated all nodes to 1.1 but I keep getting the same problem...
Any other thoughts about this?

Kind regards,
Pieter

-----Original Message-----
From: Benoit Perroud [mailto:benoit@noisette.ch] 
Sent: maandag 7 mei 2012 22:21
To: user@cassandra.apache.org
Subject: Re: sstableloader 1.1 won't stream

You may want to upgrade all your nodes to 1.1.

The streaming process connect to every living nodes of the cluster (you can explicitely diable
some nodes), so all nodes need to speak 1.1.



2012/5/7 Pieter Callewaert <pieter.callewaert@be-mobile.be>:
> Hi,
>
>
>
> I’m trying to upgrade our bulk load process in our testing env.
>
> We use the SSTableSimpleUnsortedWriter to write tables, and use 
> sstableloader to stream it into our cluster.
>
> I’ve changed the writer program to fit to the 1.1 api, but now I’m 
> having troubles to load them to our cluster. The cluster exists out of 
> one 1.1 node and two 1.0.9 nodes.
>
>
>
> I’ve enabled debug as parameter and in the log4j conf.
>
>
>
> [root@bms-app1 ~]# ./apache-cassandra/bin/sstableloader --debug -d
> 10.10.10.100 /tmp/201205071234/MapData024/HOS/
>
> INFO 16:25:40,735 Opening
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1 (1588949 bytes)
>
> INFO 16:25:40,755 JNA not found. Native methods will be disabled.
>
> DEBUG 16:25:41,060 INDEX LOAD TIME for
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1: 327 ms.
>
> Streaming revelant part of
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to 
> [/10.10.10.102, /10.10.10.100, /10.10.10.101]
>
> INFO 16:25:41,083 Stream context metadata 
> [/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6557280 - 0%], 1 sstables.
>
> DEBUG 16:25:41,084 Adding file
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to be streamed.
>
> INFO 16:25:41,087 Streaming to /10.10.10.102
>
> DEBUG 16:25:41,092 Files are
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6557280 - 0%
>
> INFO 16:25:41,099 Stream context metadata 
> [/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6551840 - 0%], 1 sstables.
>
> DEBUG 16:25:41,100 Adding file
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to be streamed.
>
> INFO 16:25:41,100 Streaming to /10.10.10.100
>
> DEBUG 16:25:41,100 Files are
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6551840 - 0%
>
> INFO 16:25:41,102 Stream context metadata 
> [/tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=2
> progress=0/6566400 - 0%], 1 sstables.
>
> DEBUG 16:25:41,102 Adding file
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db to be streamed.
>
> INFO 16:25:41,102 Streaming to /10.10.10.101
>
> DEBUG 16:25:41,102 Files are
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=2
> progress=0/6566400 - 0%
>
>
>
> progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] 
> [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 
> 16:25:41,107 Failed attempt 1 to connect to /10.10.10.101 to stream 
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=2
> progress=0/6566400 - 0%. Retrying in 4000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> WARN 16:25:41,108 Failed attempt 1 to connect to /10.10.10.102 to 
> stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6557280 - 0%. Retrying in 4000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> WARN 16:25:41,108 Failed attempt 1 to connect to /10.10.10.100 to 
> stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6551840 - 0%. Retrying in 4000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] 
> [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 
> 16:25:45,109 Failed attempt 2 to connect to /10.10.10.101 to stream 
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=2
> progress=0/6566400 - 0%. Retrying in 8000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> WARN 16:25:45,110 Failed attempt 2 to connect to /10.10.10.102 to 
> stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6557280 - 0%. Retrying in 8000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> WARN 16:25:45,110 Failed attempt 2 to connect to /10.10.10.100 to 
> stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6551840 - 0%. Retrying in 8000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] 
> [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)] WARN 
> 16:25:53,113 Failed attempt 3 to connect to /10.10.10.101 to stream 
> /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=2
> progress=0/6566400 - 0%. Retrying in 16000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> WARN 16:25:53,114 Failed attempt 3 to connect to /10.10.10.102 to 
> stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6557280 - 0%. Retrying in 16000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> WARN 16:25:53,115 Failed attempt 3 to connect to /10.10.10.100 to 
> stream /tmp/201205071234/MapData024/HOS/MapData024-HOS-hc-1-Data.db 
> sections=1
> progress=0/6551840 - 0%. Retrying in 16000 ms. (java.net.SocketException:
> Invalid argument or cannot assign requested address)
>
> progress: [/10.10.10.102 0/1 (0)] [/10.10.10.100 0/1 (0)] 
> [/10.10.10.101 0/1 (0)] [total: 0 - 0MB/s (avg: 0MB/s)]
>
> …
>
>
>
> Anyone any idea what I’m doing wrong?
>
>
>
> Kind regards,
>
> Pieter Callewaert



--
sent from my Nokia 3210

Mime
View raw message