incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thamizh <tceg...@yahoo.co.in>
Subject Re: Bulk uploader issue on multi-node cluster
Date Thu, 29 Sep 2011 09:37:38 GMT
Hi,

Thanks a lot Aaron. I had killed this process before it 8 attempts got completed. Now it it
uploading records.

Now, I am trying to perform parallel SSTable upload using 2 instances(127.0.0.2 & 127.0.0.3). 
Now the first instance is uploading and the second instance(127.0.0.3), I am getting below
error. These both instance are running on cassandra seed node.


nutch@lab02:/code/sstable0-cassandra-0.8.6$ bin/sstableloader --debug -v ipovw
Starting client (and waiting 30 seconds for gossip) ...
org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException:
Connection refused
    at org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:225)
    at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:104)
    at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:61)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection
refused
    at org.apache.thrift.transport.TSocket.open(TSocket.java:183)
    at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
    at org.apache.cassandra.tools.BulkLoader$ExternalClient.createThriftClient(BulkLoader.java:245)
    at org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:193)
    ... 2 more
Caused by: java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
    at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
    at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
    at java.net.Socket.connect(Socket.java:525)
    at org.apache.thrift.transport.TSocket.open(TSocket.java:178)
    ... 5 more
nutch@lab02:/code/sstable0-cassandra-0.8.6$ 


Any help would be appreciated.

 
Regards,
Thamizhannal 


________________________________
From: aaron morton <aaron@thelastpickle.com>
To: user@cassandra.apache.org
Sent: Wednesday, 28 September 2011 2:04 PM
Subject: Re: Bulk uploader issue on multi-node cluster


Thats just a warning, it should keep trying to connect. Does it make any progress  ?

After 8 attempts it should fail with an error. 

With the debug option you should get a full stack trace printed if it fails, can you send
that along as well. 

It's probably some sort of config problem.

Cheers




-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com 

On 28/09/2011, at 3:44 AM, Thamizh wrote:

Hi,
>
>I had set below config on SSTable instance (127.0.0.2).
>
>auto_bootstrap: false
>seeds: "172.27.15.2" (lab02)
>rpc_address: 127.0.0.2
>listen_address: 127.0.0.2
>rpc_port: 9160
>storage_port: 7000
>
>#ifconfig
>lo:2      Link encap:Local Loopback  
>          inet addr:127.0.0.2  Mask:255.0.0.0
>          UP LOOPBACK RUNNING  MTU:16436  Metric:1
>
>But When I ran sstableloader command it ended up with below error
>
>I nutch@lab02:/code/SST/apache-cassandra-0.8.6$ bin/sstableloader --debug -v /code/sstable0-cassandra-0.8.6/SSTableUploader/ipovw
>Starting client (and waiting 30 seconds for gossip) ...
>Streaming revelant part of
 /code/sstable0-cassandra-0.8.6/SSTableUploader/ipovw/ip-g-1-Data.db to [/172.27.15.4, /172.27.15.2,
/172.27.15.3]
>
>progress: [/172.27.15.4 0/0 (100)] [/172.27.15.2 0/1 (0)] [/172.27.15.3 0/0 (100)] [total:
0 - 0MB/s (avg: 0MB/s)] WARN 09:42:14,883 Failed attempt 1 to connect to /172.27.15.4 to stream
null. Retrying in 20000 ms. (java.net.SocketException: Invalid argument)
>progress: [/172.27.15.4 0/0 (100)] [/172.27.15.2 0/1 (0)] [/172.27.15.3 0/0 (100)] [total:
0 - 0MB/s (avg: 0MB/s)]
>
>
>When I issue, bin/nodetool --host <lab02/lab03/lab04> ring. I could see the ring
topology has formed. I am using Cassandra-0.8.6 version.
>
>Any suggestion would be appreciated.
>
>Regards,
>Thamizhannal P
>
>--- On Fri, 23/9/11, Benoit Perroud <benoit@noisette.ch> wrote:
>
>
>>From: Benoit Perroud <benoit@noisette.ch>
>>Subject: Re: Bulk uploader issue on multi-node cluster
>>To: user@cassandra.apache.org
>>Date: Friday, 23 September, 2011, 9:01 PM
>>
>>
>>On the sstableloader config, make sure you have the seed set and rpc_address and rpc_port
pointing to your cassandra instance (127.0.0.2) 
>>
>>
>>
>>
>>
>>2011/9/23 Thamizh <tcegrid@yahoo.co.in>
>>
>>Hi All,
>>>
>>>I am using bulk-loading to upload data(from lab02) to multi-node cluster of 3
machines(lab02,lab03 & lab04) with sigle ethernet card. I have created SSTable instance
on lab02 by duplicating look back address( sudo ifconfig lo:2 127.0.0.2 netmask 255.0.0.0
up; ) "127.0.0.2" as rpc and storage address. Here 'sstableloader' ended up with below error
message,
>>>
>>>Starting client (and waiting 30 seconds for gossip) ...
>>>java.lang.IllegalStateException: Cannot load any sstable, no live member found
in the cluster
>>>
>>>Here, in my case, Does lab02 machine should have 2 ethernet card(one for cassandra
original instance and another for 'sstableloader') ?
>>>
>>>Regards,
>>>Thamizhannal
>>> 
>> 
Mime
View raw message