Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of jacob.rhoden@me.com
 designates 17.158.232.237 as permitted sender)
From: Jacob Rhoden <jacob.rhoden@me.com>
Content-type: multipart/signed;
 boundary="Apple-Mail=_1E36EB35-16BB-4782-9AA4-8E37C66C14A5";
 protocol="application/pkcs7-signature"; micalg=sha1
Subject: Where to I start to get to the bottom of this WriteTimeout issue?
Message-id: <D8281011-ADA2-452F-8743-C82576CD2F73@me.com>
Date: Mon, 17 Feb 2014 12:01:42 +1100
To: Cassandra Users <user@cassandra.apache.org>
MIME-version: 1.0 (Mac OS X Mail 7.1 \(1827\))


--Apple-Mail=_1E36EB35-16BB-4782-9AA4-8E37C66C14A5
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

Hi Guys,

While doing a bulk load of data, incrementing counters based on log =
data, I am encountering a timeout exception. Im using the Datastax =
2.0-rc2 java driver. The driver is set up with both nodes as contact =
points. The keyspace is setup with replication factor =3D 2.

Is this an issue with the server not being able to keep up (ie server =
side config issue), or is this an issue with the client getting bored =
waiting for the server to respond? Either way, is there an easy config =
change I can make that would fix this?

    Exception in thread "main" =
com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra =
timeout during write query at consistency ONE (1 replica were required =
but only 0 acknowledged the write)
    	at =
com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeou=
tException.java:54)
    	at =
com.datastax.driver.core.ResultSetFuture.extractCauseFromExecutionExceptio=
n(ResultSetFuture.java:271)
    	at =
com.datastax.driver.core.ResultSetFuture.getUninterruptibly(ResultSetFutur=
e.java:187)
    	at com.datastax.driver.core.Session.execute(Session.java:126)
    	at jason.Stats.analyseLogMessages(Stats.java:91)
    	at jason.Stats.main(Stats.java:48)
    Caused by: =
com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra =
timeout during write query at consistency ONE (1 replica were required =
but only 0 acknowledged the write)
    	at =
com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeou=
tException.java:54)
    	at =
com.datastax.driver.core.Responses$Error.asException(Responses.java:92)
    	at =
com.datastax.driver.core.ResultSetFuture$ResponseCallback.onSet(ResultSetF=
uture.java:122)
    	at =
com.datastax.driver.core.RequestHandler.setFinalResult(RequestHandler.java=
:224)
    	at =
com.datastax.driver.core.RequestHandler.onSet(RequestHandler.java:373)
    	at =
com.datastax.driver.core.Connection$Dispatcher.messageReceived(Connection.=
java:510)
    	at =
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(Simple=
ChannelUpstreamHandler.java:70)
    	at =
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannel=
Pipeline.java:564)
    	at =
org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContex=
t.sendUpstream(DefaultChannelPipeline.java:791)
    	at =
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
    	at =
org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToO=
neDecoder.java:70)
    	at =
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannel=
Pipeline.java:564)
    	at =
org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContex=
t.sendUpstream(DefaultChannelPipeline.java:791)
    	at =
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
    	at =
org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageRecei=
ved(FrameDecoder.java:462)
    	at =
org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.j=
ava:443)
    	at =
org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDeco=
der.java:303)
    	at =
org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(Simple=
ChannelUpstreamHandler.java:70)
    	at =
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannel=
Pipeline.java:564)
    	at =
org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannel=
Pipeline.java:559)
    	at =
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268)
    	at =
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255)
    	at =
org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
    	at =
org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWo=
rker.java:109)
    	at =
org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSele=
ctor.java:312)
    	at =
org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker=
.java:90)
    	at =
org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
    	at =
org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.jav=
a:108)
    	at =
org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorke=
r.java:42)
    	at =
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:=
1145)
    	at =
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java=
:615)
    	at java.lang.Thread.run(Thread.java:744)
    Caused by: =
com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra =
timeout during write query at consistency ONE (1 replica were required =
but only 0 acknowledged the write)
    	at =
com.datastax.driver.core.Responses$Error$1.decode(Responses.java:53)
    	at =
com.datastax.driver.core.Responses$Error$1.decode(Responses.java:33)
    	at =
com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:165)
    	at =
org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToO=
neDecoder.java:66)
    	... 21 more

Thanks,
Jacob


--Apple-Mail=_1E36EB35-16BB-4782-9AA4-8E37C66C14A5
Content-Disposition: attachment;
	filename=smime.p7s
Content-Type: application/pkcs7-signature;
	name=smime.p7s
Content-Transfer-Encoding: base64

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIPKzCCBN0w
ggPFoAMCAQICEHGS++YZX6xNEoV0cTSiGKcwDQYJKoZIhvcNAQEFBQAwezELMAkGA1UEBhMCR0Ix
GzAZBgNVBAgMEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBwwHU2FsZm9yZDEaMBgGA1UECgwR
Q29tb2RvIENBIExpbWl0ZWQxITAfBgNVBAMMGEFBQSBDZXJ0aWZpY2F0ZSBTZXJ2aWNlczAeFw0w
NDAxMDEwMDAwMDBaFw0yODEyMzEyMzU5NTlaMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQx
FzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsx
ITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJz
dC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A
MIIBCgKCAQEAsjmFpPJ9q0E7YkY3rs3BYHW8OWX5ShpHornMSMxqmNVNNRm5pELlzkniii8efNIx
B8dOtINknS4p1aJkxIW9hVE1eaROaJB7HHqkkqgX8pgV8pPMyaQylbsMTzC9mKALi+VuG6JG+ni8
om+rWV6lL8/K2m2qL+usobNqqrcuZzWLeeEeaYji5kbNoKXqvgvOdjp6Dpvq/NonWz1zHyLmSGHG
TPNpsaguG7bUMSAsvIKKjqQOpdeJQ/wWWq8dcdcRWdq6hw2v+vPhwvCkxWeM1tZUOt4KpLoDd7Nl
yP0e03RiqhjKaJMeoYV+9Udly/hNVyh00jT/MLbu9mIwFIws6wIDAQABo4IBJzCCASMwHwYDVR0j
BBgwFoAUoBEKIz6W8Qfs4q8p74Klf9AwpLQwHQYDVR0OBBYEFImCZ33EnSZwAEu0UEh83j2uBG59
MA4GA1UdDwEB/wQEAwIBBjAPBgNVHRMBAf8EBTADAQH/MB0GA1UdJQQWMBQGCCsGAQUFBwMCBggr
BgEFBQcDBDARBgNVHSAECjAIMAYGBFUdIAAwewYDVR0fBHQwcjA4oDagNIYyaHR0cDovL2NybC5j
b21vZG9jYS5jb20vQUFBQ2VydGlmaWNhdGVTZXJ2aWNlcy5jcmwwNqA0oDKGMGh0dHA6Ly9jcmwu
Y29tb2RvLm5ldC9BQUFDZXJ0aWZpY2F0ZVNlcnZpY2VzLmNybDARBglghkgBhvhCAQEEBAMCAQYw
DQYJKoZIhvcNAQEFBQADggEBAJ2Vyzy4fqUJxB6/C8LHdo45PJTGEKpPDMngq4RdiVTgZTvzbRx8
NywlVF+WIfw3hJGdFdwUT4HPVB1rbEVgxy35l1FM+WbKPKCCjKbI8OLp1Er57D9Wyd12jMOCAU9s
APMeGmF0BEcDqcZAV5G8ZSLFJ2dPV9tkWtmNH7qGL/QGrpxp7en0zykX2OBKnxogL5dMUbtGB8SK
N04g4wkxaMeexIud6H4RvDJoEJYRmETYKlFgTYjrdDrfQwYyyDlWjDoRUtNBpEMD9O3vMyfbOeAU
TibJ2PU54om4k123KSZB6rObroP8d3XK6Mq1/uJlSmM+RMTQw16Hc6mYHK9/FX8wggUaMIIEAqAD
AgECAhBtGeqnGU9qMyLmIjJ6qnHeMA0GCSqGSIb3DQEBBQUAMIGuMQswCQYDVQQGEwJVUzELMAkG
A1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNU
IE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVRO
LVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMB4XDTExMDQyODAwMDAw
MFoXDTIwMDUzMDEwNDgzOFowgZMxCzAJBgNVBAYTAkdCMRswGQYDVQQIExJHcmVhdGVyIE1hbmNo
ZXN0ZXIxEDAOBgNVBAcTB1NhbGZvcmQxGjAYBgNVBAoTEUNPTU9ETyBDQSBMaW1pdGVkMTkwNwYD
VQQDEzBDT01PRE8gQ2xpZW50IEF1dGhlbnRpY2F0aW9uIGFuZCBTZWN1cmUgRW1haWwgQ0EwggEi
MA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCShIRbS1eY1F4vi6ThQMijU1hfZmXxMk73nzJ9
VdB4TFW3QpTg+SdxB8XGaaS5MsTxQBqQzCdWYn8XtXFpruUgG+TLY15gyqJB9mrho/+43x9IbWVD
jCouK2M4d9+xF6zC2oIC1tQyatRnbyATj1w1+uVUgK/YcQodNwoCUFNslR2pEBS0mZVZEjH/CaLS
TNxS297iQAFbSGjdxUq04O0kHzqvcV8H46y/FDuwJXFoPfQP1hdYRhWBPGiLi4MPbXohV+Y0sNsy
fuNK4aVScmQmkU6lkg//4LFg/RpvaFGZY40ai6XMQpubfSJj06mg/M6ekN9EGfRcWzW6FvOnm//B
AgMBAAGjggFLMIIBRzAfBgNVHSMEGDAWgBSJgmd9xJ0mcABLtFBIfN49rgRufTAdBgNVHQ4EFgQU
ehNOAHRbxnhjZCfBL+KgW7x5xXswDgYDVR0PAQH/BAQDAgEGMBIGA1UdEwEB/wQIMAYBAf8CAQAw
EQYDVR0gBAowCDAGBgRVHSAAMFgGA1UdHwRRME8wTaBLoEmGR2h0dHA6Ly9jcmwudXNlcnRydXN0
LmNvbS9VVE4tVVNFUkZpcnN0LUNsaWVudEF1dGhlbnRpY2F0aW9uYW5kRW1haWwuY3JsMHQGCCsG
AQUFBwEBBGgwZjA9BggrBgEFBQcwAoYxaHR0cDovL2NydC51c2VydHJ1c3QuY29tL1VUTkFkZFRy
dXN0Q2xpZW50X0NBLmNydDAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRydXN0LmNvbTAN
BgkqhkiG9w0BAQUFAAOCAQEAhda+eFdVbTN/RFL+QtUGqAEDgIr7DbL9Sr/2r0FJ9RtaxdKtG3Nu
PukmfOZMmMEwKN/L+0I8oSU+CnXW0D05hmbRoZu1TZtvryhsHa/l6nRaqNqxwPF1ei+eupN5yv7i
kR5WdLL4jdPgQ3Ib7Y/9YDkgR/uLrzplSDyYPaUlv73vYOBJ5RbI6z9Dg/Dg7g3B080zX5vQvWBq
szv++tTJOjwf7Zv/m0kzvkIpOYPuM2kugp1FTahp2oAbHj3SGl18R5mlmwhtEpmG1l1XBxunML5L
SUS4kH7K0Xk467Qz+qA6XSZYnmFVGLQh1ZnV4ENAQjC+6qXnlNKw/vN1+X9u5zCCBSgwggQQoAMC
AQICEQD/2yOHSO5oPiAE1MV7mhqDMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQGEwJHQjEbMBkG
A1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYDVQQKExFDT01P
RE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNhdGlvbiBhbmQg
U2VjdXJlIEVtYWlsIENBMB4XDTEzMTExMDAwMDAwMFoXDTE0MTExMDIzNTk1OVowJDEiMCAGCSqG
SIb3DQEJARYTamFjb2IucmhvZGVuQG1lLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoC
ggEBAKE8q0oVVWpp7NsRSWpeoDsUB530YHxSEQ259H7ggMhCylKxcWF2Jd8tpGgPmTdkRvBNaCBJ
oshoy7d/daQ5daUH+jviBk9DGf78mRqXrI+pmKOsLs7180vg7COAAQHtte/UyF9HtUiQ/4R7961A
kP2d0VSQdtUmP1T+Jhvnj9b7670lOM0I7frerVi3uqzhEgUgdBzg9QLc91xJ1TzrTv2tZ7wGvWgm
2xC+AJrNwxFfLXgonbbcGsOrB3KChjNrmrBiGuWUgfUtIN7swuvQEKczoXWzEL/Baw8R6VUrUzOj
QuN8UNvj/0Ei86um89owO7Iyo2UIZpHnNfqekLIfr2UCAwEAAaOCAeMwggHfMB8GA1UdIwQYMBaA
FHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBQMFd+vNfXkzC/g2Hb6b9pbsVhi/jAOBgNV
HQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggrBgEFBQcDBAYLKwYBBAGyMQED
BQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYBBAGyMQECAQEBMCswKQYIKwYB
BQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcGA1UdHwRQME4wTKBKoEiGRmh0
dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhlbnRpY2F0aW9uYW5kU2VjdXJl
RW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcwAoZGaHR0cDovL2NydC5jb21v
ZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRTZWN1cmVFbWFpbENBLmNydDAk
BggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMB4GA1UdEQQXMBWBE2phY29iLnJo
b2RlbkBtZS5jb20wDQYJKoZIhvcNAQEFBQADggEBAH1Ck00eWL4jojjMspBetsZkTXSZ0c94+PY5
TC6ZeEfpce0Q3fztIS9yrhzjBu9N2P/ng2E7Y2XtBIRSAb9d0umgBEGSWiLnCtICEN2NgVeVTpZQ
jKQuAXw1In4Nmhgc+pav7CaDPbCRi1FRCOrp27mixyQ0sO9E86aEy7LZUYdwIDQWT+ymB05hO+Lk
YAiMwFmqmVCo28aSrUmqcSo3MdaRf8f7eidNSx6OGNwGgip2WdRKe8iVjxnRwQD9PELMnP5Z5/k4
lL9Y/pfGHLhndI4qlLALbYDjCDo9sQb5odfPNGutdjHOGW0TzJHhMAqURl8Dy+T0FywUiKg2WStI
aBUxggOuMIIDqgIBATCBqTCBkzELMAkGA1UEBhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hl
c3RlcjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgGA1UEChMRQ09NT0RPIENBIExpbWl0ZWQxOTA3BgNV
BAMTMENPTU9ETyBDbGllbnQgQXV0aGVudGljYXRpb24gYW5kIFNlY3VyZSBFbWFpbCBDQQIRAP/b
I4dI7mg+IATUxXuaGoMwCQYFKw4DAhoFAKCCAdkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAc
BgkqhkiG9w0BCQUxDxcNMTQwMjE3MDEwMTQzWjAjBgkqhkiG9w0BCQQxFgQUMicoXSVnqxcB9vL0
+GFAtQRzPC0wgboGCSsGAQQBgjcQBDGBrDCBqTCBkzELMAkGA1UEBhMCR0IxGzAZBgNVBAgTEkdy
ZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgGA1UEChMRQ09NT0RPIENBIExp
bWl0ZWQxOTA3BgNVBAMTMENPTU9ETyBDbGllbnQgQXV0aGVudGljYXRpb24gYW5kIFNlY3VyZSBF
bWFpbCBDQQIRAP/bI4dI7mg+IATUxXuaGoMwgbwGCyqGSIb3DQEJEAILMYGsoIGpMIGTMQswCQYD
VQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRow
GAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50
aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBAhEA/9sjh0juaD4gBNTFe5oagzANBgkqhkiG9w0B
AQEFAASCAQAxO9hwAzRM8v/dsatmwKey0j6DnrY3qkU7gJCInFqmSx03NLiR3ivRzugm29IkJVbs
KYfh5s06723f4sR5j23XDC3ds0RbtBQLkTmeWzpQRAqDieIHaeO1/GzbMnabOFx74Odkm/nHJvF3
f0M+B7BpmLq4OjL+wTmPHortZFo+hNoAa44xSGAI/smXb6p+4uRF5x2d5u8eu7KJceQNc9YueDCG
s7wwHbcT+Qqrs/owTej3PqSnN/P4u0RWSwxswh4vaF9+B4RQnlsMSoQUq6QbCneWbBgrKpP+0JXJ
T9ERw+oojRTziIkSHzb4DBg1vLRIokzpU+F+DNwsBq9Y08uSAAAAAAAA

--Apple-Mail=_1E36EB35-16BB-4782-9AA4-8E37C66C14A5--