cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Ellis <jbel...@gmail.com>
Subject Re: casssandra 0.7beta3, pycassa and windows client timestamps
Date Thu, 18 Nov 2010 21:37:09 GMT
Interesting!

Did you post your patch to the Thrift project?

On Thu, Nov 18, 2010 at 2:13 PM, Dr. Andrew Perella <ajp@eutechnyx.com> wrote:
> UPDATE:  Solved
>
>
>
> After digging deeper I realised that I had patched fastbinary incorrectly
> for compiling under visual studio on windows and was left with the wrong
> endian define.
>
> As the app often worked it never crossed my mind to check this out!
>
> Many thanks Tyler for all your suggestions.
>
>
>
> Regards,
>
> Andrew
>
>
>
>
>
>
>
> From: Tyler Hobbs [mailto:tyler@riptano.com]
> Sent: 18 November 2010 00:00
> To: user@cassandra.apache.org
> Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
>
>
>
> No, there's no client side caching.
>
> Assuming you're using insert(), could you capture both of these:
>  - the return value of insert()
>  - the same thing you captured before in the Cassandra log
>
> so that we can verify that the timestamp is greater than what's stored in
> Cassandra?
>
>  Tyler
>
> On Wed, Nov 17, 2010 at 5:49 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> wrote:
>
> Oh – that was unexpected! I am using pycassa 0.5.2 and thrift 0.5.0
>
> I wasn’t aware any client side caching would take place?
>
>
>
>
>
>
>
> From: Tyler Hobbs [mailto:tyler@riptano.com]
> Sent: 17 November 2010 23:34
>
> To: user@cassandra.apache.org
> Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
>
>
>
> Well, the write appears to be succeeding, and since you say this works on
> Linux, it sounds like a client side problem.
>
> Are you using pycassa or are you dealing with raw Thrift.  If pycassa, what
> version?
>
> - Tyler
>
> On Wed, Nov 17, 2010 at 5:02 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> wrote:
>
> Thanks Tyler – here is the log when I call this:
>
>
>
>
>
> DEBUG 22:59:42,914 get_slice
>
> DEBUG 22:59:42,915 strongread reading data for
> SliceFromReadCommand(table='ACRKeyspace_purify', key='31',
> column_parent='QueryPath(columnFamilyName='UserOwnedCars',
> superColumnName='null', columnName='null')', start='', finish='',
> reversed=false, count=100) from 93@localhost/127.0.0.1
>
> DEBUG 22:59:42,916 collecting 0 of 100: 2885:false:32@592255573044823040
>
> DEBUG 22:59:42,916 collecting 1 of 100: 3272:false:32@2320511930048250880
>
> DEBUG 22:59:42,917 collecting 2 of 100: 3363:false:32@592255573044823040
>
> DEBUG 22:59:42,917 collecting 3 of 100:
> currentCarUID:false:32@8670115967555404800
>
> DEBUG 22:59:42,917 Read key java.nio.HeapByteBuffer[pos=0 lim=1 cap=1];
> sending response to 282F307A-0B07-7B07-C340-88E847BEF430@localhost/127.0.0.1
>
> DEBUG 22:59:42,917 Processing response on a callback from
> 282F307A-0B07-7B07-C340-88E847BEF430@localhost/127.0.0.1
>
> DEBUG 22:59:42,917 resolving 1 responses
>
> DEBUG 22:59:42,917 resolve: 0 ms.
>
> DEBUG 22:59:42,917 quorumResponseHandler: 1 ms.
>
> DEBUG 22:59:42,930 batch_mutate
>
> DEBUG 22:59:42,931 insert writing local
> RowMutation(keyspace='ACRKeyspace_purify', key='31',
> modifications=[UserOwnedCars])
>
> DEBUG 22:59:42,935 get_slice
>
> DEBUG 22:59:42,936 strongread reading data for
> SliceFromReadCommand(table='ACRKeyspace_purify', key='31',
> column_parent='QueryPath(columnFamilyName='UserOwnedCars',
> superColumnName='null', columnName='null')', start='', finish='',
> reversed=false, count=100) from 95@localhost/127.0.0.1
>
> DEBUG 22:59:42,936 collecting 0 of 100: 2885:false:32@592255573044823040
>
> DEBUG 22:59:42,936 collecting 1 of 100: 3272:false:32@2320511930048250880
>
> DEBUG 22:59:42,936 collecting 2 of 100: 3363:false:32@592255573044823040
>
> DEBUG 22:59:42,936 collecting 3 of 100:
> currentCarUID:false:32@8670115967555404800
>
> DEBUG 22:59:42,937 Read key java.nio.HeapByteBuffer[pos=0 lim=1 cap=1];
> sending response to 32E4F8F8-2DF0-8803-EBB6-AC2EAF2E55D5@localhost/127.0.0.1
>
> DEBUG 22:59:42,937 Processing response on a callback from
> 32E4F8F8-2DF0-8803-EBB6-AC2EAF2E55D5@localhost/127.0.0.1
>
> DEBUG 22:59:42,937 resolving 1 responses
>
> DEBUG 22:59:42,937 resolve: 0 ms.
>
> DEBUG 22:59:42,937 quorumResponseHandler: 0 ms.
>
>
>
>
>
> From: Tyler Hobbs [mailto:tyler@riptano.com]
> Sent: 17 November 2010 22:56
>
> To: user@cassandra.apache.org
> Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
>
>
>
> Can you turn on debug logging on Cassandra (change INFO to debug in
> conf/log4j-server.properties) and see what happens when you send a write
> that doesn't seem to have an effect?
>
> - Tyler
>
> On Wed, Nov 17, 2010 at 4:40 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> wrote:
>
> The value I want to change is:
>
>
>
> ColumnOrSuperColumn(column=Column(timestamp=1290033433618000L,
> name='currentCarUID', value='82b50f91663f42ee8a740447efa1bdae', ttl=None),
> super_column=None)
>
>
>
> and I try to overwrite it with:
>
>
>
> Mutation(column_or_supercolumn=
>
> ColumnOrSuperColumn(column=Column(timestamp=1290033474541000L,
> name=u'currentCarUID', value='e7d0cac632134c479110b6f0bb5ca6ea', ttl=None),
> super_column=None), deletion=None)
>
>
>
> I am just running a single node test machine.
>
>
>
> I am using it to run multiple keyspaces for other services (from other
> clients) if that might be relevant at all.
>
>
>
>
>
> From: Tyler Hobbs [mailto:tyler@riptano.com]
> Sent: 17 November 2010 22:33
>
> To: user@cassandra.apache.org
> Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
>
>
>
> Can you give me an example of what your writes look like here?
>
> Are you running a multinode cluster or just one instance of Cassandra?
>
> - Tyler
>
> On Wed, Nov 17, 2010 at 4:30 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> wrote:
>
> Miliseconds – but that’s not the problem – I can wait 10 minutes and still
> not get the value updated!  Other times I can update many times a second –
> it just seems random!
>
>
>
> From: Tyler Hobbs [mailto:tyler@riptano.com]
> Sent: 17 November 2010 22:28
> To: user@cassandra.apache.org
> Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
>
>
>
> What resolution does time.time() give you in Windows?
>
> - Tyler
>
> On Wed, Nov 17, 2010 at 4:23 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> wrote:
>
> I have encountered a strange problem with values not being written to
> Cassandra very often.
>
> It looks like it is a windows client timestamp problem. I cannot detect a
> pattern as to when a timestamp will allow an update however if I run my
> client (in a web server) on linux then the problem goes away.
>
>
>
> Has anyone seen anything like this or will I need to delve deeper into
> thift?
>
>
>
> FYI I am using pythons int(time.time()*1e6) as a timestamp
>
>
>
> Best Regards,
>
> Andrew
>
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by www.epagency.net.
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>
>
>
> This email has been scanned for all known viruses by the Email Protection
> Agency
>
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by www.epagency.net.
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>
>
>
> This email has been scanned for all known viruses by the Email Protection
> Agency
>
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by www.epagency.net.
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>
>
>
> This email has been scanned for all known viruses by the Email Protection
> Agency
>
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by www.epagency.net.
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>
>
>
> This email has been scanned for all known viruses by the Email Protection
> Agency
>
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by www.epagency.net.
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>
>
>
> This email has been scanned for all known viruses by the Email Protection
> Agency
>
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by www.epagency.net.
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com

Mime
View raw message