cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tyler Hobbs <ty...@riptano.com>
Subject Re: casssandra 0.7beta3, pycassa and windows client timestamps
Date Thu, 18 Nov 2010 22:43:29 GMT
Ouch.  Thanks for taking the time to handle that.

- Tyler

On Thu, Nov 18, 2010 at 4:29 PM, Dr. Andrew Perella <ajp@eutechnyx.com>wrote:

> Actually it turns out there is a submitted patch for this already from
> January 2009 but it was never accepted due to a complaint about an
> unnecessary cast! I have modified and resubmitted the patch.
>
>
> -----Original Message-----
> From: Dr. Andrew Perella [mailto:ajp@eutechnyx.com]
> Sent: 18 November 2010 21:40
> To: user@cassandra.apache.org
> Subject: RE: casssandra 0.7beta3, pycassa and windows client timestamps
>
> Thanks for the reminder - I will submit the patch :)
> -----Original Message-----
> From: Jonathan Ellis [mailto:jbellis@gmail.com]
> Sent: 18 November 2010 21:37
> To: user
> Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
>
> Interesting!
>
> Did you post your patch to the Thrift project?
>
> On Thu, Nov 18, 2010 at 2:13 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> wrote:
> > UPDATE:  Solved
> >
> >
> >
> > After digging deeper I realised that I had patched fastbinary incorrectly
> > for compiling under visual studio on windows and was left with the wrong
> > endian define.
> >
> > As the app often worked it never crossed my mind to check this out!
> >
> > Many thanks Tyler for all your suggestions.
> >
> >
> >
> > Regards,
> >
> > Andrew
> >
> >
> >
> >
> >
> >
> >
> > From: Tyler Hobbs [mailto:tyler@riptano.com]
> > Sent: 18 November 2010 00:00
> > To: user@cassandra.apache.org
> > Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
> >
> >
> >
> > No, there's no client side caching.
> >
> > Assuming you're using insert(), could you capture both of these:
> >  - the return value of insert()
> >  - the same thing you captured before in the Cassandra log
> >
> > so that we can verify that the timestamp is greater than what's stored in
> > Cassandra?
> >
> >  Tyler
> >
> > On Wed, Nov 17, 2010 at 5:49 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> > wrote:
> >
> > Oh - that was unexpected! I am using pycassa 0.5.2 and thrift 0.5.0
> >
> > I wasn't aware any client side caching would take place?
> >
> >
> >
> >
> >
> >
> >
> > From: Tyler Hobbs [mailto:tyler@riptano.com]
> > Sent: 17 November 2010 23:34
> >
> > To: user@cassandra.apache.org
> > Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
> >
> >
> >
> > Well, the write appears to be succeeding, and since you say this works on
> > Linux, it sounds like a client side problem.
> >
> > Are you using pycassa or are you dealing with raw Thrift.  If pycassa,
> what
> > version?
> >
> > - Tyler
> >
> > On Wed, Nov 17, 2010 at 5:02 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> > wrote:
> >
> > Thanks Tyler - here is the log when I call this:
> >
> >
> >
> >
> >
> > DEBUG 22:59:42,914 get_slice
> >
> > DEBUG 22:59:42,915 strongread reading data for
> > SliceFromReadCommand(table='ACRKeyspace_purify', key='31',
> > column_parent='QueryPath(columnFamilyName='UserOwnedCars',
> > superColumnName='null', columnName='null')', start='', finish='',
> > reversed=false, count=100) from 93@localhost/127.0.0.1
> >
> > DEBUG 22:59:42,916 collecting 0 of 100: 2885:false:32@592255573044823040
> >
> > DEBUG 22:59:42,916 collecting 1 of 100: 3272:false:32@2320511930048250880
> >
> > DEBUG 22:59:42,917 collecting 2 of 100: 3363:false:32@592255573044823040
> >
> > DEBUG 22:59:42,917 collecting 3 of 100:
> > currentCarUID:false:32@8670115967555404800
> >
> > DEBUG 22:59:42,917 Read key java.nio.HeapByteBuffer[pos=0 lim=1 cap=1];
> > sending response to 282F307A-0B07-7B07-C340-88E847BEF430@localhost/
> 127.0.0.1
> >
> > DEBUG 22:59:42,917 Processing response on a callback from
> > 282F307A-0B07-7B07-C340-88E847BEF430@localhost/127.0.0.1
> >
> > DEBUG 22:59:42,917 resolving 1 responses
> >
> > DEBUG 22:59:42,917 resolve: 0 ms.
> >
> > DEBUG 22:59:42,917 quorumResponseHandler: 1 ms.
> >
> > DEBUG 22:59:42,930 batch_mutate
> >
> > DEBUG 22:59:42,931 insert writing local
> > RowMutation(keyspace='ACRKeyspace_purify', key='31',
> > modifications=[UserOwnedCars])
> >
> > DEBUG 22:59:42,935 get_slice
> >
> > DEBUG 22:59:42,936 strongread reading data for
> > SliceFromReadCommand(table='ACRKeyspace_purify', key='31',
> > column_parent='QueryPath(columnFamilyName='UserOwnedCars',
> > superColumnName='null', columnName='null')', start='', finish='',
> > reversed=false, count=100) from 95@localhost/127.0.0.1
> >
> > DEBUG 22:59:42,936 collecting 0 of 100: 2885:false:32@592255573044823040
> >
> > DEBUG 22:59:42,936 collecting 1 of 100: 3272:false:32@2320511930048250880
> >
> > DEBUG 22:59:42,936 collecting 2 of 100: 3363:false:32@592255573044823040
> >
> > DEBUG 22:59:42,936 collecting 3 of 100:
> > currentCarUID:false:32@8670115967555404800
> >
> > DEBUG 22:59:42,937 Read key java.nio.HeapByteBuffer[pos=0 lim=1 cap=1];
> > sending response to 32E4F8F8-2DF0-8803-EBB6-AC2EAF2E55D5@localhost/
> 127.0.0.1
> >
> > DEBUG 22:59:42,937 Processing response on a callback from
> > 32E4F8F8-2DF0-8803-EBB6-AC2EAF2E55D5@localhost/127.0.0.1
> >
> > DEBUG 22:59:42,937 resolving 1 responses
> >
> > DEBUG 22:59:42,937 resolve: 0 ms.
> >
> > DEBUG 22:59:42,937 quorumResponseHandler: 0 ms.
> >
> >
> >
> >
> >
> > From: Tyler Hobbs [mailto:tyler@riptano.com]
> > Sent: 17 November 2010 22:56
> >
> > To: user@cassandra.apache.org
> > Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
> >
> >
> >
> > Can you turn on debug logging on Cassandra (change INFO to debug in
> > conf/log4j-server.properties) and see what happens when you send a write
> > that doesn't seem to have an effect?
> >
> > - Tyler
> >
> > On Wed, Nov 17, 2010 at 4:40 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> > wrote:
> >
> > The value I want to change is:
> >
> >
> >
> > ColumnOrSuperColumn(column=Column(timestamp=1290033433618000L,
> > name='currentCarUID', value='82b50f91663f42ee8a740447efa1bdae',
> ttl=None),
> > super_column=None)
> >
> >
> >
> > and I try to overwrite it with:
> >
> >
> >
> > Mutation(column_or_supercolumn=
> >
> > ColumnOrSuperColumn(column=Column(timestamp=1290033474541000L,
> > name=u'currentCarUID', value='e7d0cac632134c479110b6f0bb5ca6ea',
> ttl=None),
> > super_column=None), deletion=None)
> >
> >
> >
> > I am just running a single node test machine.
> >
> >
> >
> > I am using it to run multiple keyspaces for other services (from other
> > clients) if that might be relevant at all.
> >
> >
> >
> >
> >
> > From: Tyler Hobbs [mailto:tyler@riptano.com]
> > Sent: 17 November 2010 22:33
> >
> > To: user@cassandra.apache.org
> > Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
> >
> >
> >
> > Can you give me an example of what your writes look like here?
> >
> > Are you running a multinode cluster or just one instance of Cassandra?
> >
> > - Tyler
> >
> > On Wed, Nov 17, 2010 at 4:30 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> > wrote:
> >
> > Miliseconds - but that's not the problem - I can wait 10 minutes and
> still
> > not get the value updated!  Other times I can update many times a second
> -
> > it just seems random!
> >
> >
> >
> > From: Tyler Hobbs [mailto:tyler@riptano.com]
> > Sent: 17 November 2010 22:28
> > To: user@cassandra.apache.org
> > Subject: Re: casssandra 0.7beta3, pycassa and windows client timestamps
> >
> >
> >
> > What resolution does time.time() give you in Windows?
> >
> > - Tyler
> >
> > On Wed, Nov 17, 2010 at 4:23 PM, Dr. Andrew Perella <ajp@eutechnyx.com>
> > wrote:
> >
> > I have encountered a strange problem with values not being written to
> > Cassandra very often.
> >
> > It looks like it is a windows client timestamp problem. I cannot detect a
> > pattern as to when a timestamp will allow an update however if I run my
> > client (in a web server) on linux then the problem goes away.
> >
> >
> >
> > Has anyone seen anything like this or will I need to delve deeper into
> > thift?
> >
> >
> >
> > FYI I am using pythons int(time.time()*1e6) as a timestamp
> >
> >
> >
> > Best Regards,
> >
> > Andrew
> >
> > This e-mail is confidential and may be privileged. It may be read, copied
> > and used only by the intended recipient. No communication sent by e-mail
> to
> > or from Eutechnyx is intended to give rise to contractual or other legal
> > liability, apart from liability which cannot be excluded under English
> law.
> >
> > This email has been scanned for all known viruses by www.epagency.net.
> >
> > www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
> >
> >
> >
> > This email has been scanned for all known viruses by the Email Protection
> > Agency
> >
> > This e-mail is confidential and may be privileged. It may be read, copied
> > and used only by the intended recipient. No communication sent by e-mail
> to
> > or from Eutechnyx is intended to give rise to contractual or other legal
> > liability, apart from liability which cannot be excluded under English
> law.
> >
> > This email has been scanned for all known viruses by www.epagency.net.
> >
> > www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
> >
> >
> >
> > This email has been scanned for all known viruses by the Email Protection
> > Agency
> >
> > This e-mail is confidential and may be privileged. It may be read, copied
> > and used only by the intended recipient. No communication sent by e-mail
> to
> > or from Eutechnyx is intended to give rise to contractual or other legal
> > liability, apart from liability which cannot be excluded under English
> law.
> >
> > This email has been scanned for all known viruses by www.epagency.net.
> >
> > www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
> >
> >
> >
> > This email has been scanned for all known viruses by the Email Protection
> > Agency
> >
> > This e-mail is confidential and may be privileged. It may be read, copied
> > and used only by the intended recipient. No communication sent by e-mail
> to
> > or from Eutechnyx is intended to give rise to contractual or other legal
> > liability, apart from liability which cannot be excluded under English
> law.
> >
> > This email has been scanned for all known viruses by www.epagency.net.
> >
> > www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
> >
> >
> >
> > This email has been scanned for all known viruses by the Email Protection
> > Agency
> >
> > This e-mail is confidential and may be privileged. It may be read, copied
> > and used only by the intended recipient. No communication sent by e-mail
> to
> > or from Eutechnyx is intended to give rise to contractual or other legal
> > liability, apart from liability which cannot be excluded under English
> law.
> >
> > This email has been scanned for all known viruses by www.epagency.net.
> >
> > www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
> >
> >
> >
> > This email has been scanned for all known viruses by the Email Protection
> > Agency
> >
> > This e-mail is confidential and may be privileged. It may be read, copied
> > and used only by the intended recipient. No communication sent by e-mail
> to
> > or from Eutechnyx is intended to give rise to contractual or other legal
> > liability, apart from liability which cannot be excluded under English
> law.
> >
> > This email has been scanned for all known viruses by www.epagency.net.
> >
> > www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
> This email has been scanned for all known viruses by the Email Protection
> Agency.
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by the Email Protection
> Agency. http://www.epagency.net
>
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
> This email has been scanned for all known viruses by the Email Protection
> Agency.
> This e-mail is confidential and may be privileged. It may be read, copied
> and used only by the intended recipient. No communication sent by e-mail to
> or from Eutechnyx is intended to give rise to contractual or other legal
> liability, apart from liability which cannot be excluded under English law.
>
> This email has been scanned for all known viruses by the Email Protection
> Agency. http://www.epagency.net
>
>
> www.eutechnyx.com Eutechnyx Limited. Registered in England No: 2172322
>

Mime
View raw message