incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mobiledream...@gmail.com
Subject Re: keys and column names cannot be utf-8
Date Wed, 22 Jul 2009 17:33:44 GMT
Still gives error - x.search and x.related are unicode words and when they
are used as key or column name the following erros come up

 x.search
Out[5]: u'\ucd5c\uc9c4\uc2e4 \uc774\ud63c'
In [6]: x.related
Out[6]: u'\ucd5c\uc9c4\uc2e4 \uc774\ud63c'
In [7]: client.insert('Table1', x.search, ColumnPath('Super1', 'Related',
x.related), pickle.dumps(dict(count=1)), time.time(), 0)
ERROR: An unexpected error occurred while tokenizing input
The following traceback may be corrupted or invalid
The error message is: ('EOF in multi-line statement', (1149, 0))

---------------------------------------------------------------------------
TApplicationException                     Traceback (most recent call last)

/home/mark/<ipython console> in <module>()

/home/mark/work/common/cassandra/Cassandra.pyc in insert(self, table, key,
column_path, value, timestamp, block_for)
    359     """
    360     self.send_insert(table, key, column_path, value, timestamp,
block_for)
--> 361     self.recv_insert()
    362
    363   def send_insert(self, table, key, column_path, value, timestamp,
block_for):

/home/mark/work/common/cassandra/Cassandra.pyc in recv_insert(self)
    380       x.read(self._iprot)
    381       self._iprot.readMessageEnd()
--> 382       raise x
    383     result = insert_result()
    384     result.read(self._iprot)

TApplicationException: Internal error processing insert




INFO - Cassandra starting up...
DEBUG - insert
ERROR - Internal error processing insert
java.lang.NullPointerException
        at
org.apache.cassandra.service.ThriftValidation.validateColumnPath(ThriftValidation.java:61)
        at
org.apache.cassandra.service.CassandraServer.insert(CassandraServer.java:262)
        at
org.apache.cassandra.service.Cassandra$Processor$insert.process(Cassandra.java:927)
        at
org.apache.cassandra.service.Cassandra$Processor.process(Cassandra.java:796)
        at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:252)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)



On Tue, Jul 21, 2009 at 3:04 PM, Jonathan Ellis <jbellis@gmail.com> wrote:

> did you check to make sure all the nodes were running and had no
> exceptions in their logs?
>
> On Tue, Jul 21, 2009 at 4:46 PM, <mobiledreamers@gmail.com> wrote:
> > Strange this happened. in the 4 server nodes that run cassandra, the conf
> > file had
> > ConfA
> > <ColumnFamily ColumnSort="Name"
> > Name="Standard1"  FlushPeriodInMinutes="60"/>
> > <ColumnFamily ColumnSort="Name"  Name="Standard2"/>
> > <ColumnFamily ColumnSort="Time"  Name="StandardByTime1"/>
> > <ColumnFamily ColumnType="Super"   Name="Super1"/>
> > I changed it to the following and doing nodeprobe after restarting
> > cassandra, the other 3 nodes are down,
> > ConfB
> > <ColumnFamily ColumnSort="Name"
> > Name="Standard1"  CompareWith="UTF8Type" FlushPeriodInMinutes="60"/>
> > <ColumnFamily
> ColumnSort="Name"  CompareWith="UTF8Type" Name="Standard2"/>
> > <ColumnFamily
> > ColumnSort="Time"  CompareWith="UTF8Type" Name="StandardByTime1"/>
> > <ColumnFamily ColumnType="Super" CompareWith="UTF8Type"
> > CompareSubcolumnsWith="UTF8Type" Name="Super1"/>
> > If i revert ConfB and set ConfA, all 4 nodes show up in nodeprobe in all
> the
> > 4 nodes
> > I m unsure how to debug this
> > On Tue, Jul 21, 2009 at 2:32 PM, <mobiledreamers@gmail.com> wrote:
> >>
> >> if this would be the conf/storage-conf.xml
> >> <ColumnFamily ColumnSort="Name"
> >> Name="Standard1"  CompareWith="UTF8Type" FlushPeriodInMinutes="60"/>
> >> <ColumnFamily
> ColumnSort="Name"  CompareWith="UTF8Type" Name="Standard2"/>
> >> <ColumnFamily
> >> ColumnSort="Time"  CompareWith="UTF8Type" Name="StandardByTime1"/>
> >> <ColumnFamily ColumnType="Super" CompareWith="UTF8Type"
> >> CompareSubcolumnsWith="UTF8Type" Name="Super1"/>
> >> Jonathan can you clarify if this will guarantee proper python thrift
> utf8
> >> behavior thanks
> >> On Tue, Jul 21, 2009 at 2:29 PM, Jonathan Ellis <jbellis@gmail.com>
> wrote:
> >>>
> >>> you may also want to specify CompareSubcolumnsWith.
> >>>
> >>> On Tue, Jul 21, 2009 at 4:27 PM, <mobiledreamers@gmail.com> wrote:
> >>> > thanks jonathan
> >>> > trying this
> >>> > <ColumnFamily
> ColumnType="Super" CompareWith="UTF8Type" Name="Super1"/>
> >>> >
> >>> > On Tue, Jul 21, 2009 at 2:24 PM, Jonathan Ellis <jbellis@gmail.com>
> >>> > wrote:
> >>> >>
> >>> >> On Tue, Jul 21, 2009 at 4:21 PM, Jonathan Ellis<jbellis@gmail.com>
> >>> >> wrote:
> >>> >> >> does this work in python thrift
> >>> >> >
> >>> >> > probably not, given the thrift utf8 bugs.
> >>> >>
> >>> >> to correct myself: now that we are using binary data in the thrift
> api
> >>> >> it can't screw us over.  so yes, UTF8Type should be fine.
> >>> >
> >>> >
> >>> >
> >>> > --
> >>> > Bidegg worlds best auction site
> >>> > http://bidegg.com
> >>> >
> >>
> >>
> >>
> >> --
> >> Bidegg worlds best auction site
> >> http://bidegg.com
> >
> >
> >
> > --
> > Bidegg worlds best auction site
> > http://bidegg.com
> >
>
>



-- 
Bidegg worlds best auction site
http://bidegg.com

Mime
View raw message