cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Wick (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-9324) Map Mutation rejected by Cassandra: IllegalArgumentException
Date Thu, 07 May 2015 16:34:00 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532957#comment-14532957
] 

Mark Wick commented on CASSANDRA-9324:
--------------------------------------

Sure - here's the cql3 create table statement (I've removed the other non-key columns for
brevity's sake):


CREATE TABLE points (
	name ascii,
	id varint,
    attributes map<ascii,ascii>,
    PRIMARY KEY(name, id)
)
WITH CLUSTERING ORDER BY(id ASC);





Here's a snippet of the c++ used to generate the mutation (with minor refactoring to removing
product information):
for(TSPoint::Attributes::const_iterator it = point->get_metadata_itr_begin(); it != point->get_metadata_itr_end();
it++)
	{
		CompositeColumnList name_parts;
		name_parts.push_back(&id_v);
		std::string attributes_s("attributes");
                //CassValue is our own class which encodes various types to the bytes Cassandra
expects
                //It is unchanged since our migration from 2.0.14
		CassValue attributes_name_v(attributes_s);
		name_parts.push_back(&attributes_name_v);
		CassValue name_v(it->first);
		name_parts.push_back(&name_v);

		CassValue item(it->second);

		OSII_TIME_T current_time_ms = utc_time_ms();

		Mutation m;
		m.column_or_supercolumn.column.name = encode_values(name_parts);
		m.column_or_supercolumn.column.value = item.stringValue();
		m.column_or_supercolumn.column.timestamp = current_time_ms * 1000;
		m.__isset.column_or_supercolumn = true;
		m.column_or_supercolumn.__isset.column = true;
		m.column_or_supercolumn.column.__isset.value = true;
		m.column_or_supercolumn.column.__isset.timestamp = true;

		//...code ommited for storage / sending of the Mutation after it's been created
	}

//here's the function to encode the composite column, which is used successfully for our other
mutations with no errors, and which is unchanged from when this worked in 2.0.14
std::string CassandraConnection::encode_values(CompositeColumnList & values)
{
	std::string result;
	result.reserve(values.size() * 10);//approximate, for efficiency only
	for(CompositeColumnList::iterator it = values.begin(); it != values.end(); it++)
	{
		//Encode value - size then data
                //encode_int16_to_string just stores the raw bytes in a std::string, as the
thrift API expects for byte arrays/buffers
		result += encode_int16_to_string((OSII_UINT16)(*it)->size());
		result += (*it)->stringValue();
		result += '\0';
	}
	return result;
}

> Map Mutation rejected by Cassandra: IllegalArgumentException
> ------------------------------------------------------------
>
>                 Key: CASSANDRA-9324
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-9324
>             Project: Cassandra
>          Issue Type: Bug
>          Components: API
>         Environment: Windows 7, Cassandra 2.1.5
>            Reporter: Mark Wick
>            Priority: Minor
>             Fix For: 2.1.x
>
>
> We use a collection (map<ascii,ascii>) in a CQL3 table. We write into that cql3
table using thrift mutations, from a c++ application. We are prototyping migrating from our
current Cassandra (2.0.7) to 2.1.5, and are unable to write rows to this cql3 table. We have
no problems when we remove the writes to the map column, and all other writes succeed in this
case. Cassandra is rejecting our writes and we are catching a TTransportException (no more
data to read). The below call stack is from the Cassandra instance that is rejecting the write.
> {code}
> ERROR 14:08:10 Error occurred during processing of message.
> java.lang.IllegalArgumentException: null
>         at java.nio.Buffer.limit(Unknown Source) ~[na:1.7.0_71]
>         at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:543)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.serializers.CollectionSerializer.readValue(CollectionSerializer.java:124)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.serializers.MapSerializer.validateForNativeProtocol(MapSerializer.java:80)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.serializers.CollectionSerializer.validate(CollectionSerializer.java:61)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.db.marshal.AbstractType.validate(AbstractType.java:97)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.ThriftValidation.validateColumnData(ThriftValidation.java:449)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.ThriftValidation.validateColumnOrSuperColumn(ThriftValidation.java:318)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.ThriftValidation.validateMutation(ThriftValidation.java:385)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.CassandraServer.createMutationList(CassandraServer.java:861)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:976)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3996)
~[apache-cassandra-thrift-2.1.5.jar:2.1.5]
>         at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3980)
~[apache-cassandra-thrift-2.1.5.jar:2.1.5]
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) ~[libthrift-0.9.2.jar:0.9.2]
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) ~[libthrift-0.9.2.jar:0.9.2]
>         at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:205)
~[apache-cassandra-2.1.5.jar:2.1.5]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_71]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_71]
>         at java.lang.Thread.run(Unknown Source) [na:1.7.0_71]{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message