cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pranav Jindal (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-12700) During writing data into Cassandra 3.7.0 using Python driver 3.7 sometimes Connection get lost, because of Server NullPointerException
Date Tue, 20 Mar 2018 13:59:00 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16406360#comment-16406360
] 

Pranav Jindal edited comment on CASSANDRA-12700 at 3/20/18 1:58 PM:
--------------------------------------------------------------------

Using cassandra 3.10, facing below issue.

[~jjirsa] 
{code:java}
WARN [Native-Transport-Requests-1] 2018-03-20 13:37:17,894 CassandraRoleManager.java:96 -
An invalid value has been detected in the roles table for role utorjwcnruzzlzafxffgyqmlvkxiqcgb.
If you are unable to login, you may need to disable authentication and confirm that values
in that table are accurate
ERROR [Native-Transport-Requests-1] 2018-03-20 13:37:17,895 Message.java:623 - Unexpected
exception during request; channel = [id: 0xdfc3604f, L:/10.180.0.150:9042 - R:/10.180.0.150:51668]
java.lang.RuntimeException: Invalid metadata has been detected for role utorjwcnruzzlzafxffgyqmlvkxiqcgb
at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:99) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:82) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager.getRoleFromTable(CassandraRoleManager.java:528)
~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager.getRole(CassandraRoleManager.java:503) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager.canLogin(CassandraRoleManager.java:310)
~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.service.ClientState.login(ClientState.java:271) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.transport.messages.AuthResponse.execute(AuthResponse.java:80) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:517) [apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:410) [apache-cassandra-3.10.jar:3.10]
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:357)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_121]
at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) [apache-cassandra-3.10.jar:3.10]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
Caused by: java.lang.NullPointerException: null
at org.apache.cassandra.cql3.UntypedResultSet$Row.getBoolean(UntypedResultSet.java:273) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:88) ~[apache-cassandra-3.10.jar:3.10]
... 16 common frames omitted

{code}


was (Author: prnvjndl):
Using cassandra 3.10, facing below issue.

 
{code:java}
WARN [Native-Transport-Requests-1] 2018-03-20 13:37:17,894 CassandraRoleManager.java:96 -
An invalid value has been detected in the roles table for role utorjwcnruzzlzafxffgyqmlvkxiqcgb.
If you are unable to login, you may need to disable authentication and confirm that values
in that table are accurate
ERROR [Native-Transport-Requests-1] 2018-03-20 13:37:17,895 Message.java:623 - Unexpected
exception during request; channel = [id: 0xdfc3604f, L:/10.180.0.150:9042 - R:/10.180.0.150:51668]
java.lang.RuntimeException: Invalid metadata has been detected for role utorjwcnruzzlzafxffgyqmlvkxiqcgb
at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:99) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:82) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager.getRoleFromTable(CassandraRoleManager.java:528)
~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager.getRole(CassandraRoleManager.java:503) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager.canLogin(CassandraRoleManager.java:310)
~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.service.ClientState.login(ClientState.java:271) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.transport.messages.AuthResponse.execute(AuthResponse.java:80) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:517) [apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:410) [apache-cassandra-3.10.jar:3.10]
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:357)
[netty-all-4.0.39.Final.jar:4.0.39.Final]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_121]
at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) [apache-cassandra-3.10.jar:3.10]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
Caused by: java.lang.NullPointerException: null
at org.apache.cassandra.cql3.UntypedResultSet$Row.getBoolean(UntypedResultSet.java:273) ~[apache-cassandra-3.10.jar:3.10]
at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:88) ~[apache-cassandra-3.10.jar:3.10]
... 16 common frames omitted

{code}

> During writing data into Cassandra 3.7.0 using Python driver 3.7 sometimes Connection
get lost, because of Server NullPointerException
> --------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-12700
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-12700
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: Cassandra cluster with two nodes running C* version 3.7.0 and Python
Driver 3.7 using Python 2.7.11. 
> OS: Red Hat Enterprise Linux 6.x x64, 
> RAM :8GB
> DISK :210GB
> Cores: 2
> Java 1.8.0_73 JRE
>            Reporter: Rajesh Radhakrishnan
>            Assignee: Jeff Jirsa
>            Priority: Major
>             Fix For: 2.2.9, 3.0.10, 3.10
>
>
> In our C* cluster we are using the latest Cassandra 3.7.0 (datastax-ddc.3.70) with Python
driver 3.7. Trying to insert 2 million row or more data into the database, but sometimes we
are getting "Null pointer Exception". 
> We are using Python 2.7.11 and Java 1.8.0_73 in the Cassandra nodes and in the client
its Python 2.7.12.
> {code:title=cassandra server log}
> ERROR [SharedPool-Worker-6] 2016-09-23 09:42:55,002 Message.java:611 - Unexpected exception
during request; channel = [id: 0xc208da86, L:/IP1.IP2.IP3.IP4:9042 - R:/IP5.IP6.IP7.IP8:58418]
> java.lang.NullPointerException: null
>     at org.apache.cassandra.serializers.BooleanSerializer.deserialize(BooleanSerializer.java:33)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.serializers.BooleanSerializer.deserialize(BooleanSerializer.java:24)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.java:113) ~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.cql3.UntypedResultSet$Row.getBoolean(UntypedResultSet.java:273)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:85)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:81)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager.getRoleFromTable(CassandraRoleManager.java:503)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager.getRole(CassandraRoleManager.java:485)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager.canLogin(CassandraRoleManager.java:298)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.service.ClientState.login(ClientState.java:227) ~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.transport.messages.AuthResponse.execute(AuthResponse.java:79)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507)
[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401)
[apache-cassandra-3.7.0.jar:3.7.0]
>     at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:292)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:32)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:283)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_73]
>     at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164)
[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.0.jar:3.7.0]
>     at java.lang.Thread.run(Thread.java:745) [na:1.8.0_73]
> ERROR [SharedPool-Worker-1] 2016-09-23 09:42:56,238 Message.java:611 - Unexpected exception
during request; channel = [id: 0x8e2eae00, L:/IP1.IP2.IP3.IP4:9042 - R:/IP5.IP6.IP7.IP8:58421]
> java.lang.NullPointerException: null
>     at org.apache.cassandra.serializers.BooleanSerializer.deserialize(BooleanSerializer.java:33)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.serializers.BooleanSerializer.deserialize(BooleanSerializer.java:24)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.java:113) ~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.cql3.UntypedResultSet$Row.getBoolean(UntypedResultSet.java:273)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:85)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRoleManager.java:81)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager.getRoleFromTable(CassandraRoleManager.java:503)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager.getRole(CassandraRoleManager.java:485)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.auth.CassandraRoleManager.canLogin(CassandraRoleManager.java:298)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.service.ClientState.login(ClientState.java:227) ~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.transport.messages.AuthResponse.execute(AuthResponse.java:79)
~[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507)
[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401)
[apache-cassandra-3.7.0.jar:3.7.0]
>     at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:292)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:32)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:283)
[netty-all-4.0.36.Final.jar:4.0.36.Final]
>     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_73]
>     at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164)
[apache-cassandra-3.7.0.jar:3.7.0]
>     at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.0.jar:3.7.0]
>     at java.lang.Thread.run(Thread.java:745) [na:1.8.0_73]
> {code}
> {code:title=python client error}
> Traceback (most recent call last):
>  File "vssandra_v5.py", line 132, in <module>
>    db.insert_batch()
>  File "vssandra_v5.py", line 60, in insert_batch
>    self.session.execute(self.batch, timeout=None)
>  File "cassandra/cluster.py", line 1998, in cassandra.cluster.Session.execute (cassandra/cluster.c:34869)
>  File "cassandra/cluster.py", line 3781, in cassandra.cluster.ResponseFuture.result (cassandra/cluster.c:73073)
> cassandra.protocol.ServerError: <Error from server: code=0000 [Server error] message="com.google.common.util.concurrent.UncheckedExecutionException:
com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException">
> {code}
> {code:title=cassandra config}
>  Node configuration:[allocate_tokens_for_keyspace=null; authenticator=PasswordAuthenticator;
authorizer=CassandraAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=100;
batch_size_warn_threshold_in_kb=10; batchlog_replay_throttle_in_kb=1024; broadcast_address=null;
broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=5000;
client_encryption_options=<REDACTED>; cluster_name=VCF Stress Cluster; column_index_cache_size_in_kb=2;
column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=null;
commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32;
commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000;
commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=150; compaction_throughput_mb_per_sec=20;
concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32;
concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647;
counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000;
credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000;
cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@36fc695d; disk_access_mode=auto;
disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1;
disk_optimization_strategy=spinning; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1;
dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false;
enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null;
endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[];
hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=null;
hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null;
index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200;
inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=dc; internode_recv_buff_size_in_bytes=null;
internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400;
key_cache_size_in_mb=null; listen_address=IP.251; listen_interface=null; listen_interface_prefer_ipv6=false;
listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2;
max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256;
memtable_allocation_type=offheap_objects; memtable_cleanup_threshold=null; memtable_flush_writers=1;
memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; native_transport_max_concurrent_connections=-1;
native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256;
native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null;
num_tokens=256; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner;
permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000;
phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=11000;
read_request_timeout_in_ms=6000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler;
request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=20000; role_manager=CassandraRoleManager;
roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider;
row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=IP.251;
rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50;
rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null;
rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=null; seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=IP.251};
server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001;
sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000;
stream_throughput_outbound_megabits_per_sec=250; streaming_socket_timeout_in_ms=86400000;
thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null;
tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400;
tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@28701274;
trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000;
unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500;
user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1;
write_request_timeout_in_ms=10000]
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org


Mime
View raw message