Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 27B34200B95 for ; Tue, 27 Sep 2016 09:10:25 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 263E3160AD3; Tue, 27 Sep 2016 07:10:25 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1BD8F160AE7 for ; Tue, 27 Sep 2016 09:10:23 +0200 (CEST) Received: (qmail 95029 invoked by uid 500); 27 Sep 2016 07:10:22 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 94706 invoked by uid 99); 27 Sep 2016 07:10:22 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Sep 2016 07:10:22 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 58AC02C2A65 for ; Tue, 27 Sep 2016 07:10:22 +0000 (UTC) Date: Tue, 27 Sep 2016 07:10:22 +0000 (UTC) From: "Jeff Jirsa (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Assigned] (CASSANDRA-12700) During writing data into Cassandra 3.7.0 using Python driver 3.7 sometimes Connection get lost, because of Server NullPointerException MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 27 Sep 2016 07:10:25 -0000 [ https://issues.apache.org/jira/browse/CASSANDRA-12700?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Jirsa reassigned CASSANDRA-12700: -------------------------------------- Assignee: Jeff Jirsa > During writing data into Cassandra 3.7.0 using Python driver 3.7 sometime= s Connection get lost, because of Server NullPointerException > -------------------------------------------------------------------------= ------------------------------------------------------------- > > Key: CASSANDRA-12700 > URL: https://issues.apache.org/jira/browse/CASSANDRA-1270= 0 > Project: Cassandra > Issue Type: Bug > Components: Core > Environment: Cassandra cluster with two nodes running C* version = 3.7.0 and Python Driver 3.7 using Python 2.7.11.=20 > OS: Red Hat Enterprise Linux 6.x x64,=20 > RAM :8GB > DISK :210GB > Cores: 2 > Java 1.8.0_73 JRE > Reporter: Rajesh Radhakrishnan > Assignee: Jeff Jirsa > Fix For: 3.x > > > In our C* cluster we are using the latest Cassandra 3.7.0 (datastax-ddc.3= .70) with Python driver 3.7. Trying to insert 2 million row or more data in= to the database, but sometimes we are getting "Null pointer Exception".=20 > We are using Python 2.7.11 and Java 1.8.0_73 in the Cassandra nodes and i= n the client its Python 2.7.12. > {code:title=3Dcassandra server log} > ERROR [SharedPool-Worker-6] 2016-09-23 09:42:55,002 Message.java:611 - Un= expected exception during request; channel =3D [id: 0xc208da86, L:/IP1.IP2.= IP3.IP4:9042 - R:/IP5.IP6.IP7.IP8:58418] > java.lang.NullPointerException: null > at org.apache.cassandra.serializers.BooleanSerializer.deserialize(Boo= leanSerializer.java:33) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.serializers.BooleanSerializer.deserialize(Boo= leanSerializer.java:24) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.= java:113) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.cql3.UntypedResultSet$Row.getBoolean(UntypedR= esultSet.java:273) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRo= leManager.java:85) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRo= leManager.java:81) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager.getRoleFromTable(Ca= ssandraRoleManager.java:503) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager.getRole(CassandraRo= leManager.java:485) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager.canLogin(CassandraR= oleManager.java:298) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.service.ClientState.login(ClientState.java:22= 7) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.transport.messages.AuthResponse.execute(AuthR= esponse.java:79) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Mes= sage.java:507) [apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Mes= sage.java:401) [apache-cassandra-3.7.0.jar:3.7.0] > at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleCha= nnelInboundHandler.java:105) [netty-all-4.0.36.Final.jar:4.0.36.Final] > at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(A= bstractChannelHandlerContext.java:292) [netty-all-4.0.36.Final.jar:4.0.36.F= inal] > at io.netty.channel.AbstractChannelHandlerContext.access$600(Abstract= ChannelHandlerContext.java:32) [netty-all-4.0.36.Final.jar:4.0.36.Final] > at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChann= elHandlerContext.java:283) [netty-all-4.0.36.Final.jar:4.0.36.Final] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) [na:1.8.0_73] > at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$= FutureTask.run(AbstractLocalAwareExecutorService.java:164) [apache-cassandr= a-3.7.0.jar:3.7.0] > at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) = [apache-cassandra-3.7.0.jar:3.7.0] > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_73] > ERROR [SharedPool-Worker-1] 2016-09-23 09:42:56,238 Message.java:611 - Un= expected exception during request; channel =3D [id: 0x8e2eae00, L:/IP1.IP2.= IP3.IP4:9042 - R:/IP5.IP6.IP7.IP8:58421] > java.lang.NullPointerException: null > at org.apache.cassandra.serializers.BooleanSerializer.deserialize(Boo= leanSerializer.java:33) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.serializers.BooleanSerializer.deserialize(Boo= leanSerializer.java:24) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.db.marshal.AbstractType.compose(AbstractType.= java:113) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.cql3.UntypedResultSet$Row.getBoolean(UntypedR= esultSet.java:273) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRo= leManager.java:85) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager$1.apply(CassandraRo= leManager.java:81) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager.getRoleFromTable(Ca= ssandraRoleManager.java:503) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager.getRole(CassandraRo= leManager.java:485) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.auth.CassandraRoleManager.canLogin(CassandraR= oleManager.java:298) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.service.ClientState.login(ClientState.java:22= 7) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.transport.messages.AuthResponse.execute(AuthR= esponse.java:79) ~[apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Mes= sage.java:507) [apache-cassandra-3.7.0.jar:3.7.0] > at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Mes= sage.java:401) [apache-cassandra-3.7.0.jar:3.7.0] > at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleCha= nnelInboundHandler.java:105) [netty-all-4.0.36.Final.jar:4.0.36.Final] > at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(A= bstractChannelHandlerContext.java:292) [netty-all-4.0.36.Final.jar:4.0.36.F= inal] > at io.netty.channel.AbstractChannelHandlerContext.access$600(Abstract= ChannelHandlerContext.java:32) [netty-all-4.0.36.Final.jar:4.0.36.Final] > at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChann= elHandlerContext.java:283) [netty-all-4.0.36.Final.jar:4.0.36.Final] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java= :511) [na:1.8.0_73] > at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$= FutureTask.run(AbstractLocalAwareExecutorService.java:164) [apache-cassandr= a-3.7.0.jar:3.7.0] > at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) = [apache-cassandra-3.7.0.jar:3.7.0] > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_73] > {code} > {code:title=3Dpython client error} > Traceback (most recent call last): > File "vssandra_v5.py", line 132, in > db.insert_batch() > File "vssandra_v5.py", line 60, in insert_batch > self.session.execute(self.batch, timeout=3DNone) > File "cassandra/cluster.py", line 1998, in cassandra.cluster.Session.exe= cute (cassandra/cluster.c:34869) > File "cassandra/cluster.py", line 3781, in cassandra.cluster.ResponseFut= ure.result (cassandra/cluster.c:73073) > cassandra.protocol.ServerError: > {code} > {code:title=3Dcassandra config} > Node configuration:[allocate_tokens_for_keyspace=3Dnull; authenticator= =3DPasswordAuthenticator; authorizer=3DCassandraAuthorizer; auto_bootstrap= =3Dtrue; auto_snapshot=3Dtrue; batch_size_fail_threshold_in_kb=3D100; batch= _size_warn_threshold_in_kb=3D10; batchlog_replay_throttle_in_kb=3D1024; bro= adcast_address=3Dnull; broadcast_rpc_address=3Dnull; buffer_pool_use_heap_i= f_exhausted=3Dtrue; cas_contention_timeout_in_ms=3D5000; client_encryption_= options=3D; cluster_name=3DVCF Stress Cluster; column_index_cache= _size_in_kb=3D2; column_index_size_in_kb=3D64; commit_failure_policy=3Dstop= ; commitlog_compression=3Dnull; commitlog_directory=3Dnull; commitlog_max_c= ompression_buffers_in_pool=3D3; commitlog_periodic_queue_size=3D-1; commitl= og_segment_size_in_mb=3D32; commitlog_sync=3Dperiodic; commitlog_sync_batch= _window_in_ms=3Dnull; commitlog_sync_period_in_ms=3D10000; commitlog_total_= space_in_mb=3Dnull; compaction_large_partition_warning_threshold_mb=3D150; = compaction_throughput_mb_per_sec=3D20; concurrent_compactors=3Dnull; concur= rent_counter_writes=3D32; concurrent_materialized_view_writes=3D32; concurr= ent_reads=3D32; concurrent_replicates=3Dnull; concurrent_writes=3D32; count= er_cache_keys_to_save=3D2147483647; counter_cache_save_period=3D7200; count= er_cache_size_in_mb=3Dnull; counter_write_request_timeout_in_ms=3D5000; cre= dentials_cache_max_entries=3D1000; credentials_update_interval_in_ms=3D-1; = credentials_validity_in_ms=3D2000; cross_node_timeout=3Dfalse; data_file_di= rectories=3D[Ljava.lang.String;@36fc695d; disk_access_mode=3Dauto; disk_fai= lure_policy=3Dstop; disk_optimization_estimate_percentile=3D0.95; disk_opti= mization_page_cross_chance=3D0.1; disk_optimization_strategy=3Dspinning; dy= namic_snitch=3Dtrue; dynamic_snitch_badness_threshold=3D0.1; dynamic_snitch= _reset_interval_in_ms=3D600000; dynamic_snitch_update_interval_in_ms=3D100;= enable_scripted_user_defined_functions=3Dfalse; enable_user_defined_functi= ons=3Dfalse; enable_user_defined_functions_threads=3Dtrue; encryption_optio= ns=3Dnull; endpoint_snitch=3DSimpleSnitch; file_cache_size_in_mb=3Dnull; gc= _warn_threshold_in_ms=3D1000; hinted_handoff_disabled_datacenters=3D[]; hin= ted_handoff_enabled=3Dtrue; hinted_handoff_throttle_in_kb=3D1024; hints_com= pression=3Dnull; hints_directory=3Dnull; hints_flush_period_in_ms=3D10000; = incremental_backups=3Dfalse; index_interval=3Dnull; index_summary_capacity_= in_mb=3Dnull; index_summary_resize_interval_in_minutes=3D60; initial_token= =3Dnull; inter_dc_stream_throughput_outbound_megabits_per_sec=3D200; inter_= dc_tcp_nodelay=3Dfalse; internode_authenticator=3Dnull; internode_compressi= on=3Ddc; internode_recv_buff_size_in_bytes=3Dnull; internode_send_buff_size= _in_bytes=3Dnull; key_cache_keys_to_save=3D2147483647; key_cache_save_perio= d=3D14400; key_cache_size_in_mb=3Dnull; listen_address=3DIP.251; listen_int= erface=3Dnull; listen_interface_prefer_ipv6=3Dfalse; listen_on_broadcast_ad= dress=3Dfalse; max_hint_window_in_ms=3D10800000; max_hints_delivery_threads= =3D2; max_hints_file_size_in_mb=3D128; max_mutation_size_in_kb=3Dnull; max_= streaming_retries=3D3; max_value_size_in_mb=3D256; memtable_allocation_type= =3Doffheap_objects; memtable_cleanup_threshold=3Dnull; memtable_flush_write= rs=3D1; memtable_heap_space_in_mb=3Dnull; memtable_offheap_space_in_mb=3Dnu= ll; native_transport_max_concurrent_connections=3D-1; native_transport_max_= concurrent_connections_per_ip=3D-1; native_transport_max_frame_size_in_mb= =3D256; native_transport_max_threads=3D128; native_transport_port=3D9042; n= ative_transport_port_ssl=3Dnull; num_tokens=3D256; otc_coalescing_strategy= =3DTIMEHORIZON; otc_coalescing_window_us=3D200; partitioner=3Dorg.apache.ca= ssandra.dht.Murmur3Partitioner; permissions_cache_max_entries=3D1000; permi= ssions_update_interval_in_ms=3D-1; permissions_validity_in_ms=3D2000; phi_c= onvict_threshold=3D8.0; prepared_statements_cache_size_mb=3Dnull; range_req= uest_timeout_in_ms=3D11000; read_request_timeout_in_ms=3D6000; request_sche= duler=3Dorg.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=3D= null; request_scheduler_options=3Dnull; request_timeout_in_ms=3D20000; role= _manager=3DCassandraRoleManager; roles_cache_max_entries=3D1000; roles_upda= te_interval_in_ms=3D-1; roles_validity_in_ms=3D2000; row_cache_class_name= =3Dorg.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=3D2147483= 647; row_cache_save_period=3D0; row_cache_size_in_mb=3D0; rpc_address=3DIP.= 251; rpc_interface=3Dnull; rpc_interface_prefer_ipv6=3Dfalse; rpc_keepalive= =3Dtrue; rpc_listen_backlog=3D50; rpc_max_threads=3D2147483647; rpc_min_thr= eads=3D16; rpc_port=3D9160; rpc_recv_buff_size_in_bytes=3Dnull; rpc_send_bu= ff_size_in_bytes=3Dnull; rpc_server_type=3Dsync; saved_caches_directory=3Dn= ull; seed_provider=3Dorg.apache.cassandra.locator.SimpleSeedProvider{seeds= =3DIP.251}; server_encryption_options=3D; snapshot_before_compact= ion=3Dfalse; ssl_storage_port=3D7001; sstable_preemptive_open_interval_in_m= b=3D50; start_native_transport=3Dtrue; start_rpc=3Dfalse; storage_port=3D70= 00; stream_throughput_outbound_megabits_per_sec=3D250; streaming_socket_tim= eout_in_ms=3D86400000; thrift_framed_transport_size_in_mb=3D15; thrift_max_= message_length_in_mb=3D16; thrift_prepared_statements_cache_size_mb=3Dnull;= tombstone_failure_threshold=3D100000; tombstone_warn_threshold=3D1000; tra= cetype_query_ttl=3D86400; tracetype_repair_ttl=3D604800; transparent_data_e= ncryption_options=3Dorg.apache.cassandra.config.TransparentDataEncryptionOp= tions@28701274; trickle_fsync=3Dfalse; trickle_fsync_interval_in_kb=3D10240= ; truncate_request_timeout_in_ms=3D60000; unlogged_batch_across_partitions_= warn_threshold=3D10; user_defined_function_fail_timeout=3D1500; user_define= d_function_warn_timeout=3D500; user_function_timeout_policy=3Ddie; windows_= timer_interval=3D1; write_request_timeout_in_ms=3D10000] > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)