accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mohit.kaushik" <mohit.kaus...@orkash.com>
Subject Mutation Rejected exception with server Error 1
Date Tue, 22 Dec 2015 13:30:33 GMT
Dear All,

The mutations rejected exception can be seen at client side with server 
error 1.
/*org.apache.accumulo.core.client.MutationsRejectedException: # 
constraint violations : 0  security codes: {}  # server errors 1 # 
exceptions 1\n\tat 
org.apache.accumulo.core.client.impl.TabletServerBatchWriter.checkForFailures(TabletServerBatchWriter.java:537)\n\tat

org.apache.accumulo.core.client.impl.TabletServerBatchWriter.addMutation(TabletServerBatchWriter.java:249)\n\tat

org.apache.accumulo.core.client.impl.MultiTableBatchWriterImpl$TableBatchWriter.addMutation(MultiTableBatchWriterImpl.java:64)\n\tat

com.orkash.accumulo.IngestionWithoutServiceOnCondition.main(IngestionWithoutServiceOnCondition.java:235)\n\tat

com.orkash.db.DBQuery.insertLookUpDB(DBQuery.java:570)\n\tat 
com.orkash.Crawling.CrawlerThread.run(CrawlerThread.java:145)\n\tat 
java.lang.Thread.run(Thread.java:745)\nCaused by: 
org.apache.accumulo.core.client.impl.AccumuloServerException: Error on 
server orkash1:9997\n\tat */

I also found exceptions in Monitor related to Tracing.

*Tracing spans are being dropped because there are already 5000 spans queued for delivery.
This does not affect performance, security or data integrity, but distributed tracing information
is being lost.**
**
**and**6458 times**
**Got an IOException in internalRead!
	java.io.IOException: Connection reset by peer
		at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
		at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
		at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
		at sun.nio.ch.IOUtil.read(IOUtil.java:197)
		at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
		at org.apache.thrift.transport.TNonblockingSocket.read(TNonblockingSocket.java:141)
		at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.internalRead(AbstractNonblockingServer.java:537)
		at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.read(AbstractNonblockingServer.java:338)
		at org.apache.thrift.server.AbstractNonblockingServer$AbstractSelectThread.handleRead(AbstractNonblockingServer.java:203)
		at org.apache.accumulo.server.rpc.CustomNonBlockingServer$SelectAcceptThread.select(CustomNonBlockingServer.java:228)
		at org.apache.accumulo.server.rpc.CustomNonBlockingServer$SelectAcceptThread.run*



I am facing the following exceptions in tserver logs and one tserver 
goes dead.

*2015-12-22 09:37:27,173 [zookeeper.ZooCache] WARN : Saw (possibly) 
transient exception communicating with ZooKeeper, will retry**
**org.apache.zookeeper.KeeperException$ConnectionLossException: 
KeeperErrorCode = ConnectionLoss for 
/accumulo/f8708e0d-9238-41f5-b948-8f435fd01207/tables/16/conf/table.split.threshold**
**        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:99)**
**        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)**
**        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)**
**        at 
org.apache.accumulo.fate.zookeeper.ZooCache$2.run(ZooCache.java:264)**
**        at 
org.apache.accumulo.fate.zookeeper.ZooCache.retry(ZooCache.java:162)**
**        at 
org.apache.accumulo.fate.zookeeper.ZooCache.get(ZooCache.java:289)**
**        at 
org.apache.accumulo.fate.zookeeper.ZooCache.get(ZooCache.java:238)**
**        at 
org.apache.accumulo.server.conf.ZooCachePropertyAccessor.get(ZooCachePropertyAccessor.java:117)**
**        at 
org.apache.accumulo.server.conf.ZooCachePropertyAccessor.get(ZooCachePropertyAccessor.java:103)**
**        at 
org.apache.accumulo.server.conf.TableConfiguration.get(TableConfiguration.java:99)**
**        at 
org.apache.accumulo.core.conf.AccumuloConfiguration.getMemoryInBytes(AccumuloConfiguration.java:197)**
**        at 
org.apache.accumulo.tserver.tablet.Tablet.findSplitRow(Tablet.java:1604)**
**        at 
org.apache.accumulo.tserver.tablet.Tablet.needsSplit(Tablet.java:1772)**
**        at 
org.apache.accumulo.tserver.TabletServer$MajorCompactor.run(TabletServer.java:1853)**
**        at 
org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)**
**        at java.lang.Thread.run(Thread.java:745)**
*
These are creating problems in continuously ingesting data and I also 
experienced some delay in queries and table create commands.
Please comment what could be the cause of these exceptions?

Thanks
Mohit Kaushik
Signature

**//


Mime
View raw message