Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 51C98200C6A for ; Wed, 19 Apr 2017 20:57:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5024E160B9C; Wed, 19 Apr 2017 18:57:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 70CF4160B94 for ; Wed, 19 Apr 2017 20:57:03 +0200 (CEST) Received: (qmail 29102 invoked by uid 500); 19 Apr 2017 18:56:57 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 29092 invoked by uid 99); 19 Apr 2017 18:56:57 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Apr 2017 18:56:57 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 2B21EC0C69 for ; Wed, 19 Apr 2017 18:56:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.481 X-Spam-Level: X-Spam-Status: No, score=0.481 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=deenlo-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id I1iaDm4I9h_K for ; Wed, 19 Apr 2017 18:56:55 +0000 (UTC) Received: from mail-qt0-f173.google.com (mail-qt0-f173.google.com [209.85.216.173]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 10D365F2FD for ; Wed, 19 Apr 2017 18:56:55 +0000 (UTC) Received: by mail-qt0-f173.google.com with SMTP id g60so27763793qtd.3 for ; Wed, 19 Apr 2017 11:56:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=deenlo-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=JVY5ac6b7OnOkoKjmNPaAFL6OqvzjkHppQ+Fa8khRP4=; b=cBn72Ej4oQ8ea5Ls/1hS4Z9lfjuxXMQw2fAr5cEvrFvBQbU6D8O/k2YxS99uSzvdEk GOCmVeAlTXnhEvX+2COeaF3+wxgLj6yxydNzymm+GW547ljmMixNkCno6jM2fjiXCgFw nVK08XzhBlvL+DiMk+qQs0Zhe0rCQw6vfiObTOJ6hxLdDROu+rVmxvWllwC7xloDSYkT 9kUcBcY3YPwWXbnYv9vTUNCKXivpeoIm4aUdC90fl27DdLZIccGy83Bcv70iJW1P5dks 4LaD2RrtO63aS/hY//B3bVUUsZRA149ULMD8iPx4MJkzJLr90Jy4ir8AUbCkq2kxS9Ji jT8w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=JVY5ac6b7OnOkoKjmNPaAFL6OqvzjkHppQ+Fa8khRP4=; b=MzMg+NH5GkfQQVVtJGVNS7p53QBe/RrBwOgkNVwZH6IV2Nz8w0Rsx0wLcUsPaYqh7d G6ci0w0krTVvBxOIm6MfCuoXZnPoymIFv+EpDumHEn5kYd9nqIUXLUZBK0g/si19Y+M4 7uxIyqhAvI3RP4SHTVURyB5CWoBYmOyVC7oPFb5K8aiu9XMQBA8FHnk6hQCG0Eu1raDz K2Ph/ziRM/DSaMhwgo3PfXVx6TcsbH2Btlkk1/GgrxbjdUFq25SgWDZb8F5zti1kiPqS gdBhG8m1QkYkrgQYx6M2QYipN6Cjl8T2jtA/Q7sHTtGrJZ9PqrxgpMWc6/MtTaqvPY09 kUXg== X-Gm-Message-State: AN3rC/6w9sr7Aw7PmUe+ZcaDwlY09xGIoU5GSFBJ3NPMja5IV66Irudb 0Df13t1hvc/FdkiabWBbfx14IWZaEJIZ X-Received: by 10.237.35.162 with SMTP id j31mr4005654qtc.117.1492628214512; Wed, 19 Apr 2017 11:56:54 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.141.66 with HTTP; Wed, 19 Apr 2017 11:56:54 -0700 (PDT) In-Reply-To: References: From: Keith Turner Date: Wed, 19 Apr 2017 14:56:54 -0400 Message-ID: Subject: Re: Batchscanner - error closing output stream because stream is closed To: user@accumulo.apache.org Content-Type: text/plain; charset=UTF-8 archived-at: Wed, 19 Apr 2017 18:57:04 -0000 On Wed, Apr 19, 2017 at 12:38 PM, David Boyd wrote: > All: > > I am getting this stack trace periodically based on no pattern I can > determine from my application. If you are seeing this regularly, try to enable Accumulo debug logging. That may allow you see messages like [1] which may help understand the cause. https://github.com/apache/accumulo/blob/rel/1.7.2/core/src/main/java/org/apache/accumulo/core/client/impl/TabletServerBatchReaderIterator.java#L689 > > Is this a message I should be worried about? > > What is a technique to trace this back to my code and the cause? > > Obviously something is closing things before the thread closes it. > > >> 2017-04-19 12:33:53,423 | WARN | [batch scanner 19824- 8 looking up 1 >> ranges at accumulodev:9997] | (TIOStreamTransport.java:112) - Error closing >> output stream. >> java.io.IOException: The stream is closed >> at >> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:118) >> at >> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) >> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) >> at java.io.FilterOutputStream.close(FilterOutputStream.java:158) >> at >> org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) >> at >> org.apache.thrift.transport.TFramedTransport.close(TFramedTransport.java:89) >> at >> org.apache.accumulo.core.client.impl.ThriftTransportPool$CachedTTransport.close(ThriftTransportPool.java:309) >> at >> org.apache.accumulo.core.client.impl.ThriftTransportPool.returnTransport(ThriftTransportPool.java:571) >> at >> org.apache.accumulo.core.rpc.ThriftUtil.returnClient(ThriftUtil.java:151) >> at >> org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:686) >> at >> org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:349) >> at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> at >> org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) >> at java.lang.Thread.run(Thread.java:745) > > > > -- > ========= mailto:dboyd@incadencecorp.com ============ > David W. Boyd > VP, Data Solutions > 10432 Balls Ford, Suite 240 > Manassas, VA 20109 > office: +1-703-552-2862 > cell: +1-703-402-7908 > ============== http://www.incadencecorp.com/ ============ > ISO/IEC JTC1 WG9, editor ISO/IEC 20547 Big Data Reference Architecture > Chair ANSI/INCITS TC Big Data > Co-chair NIST Big Data Public Working Group Reference Architecture > First Robotic Mentor - FRC, FTC - www.iliterobotics.org > Board Member- USSTEM Foundation - www.usstem.org > > The information contained in this message may be privileged > and/or confidential and protected from disclosure. > If the reader of this message is not the intended recipient > or an employee or agent responsible for delivering this message > to the intended recipient, you are hereby notified that any > dissemination, distribution or copying of this communication > is strictly prohibited. If you have received this communication > in error, please notify the sender immediately by replying to > this message and deleting the material from any computer. > >