Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B733610988 for ; Mon, 28 Oct 2013 22:16:31 +0000 (UTC) Received: (qmail 5551 invoked by uid 500); 28 Oct 2013 22:16:31 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 5504 invoked by uid 500); 28 Oct 2013 22:16:31 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 5495 invoked by uid 500); 28 Oct 2013 22:16:31 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 5492 invoked by uid 99); 28 Oct 2013 22:16:31 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Oct 2013 22:16:31 +0000 Date: Mon, 28 Oct 2013 22:16:31 +0000 (UTC) From: "Hari Sankar Sivarama Subramaniyan (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-5519) Use paging mechanism for templeton get requests. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-5519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-5519: ---------------------------------------------------- Attachment: HIVE-5519.3.patch.txt Thanks for the review, [~thejas] Updating the change as per [~thejas] ' comment. The bug with the previous upload was that even though the counter was incremented correctly based on the filter condition, the records which do not satisfy the filter condition do not get skipped. The fix is to continue and skip the current record, if the filter condition is not satisfied in Server.showJobList(). > Use paging mechanism for templeton get requests. > ------------------------------------------------ > > Key: HIVE-5519 > URL: https://issues.apache.org/jira/browse/HIVE-5519 > Project: Hive > Issue Type: Bug > Components: WebHCat > Reporter: Hari Sankar Sivarama Subramaniyan > Assignee: Hari Sankar Sivarama Subramaniyan > Attachments: HIVE-5519.1.patch.txt, HIVE-5519.2.patch.txt, HIVE-5519.3.patch.txt > > > Issuing a command to retrieve the jobs field using > "https://mwinkledemo.azurehdinsight.net:563/templeton/v1/queue/?user.name=admin&fields=*" --user u:p > will result in timeout in windows machine. The issue happens because of the amount of data that needs to be fetched. The proposal is to use paging based encoding scheme so that we flush the contents regularly and the client does not time out. -- This message was sent by Atlassian JIRA (v6.1#6144)