From common-dev-return-102311-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Tue Jun 11 00:41:42 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 4CEDA180649 for ; Tue, 11 Jun 2019 02:41:42 +0200 (CEST) Received: (qmail 21431 invoked by uid 500); 11 Jun 2019 00:41:21 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 20933 invoked by uid 99); 11 Jun 2019 00:41:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Jun 2019 00:41:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 6E1391A460F for ; Tue, 11 Jun 2019 00:41:19 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.8 X-Spam-Level: * X-Spam-Status: No, score=1.8 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id F0wzttCICycW for ; Tue, 11 Jun 2019 00:41:18 +0000 (UTC) Received: from mail-lj1-f174.google.com (mail-lj1-f174.google.com [209.85.208.174]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id AF83F5FBC9 for ; Tue, 11 Jun 2019 00:41:17 +0000 (UTC) Received: by mail-lj1-f174.google.com with SMTP id 16so9735975ljv.10 for ; Mon, 10 Jun 2019 17:41:17 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9J26jNm/tTbrOVIcop9lfLG7s2RXtw6MRWi/6uTl2+o=; b=VIGz/AL4THE0hRVV7fuC8CG2PLNqNAigotTBD7Ned6RVt1/HLFCMz9lEEMhNjfjAsP u1VBivEo0CMzrEfoPh0Bw8tDdTbG7/Q6bPH+brf26WwNsgJTaEjXzk2rXFtqO5sztT1M gZ+J8xq3NqyZafDqbNNyiMNvASIDAvFVUQLlO4nsYF0Co62ynz75eL44TPB2VICjEnZH mtqSUd6Thcthog1nVjvq0A8bGukoi7Lc3pbtdImQ8HlH+ZIunnudLBL4Cm7qoNBonlmY Zaeo+6dkgTLFavI2Kvp6E6rcwancL4c7dFrUpVFdSfyEHyAgOd4rUoeDSF+t27Y+nb1k fklg== X-Gm-Message-State: APjAAAX6laevrQX7Ggq3CDAFY1kuATOrNtCmOSKivg2Pd7p4q9ZI2rrE x6JBlS8uiDcvV/YOqOvsQNef1W3PsQW8NUYe5xGZmQ== X-Google-Smtp-Source: APXvYqxs4xepBUDm4mLZ0RK10DQ5wwjdnlGV5gyy89FyVVVhgfMOncEQtTg+Gh/ay9Fd2S94RRJ6WCMtjuoI6UwppW8= X-Received: by 2002:a2e:3a01:: with SMTP id h1mr25872781lja.132.1560213676371; Mon, 10 Jun 2019 17:41:16 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Wei-Chiu Chuang Date: Mon, 10 Jun 2019 17:40:49 -0700 Message-ID: Subject: Re: [DISCUSS] HDFS roadmap/wish list To: Sudeep Singh Thakur Cc: Wei-Chiu Chuang , Hdfs-dev , "common-user@hadoop.apache.org" , Hadoop Common Content-Type: multipart/alternative; boundary="000000000000f45276058b018d48" --000000000000f45276058b018d48 Content-Type: text/plain; charset="UTF-8" Thank you Sudeep for the feedback, To be more specific, what sort of examples are you looking for? On another note, I had written some docs of extended length about Hadoop code base and internal designs. I should probably make those public to share the knowledge (or fix my grammar errors, for that matter) On Mon, Jun 10, 2019 at 12:11 PM Sudeep Singh Thakur < sudeepthakur90@gmail.com> wrote: > Hi , > > Examples are most helpful for developer. Please add examples as much as we > can. > > Thanks > Sudeep Thakur > > On Mon, Jun 10, 2019, 10:38 PM Wei-Chiu Chuang > wrote: > >> Hi! >> >> I am soliciting feedbacks for HDFS roadmap items and wish list in the >> future Hadoop releases. A community meetup >> >> is happening soon, and perhaps we can use this thread to converge on things >> we should talk about there. >> >> I am aware of several major features that merged into trunk, such as RBF, >> Consistent Standby Serving Reads, as well as some recent features that >> merged into 3.2.0 release (storage policy satisfier). >> >> What else should we be doing? I have a laundry list of supportability >> improvement projects, mostly about improving performance or making >> performance diagnostics easier. I can share the list if folks are >> interested. >> >> Are there things we should do to make developer's life easier or things >> that would be nice to have for downstream applications? I know Sahil Takiar >> made a series of improvements in HDFS for Impala recently, and those >> improvements are applicable to other downstreamers such as HBase. Or would >> it help if we provide more Hadoop API examples? >> > --000000000000f45276058b018d48--