hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565
Date Sat, 30 Jan 2016 02:15:39 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Akira AJISAKA updated HDFS-9724:
--------------------------------
    Attachment: HDFS-9724.01.patch

Attaching a patch to re-use {{ObjectMapper}} instance. After applying the patch, WebHDFS listing
gets faster.
{noformat}
[root@trunk ~]# time curl 'http://trunk:50070/webhdfs/v1/tmp/test/?op=LISTSTATUS' | wc
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 2440k    0 2440k    0     0  18.6M      0 --:--:-- --:--:-- --:--:-- 18.6M
  10002   10002 2498929

real	0m0.136s
user	0m0.054s
sys	0m0.011s
{noformat}

> WebHDFS listing is too slow after HDFS-6565
> -------------------------------------------
>
>                 Key: HDFS-9724
>                 URL: https://issues.apache.org/jira/browse/HDFS-9724
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: performance
>    Affects Versions: 2.7.0
>            Reporter: Akira AJISAKA
>            Assignee: Akira AJISAKA
>            Priority: Critical
>         Attachments: HDFS-9724.01.patch
>
>
> Eremikhin Alexey reported at user ML that WebHDFS listing is too slow because of HDFS-6565.
> https://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/201601.mbox/%3C56AB857B.6020105%40corp.badoo.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message