hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-8106) Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException while loading log meta
Date Wed, 04 Apr 2018 04:16:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wangda Tan updated YARN-8106:
-----------------------------
    Target Version/s: 3.1.1
            Priority: Critical  (was: Major)

> Update LogAggregationIndexedFileController to use readFull instead read to avoid IOException
while loading log meta
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8106
>                 URL: https://issues.apache.org/jira/browse/YARN-8106
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: log-aggregation
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Critical
>         Attachments: YARN-8106.1.patch
>
>
> yarn logs command fails with below error message. Found  LogAggregationIndexedFileController
uses read() to read the contents of remoteLog into byte array which sometimes does not read
full contents and so actual bytes read is not same as offset leading to IOException. readFully()
can be used.
> {code}
> WARN ifile.LogAggregationIndexedFileController: Can not get log meta from the log 
> Error on loading log meta from 
>  if (actual != offset) {
>         throw new IOException("Error on loading log meta from "
>             + remoteLogPath);
>       }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message