hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Doe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-13513) BenchmarkThroughput.readFile hangs with misconfigured BUFFER_SIZE
Date Fri, 27 Apr 2018 19:47:00 GMT
John Doe created HDFS-13513:

             Summary: BenchmarkThroughput.readFile hangs with misconfigured BUFFER_SIZE
                 Key: HDFS-13513
                 URL: https://issues.apache.org/jira/browse/HDFS-13513
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: test
            Reporter: John Doe
             Fix For: 2.5.0

When the BUFFER_SIZE is configured to be 0, the while loop in BenchmarkThroughput.readFile
function hangs endlessly.
This is because when the data.size (i.e., BUFFER_SIZE) is 0, the val will always be 0 by invoking
Here is the code snippet.

  BUFFER_SIZE = conf.getInt("dfsthroughput.buffer.size", 4 * 1024);//when dfsthroughput.buffer.size
is configued to be 0

  private void readFile(FileSystem fs, Path f, String name, Configuration conf ) throws IOException
    System.out.print("Reading " + name);
    InputStream in = fs.open(f);
    byte[] data = new byte[BUFFER_SIZE];
    long val = 0;
    while (val >= 0) {
      val = in.read(data);

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message