spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sro...@apache.org
Subject spark git commit: [MINOR][CORE] Using bufferedInputStream for dataDeserializeStream
Date Mon, 13 Nov 2017 12:19:16 GMT
Repository: spark
Updated Branches:
  refs/heads/master 209b9361a -> 176ae4d53


[MINOR][CORE] Using bufferedInputStream for dataDeserializeStream

## What changes were proposed in this pull request?

Small fix. Using bufferedInputStream for dataDeserializeStream.

## How was this patch tested?

Existing UT.

Author: Xianyang Liu <xianyang.liu@intel.com>

Closes #19735 from ConeyLiu/smallfix.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/176ae4d5
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/176ae4d5
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/176ae4d5

Branch: refs/heads/master
Commit: 176ae4d53e0269cfc2cfa62d3a2991e28f5a9182
Parents: 209b936
Author: Xianyang Liu <xianyang.liu@intel.com>
Authored: Mon Nov 13 06:19:13 2017 -0600
Committer: Sean Owen <sowen@cloudera.com>
Committed: Mon Nov 13 06:19:13 2017 -0600

----------------------------------------------------------------------
 .../main/scala/org/apache/spark/serializer/SerializerManager.scala | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/176ae4d5/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala b/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
index 311383e..1d4b05c 100644
--- a/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
+++ b/core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala
@@ -206,7 +206,7 @@ private[spark] class SerializerManager(
     val autoPick = !blockId.isInstanceOf[StreamBlockId]
     getSerializer(classTag, autoPick)
       .newInstance()
-      .deserializeStream(wrapForCompression(blockId, inputStream))
+      .deserializeStream(wrapForCompression(blockId, stream))
       .asIterator.asInstanceOf[Iterator[T]]
   }
 }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message