mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1715) Closeable API for broadcast tensors
Date Tue, 23 Jun 2015 03:35:03 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597102#comment-14597102
] 

Hudson commented on MAHOUT-1715:
--------------------------------

FAILURE: Integrated in Mahout-Quality #3201 (See [https://builds.apache.org/job/Mahout-Quality/3201/])
MAHOUT-1660 MAHOUT-1713 MAHOUT-1714 MAHOUT-1715 MAHOUT-1716 MAHOUT-1717 MAHOUT-1718 MAHOUT-1719
MAHOUT-1720 MAHOUT-1721 MAHOUT-1722 MAHOUT-1723 MAHOUT-1724 MAHOUT-1725 MAHOUT-1726 MAHOUT-1727
MAHOUT-1728 MAHOUT-1729 MAHOUT-1730 MAHOUT-1731 MAHOUT-1732 (avati: rev 0b564c71e1a7d555efb5c9696275ecc69a0df026)
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/MMul.scala
* math/src/main/java/org/apache/mahout/math/FileBasedSparseBinaryMatrix.java
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/RLikeVectorOps.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/RbindAB.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/package.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AtA.scala
* bin/mahout
* math-scala/src/main/scala/org/apache/mahout/math/drm/DrmLikeOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/CheckpointAction.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/Par.scala
* math/src/main/java/org/apache/mahout/math/DenseMatrix.java
* spark/src/test/scala/org/apache/mahout/sparkbindings/drm/RLikeDrmOpsSuite.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DistributedEngine.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewScalar.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/io/MahoutKryoRegistrator.scala
* math/src/main/java/org/apache/mahout/math/flavor/TraversingStructureEnum.java
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/SSVD.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/VectorOps.scala
* math/src/main/java/org/apache/mahout/math/RandomAccessSparseVector.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AewB.scala
* math/src/main/java/org/apache/mahout/math/AbstractMatrix.java
* math/src/main/java/org/apache/mahout/math/Matrix.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/io/UnsupportedSerializer.scala
* mr/src/main/java/org/apache/mahout/math/hadoop/DistributedRowMatrix.java
* math/src/main/java/org/apache/mahout/math/Vector.java
* math-scala/src/main/scala/org/apache/mahout/logging/package.scala
* math-scala/src/test/scala/org/apache/mahout/math/scalabindings/MatrixOpsSuite.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/CheckpointedDrmSparkOps.scala
* CHANGELOG
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/TEwFunc.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/io/VectorKryoSerializer.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/ABt.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/DrmRddOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/DrmDoubleScalarOps.scala
* math-scala/src/test/scala/org/apache/mahout/math/drm/DrmLikeOpsSuiteBase.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/Slicing.scala
* math/src/test/java/org/apache/mahout/math/MatricesTest.java
* math-scala/src/main/scala/org/apache/mahout/math/drm/RLikeDrmOps.scala
* spark/src/test/scala/org/apache/mahout/sparkbindings/SparkBindingsSuite.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/RLikeTimesOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/DoubleScalarOps.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/package.scala
* math/src/main/java/org/apache/mahout/math/VectorView.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AinCoreB.scala
* spark/src/test/scala/org/apache/mahout/sparkbindings/blas/BlasSuite.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/MapBlock.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/AbstractUnaryOp.scala
* math/src/main/java/org/apache/mahout/math/SparseColumnMatrix.java
* spark/src/main/scala/org/apache/mahout/common/DrmMetadata.scala
* math/src/main/java/org/apache/mahout/math/MatrixView.java
* math/src/main/java/org/apache/mahout/math/SparseMatrix.java
* spark/src/test/scala/org/apache/mahout/sparkbindings/drm/DrmLikeOpsSuite.scala
* spark/src/main/scala/org/apache/mahout/common/Hadoop1HDFSUtil.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/RLikeMatrixOps.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/SparkBCast.scala
* math/src/main/java/org/apache/mahout/math/ConstantVector.java
* math-scala/src/main/scala/org/apache/mahout/util/IOUtilsScala.scala
* math/src/main/java/org/apache/mahout/math/flavor/BackEnum.java
* math/src/main/java/org/apache/mahout/math/DenseSymmetricMatrix.java
* math/src/main/java/org/apache/mahout/math/UpperTriangular.java
* spark/pom.xml
* spark/src/test/scala/org/apache/mahout/sparkbindings/test/LoggerConfiguration.scala
* math/src/main/java/org/apache/mahout/math/TransposedMatrixView.java
* math-scala/src/test/scala/org/apache/mahout/math/drm/RLikeDrmOpsSuiteBase.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/package.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/BCast.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewUnaryFuncFusion.scala
* math/src/main/java/org/apache/mahout/math/Matrices.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/SparkEngine.scala
* math-scala/src/test/scala/org/apache/mahout/math/scalabindings/RLikeMatrixOpsSuite.scala
* math/src/main/java/org/apache/mahout/math/FunctionalMatrixView.java
* mr/src/main/java/org/apache/mahout/math/hadoop/stochasticsvd/qr/GivensThinSolver.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/io/GenericMatrixKryoSerializer.scala
* math/src/main/java/org/apache/mahout/math/DelegatingVector.java
* spark-shell/src/main/scala/org/apache/mahout/sparkbindings/shell/MahoutSparkILoop.scala
* spark/src/test/scala/org/apache/mahout/sparkbindings/test/DistributedSparkSuite.scala
* math/src/main/java/org/apache/mahout/math/VectorIterable.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/AtB.scala
* math/src/main/java/org/apache/mahout/math/PermutedVectorView.java
* math-scala/src/test/scala/org/apache/mahout/math/scalabindings/VectorOpsSuite.scala
* math/src/main/java/org/apache/mahout/math/SequentialAccessSparseVector.java
* math/src/main/java/org/apache/mahout/math/flavor/MatrixFlavor.java
* h2o/src/main/scala/org/apache/mahout/h2obindings/H2OEngine.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/CheckpointedDrmSpark.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/CbindAB.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/drm/DrmRddInput.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpMapBlock.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpAewUnaryFunc.scala
* spark/src/test/scala/org/apache/mahout/sparkbindings/io/IOSuite.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpCbind.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/package.scala
* math/src/main/java/org/apache/mahout/math/DiagonalMatrix.java
* math/src/main/java/org/apache/mahout/math/DenseVector.java
* math-scala/src/main/scala/org/apache/mahout/math/drm/CheckpointedOps.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/Ax.scala
* math-scala/src/main/scala/org/apache/mahout/math/drm/logical/OpCbindScalar.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/DQR.scala
* math/src/main/java/org/apache/mahout/math/NamedVector.java
* math/src/main/java/org/apache/mahout/math/SparseRowMatrix.java
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/MatrixOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/DSSVD.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/RLikeOps.scala
* spark/src/main/scala/org/apache/mahout/common/HDFSUtil.scala
* math/src/main/java/org/apache/mahout/math/MatrixVectorView.java
* h2o/src/main/java/org/apache/mahout/h2obindings/drm/H2OBCast.java
* spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/At.scala
* math-scala/src/test/scala/org/apache/mahout/math/drm/DrmLikeSuiteBase.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/RLikeDoubleScalarOps.scala


> Closeable API for broadcast tensors
> -----------------------------------
>
>                 Key: MAHOUT-1715
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1715
>             Project: Mahout
>          Issue Type: Improvement
>            Reporter: Dmitriy Lyubimov
>            Assignee: Dmitriy Lyubimov
>             Fix For: 0.10.2
>
>
> Spark has added explicit termination api for broadcasts in 1.1. So broadcast variables
are now closeable by driver. 
> Spark 1.2 seems to have done this change a bit moot since it is using reference queues
to shut off broadcasts (and caches) automatically now.
> PR https://github.com/apache/mahout/pull/135



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message