pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-4809) Implement to collect metric data like getSMMSpillCount() in SparkJobStats
Date Mon, 15 Feb 2016 01:30:18 GMT
liyunzhang_intel created PIG-4809:
-------------------------------------

             Summary: Implement to collect metric data like getSMMSpillCount() in SparkJobStats
                 Key: PIG-4809
                 URL: https://issues.apache.org/jira/browse/PIG-4809
             Project: Pig
          Issue Type: Sub-task
          Components: spark
            Reporter: liyunzhang_intel


In current code, we don't implement to collect metric data in SparkJobStats like:
SparkJobStats#getSMMSpillCount:
{code}
    @Override
    public long getSMMSpillCount() {
        throw new UnsupportedOperationException();
    }
{code}

We just throw UnsupportedOperationException when this function is called. 
We need implement following functions in SparkJobStats if the metric data can be collected
in spark mode:
{code}
    @Override
    public int getNumberMaps() {
        throw new UnsupportedOperationException();
    }

    @Override
    public int getNumberReduces() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMaxMapTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMinMapTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getAvgMapTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMaxReduceTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMinReduceTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getAvgREduceTime() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMapInputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getMapOutputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getReduceInputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getReduceOutputRecords() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getSMMSpillCount() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getProactiveSpillCountObjects() {
        throw new UnsupportedOperationException();
    }

    @Override
    public long getProactiveSpillCountRecs() {
        throw new UnsupportedOperationException();
    }

  @Override
    public Map<String, Long> getMultiStoreCounters() {
        throw new UnsupportedOperationException();
    }

    @Override
    public Map<String, Long> getMultiInputCounters() {
        throw new UnsupportedOperationException();
    }
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message