com.aliyun.odps.mapred.unittest

Class TaskOutput

java.lang.Object

com.aliyun.odps.mapred.local.MapOutputBuffer

com.aliyun.odps.mapred.unittest.TaskOutput

public class TaskOutput
extends MapOutputBuffer

Mapper/Reducer的输出.

Constructor Summary

Constructors

Constructor and Description
TaskOutput(JobConf conf, int reduceNum)
TaskOutput(JobConf job, Pipeline pipeline, String taskId, int reduceCopyNum)

Method Summary

Modifier and Type	Method and Description
void	add(Record key, Record value)
void	add(Record key, Record value, int partition)
void	add(Record record, String label)
com.aliyun.odps.counter.Counters	getCounters() 获取作业 Counters.
List<KeyValue<Record,Record>>	getOutputKeyValues() 返回 Mapper 最终输出到 Reducer 的键值对列表.
List<KeyValue<Record,Record>>	getOutputKeyValues(int reduceId) 返回 Mapper 输出到给定 reduceId 的键值对列表.
List<Record>	getOutputRecords() 获取默认输出结果，返回 List<Record>.
List<Record>	getOutputRecords(boolean sort) 获取默认输出结果，返回 List<Record>.
List<Record>	getOutputRecords(String label) 获取给定标签的输出结果，返回 List<Record>.
List<Record>	getOutputRecords(String label, boolean sort) 获取给定标签的输出结果，返回 List<Record>.
long	getTotalRecordCount()

Methods inherited from class com.aliyun.odps.mapred.local.MapOutputBuffer

getComparator, getPartitionQueue

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TaskOutput

public TaskOutput(JobConf conf,
                  int reduceNum)

TaskOutput

public TaskOutput(JobConf job,
                  Pipeline pipeline,
                  String taskId,
                  int reduceCopyNum)

Method Detail

getOutputKeyValues

public List<KeyValue<Record,Record>> getOutputKeyValues()

返回 Mapper 最终输出到 Reducer 的键值对列表.

Returns:

Mapper 输出到 Reducer 的键值对列表

getOutputKeyValues

public List<KeyValue<Record,Record>> getOutputKeyValues(int reduceId)

返回 Mapper 输出到给定 reduceId 的键值对列表.

Parameters:

reduceId - Reducer 序号，从 0 开始计数。

Returns:

输出到给定 reduceId 的键值对列表

getOutputRecords

public List<Record> getOutputRecords()

获取默认输出结果，返回 List<Record>.

Returns:

默认输出结果

getOutputRecords

public List<Record> getOutputRecords(String label)

获取给定标签的输出结果，返回 List<Record>.

Parameters:

label - 输出标签

Returns:

给定标签的输出结果

getOutputRecords

public List<Record> getOutputRecords(boolean sort)

获取默认输出结果，返回 List<Record>.

Returns:

默认输出结果

getOutputRecords

public List<Record> getOutputRecords(String label,
                                     boolean sort)

获取给定标签的输出结果，返回 List<Record>.

Parameters:

label - 输出标签

Returns:

给定标签的输出结果

getCounters

public com.aliyun.odps.counter.Counters getCounters()

获取作业 Counters.

Returns:

作业 Counters.

add

public void add(Record key,
                Record value)

Overrides:

add in class MapOutputBuffer

add

public void add(Record key,
                Record value,
                int partition)

Overrides:

add in class MapOutputBuffer

add

public void add(Record record,
                String label)

Overrides:

add in class MapOutputBuffer

getTotalRecordCount

public long getTotalRecordCount()

Overrides:

getTotalRecordCount in class MapOutputBuffer