org.apache.flink.streaming.api.operators.source

类 SourceOutputWithWatermarks<T>

java.lang.Object

org.apache.flink.streaming.api.operators.source.SourceOutputWithWatermarks<T>

类型参数:

T - The type of emitted records.

所有已实现的接口:

org.apache.flink.api.common.eventtime.WatermarkOutput, org.apache.flink.api.connector.source.SourceOutput<T>

@Internal
public class SourceOutputWithWatermarks<T>
extends Object
implements org.apache.flink.api.connector.source.SourceOutput<T>

Implementation of the SourceOutput. The records emitted to this output are pushed into a given PushingAsyncDataInput.DataOutput. The watermarks are pushed into the same output, or into a separate WatermarkOutput, if one is provided.

Periodic Watermarks

This output does not implement automatic periodic watermark emission. The method emitPeriodicWatermark() needs to be called periodically.

Note on Performance Considerations

The methods SourceOutput.collect(Object) and SourceOutput.collect(Object, long) are highly performance-critical (part of the hot loop). To make the code as JIT friendly as possible, we want to have only a single implementation of these two methods, across all classes. That way, the JIT compiler can de-virtualize (and inline) them better.

Currently, we have one implementation of these methods for the case where we don't need watermarks (see class NoOpTimestampsAndWatermarks) and one for the case where we do (this class). When the JVM is dedicated to a single job (or type of job) only one of these classes will be loaded. In mixed job setups, we still have a bimorphic method (rather than a poly/-/mega-morphic method).

构造器概要

构造器

限定符

构造器和说明

protected

SourceOutputWithWatermarks(PushingAsyncDataInput.DataOutput<T> recordsOutput, org.apache.flink.api.common.eventtime.WatermarkOutput onEventWatermarkOutput, org.apache.flink.api.common.eventtime.WatermarkOutput periodicWatermarkOutput, org.apache.flink.api.common.eventtime.TimestampAssigner<T> timestampAssigner, org.apache.flink.api.common.eventtime.WatermarkGenerator<T> watermarkGenerator) Creates a new SourceOutputWithWatermarks that emits records to the given DataOutput and watermarks to the (possibly different) WatermarkOutput.

方法概要

限定符和类型	方法和说明
void	collect(T record)
void	collect(T record, long timestamp)
static <E> SourceOutputWithWatermarks<E>	createWithSeparateOutputs(PushingAsyncDataInput.DataOutput<E> recordsOutput, org.apache.flink.api.common.eventtime.WatermarkOutput onEventWatermarkOutput, org.apache.flink.api.common.eventtime.WatermarkOutput periodicWatermarkOutput, org.apache.flink.api.common.eventtime.TimestampAssigner<E> timestampAssigner, org.apache.flink.api.common.eventtime.WatermarkGenerator<E> watermarkGenerator) Creates a new SourceOutputWithWatermarks that emits records to the given DataOutput and watermarks to the different WatermarkOutputs.
void	emitPeriodicWatermark()
void	emitWatermark(org.apache.flink.api.common.eventtime.Watermark watermark)
void	markActive()
void	markIdle()

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SourceOutputWithWatermarks

protected SourceOutputWithWatermarks(PushingAsyncDataInput.DataOutput<T> recordsOutput,
                                     org.apache.flink.api.common.eventtime.WatermarkOutput onEventWatermarkOutput,
                                     org.apache.flink.api.common.eventtime.WatermarkOutput periodicWatermarkOutput,
                                     org.apache.flink.api.common.eventtime.TimestampAssigner<T> timestampAssigner,
                                     org.apache.flink.api.common.eventtime.WatermarkGenerator<T> watermarkGenerator)

Creates a new SourceOutputWithWatermarks that emits records to the given DataOutput and watermarks to the (possibly different) WatermarkOutput.

方法详细资料

collect

public final void collect(T record)

指定者:

collect 在接口中 org.apache.flink.api.connector.source.SourceOutput<T>

collect

public final void collect(T record,
                          long timestamp)

指定者:

collect 在接口中 org.apache.flink.api.connector.source.SourceOutput<T>

emitWatermark

public final void emitWatermark(org.apache.flink.api.common.eventtime.Watermark watermark)

指定者:

emitWatermark 在接口中 org.apache.flink.api.common.eventtime.WatermarkOutput

markIdle

public final void markIdle()

指定者:

markIdle 在接口中 org.apache.flink.api.common.eventtime.WatermarkOutput

markActive

public void markActive()

指定者:

markActive 在接口中 org.apache.flink.api.common.eventtime.WatermarkOutput

emitPeriodicWatermark

public final void emitPeriodicWatermark()

createWithSeparateOutputs

public static <E> SourceOutputWithWatermarks<E> createWithSeparateOutputs(PushingAsyncDataInput.DataOutput<E> recordsOutput,
                                                                          org.apache.flink.api.common.eventtime.WatermarkOutput onEventWatermarkOutput,
                                                                          org.apache.flink.api.common.eventtime.WatermarkOutput periodicWatermarkOutput,
                                                                          org.apache.flink.api.common.eventtime.TimestampAssigner<E> timestampAssigner,
                                                                          org.apache.flink.api.common.eventtime.WatermarkGenerator<E> watermarkGenerator)

Creates a new SourceOutputWithWatermarks that emits records to the given DataOutput and watermarks to the different WatermarkOutputs.