Package ai.djl.huggingface.translator

Class CrossEncoderTranslator

java.lang.Object

ai.djl.huggingface.translator.CrossEncoderTranslator

All Implemented Interfaces:

ai.djl.translate.PostProcessor<float[]>, ai.djl.translate.PreProcessor<ai.djl.util.StringPair>, ai.djl.translate.Translator<ai.djl.util.StringPair,float[]>

public class CrossEncoderTranslator
extends Object
implements ai.djl.translate.Translator<ai.djl.util.StringPair,float[]>

The translator for Huggingface cross encoder model.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	CrossEncoderTranslator.Builder	The builder for question answering translator.

Method Summary

Modifier and Type	Method	Description
ai.djl.ndarray.NDList	batchProcessInput(ai.djl.translate.TranslatorContext ctx, List<ai.djl.util.StringPair> inputs)
List<float[]>	batchProcessOutput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList list)
static CrossEncoderTranslator.Builder	builder(HuggingFaceTokenizer tokenizer)	Creates a builder to build a CrossEncoderTranslator.
static CrossEncoderTranslator.Builder	builder(HuggingFaceTokenizer tokenizer, Map<String,?> arguments)	Creates a builder to build a CrossEncoderTranslator.
ai.djl.translate.Batchifier	getBatchifier()
ai.djl.ndarray.NDList	processInput(ai.djl.translate.TranslatorContext ctx, ai.djl.util.StringPair input)
float[]	processOutput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList list)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.djl.translate.Translator

getExpansions, prepare

Method Details

getBatchifier

public ai.djl.translate.Batchifier getBatchifier()

Specified by:

getBatchifier in interface ai.djl.translate.Translator<ai.djl.util.StringPair,float[]>

processInput

public ai.djl.ndarray.NDList processInput(ai.djl.translate.TranslatorContext ctx,
 ai.djl.util.StringPair input)

Specified by:

processInput in interface ai.djl.translate.PreProcessor<ai.djl.util.StringPair>

batchProcessInput

public ai.djl.ndarray.NDList batchProcessInput(ai.djl.translate.TranslatorContext ctx,
 List<ai.djl.util.StringPair> inputs)

Specified by:

batchProcessInput in interface ai.djl.translate.Translator<ai.djl.util.StringPair,float[]>

processOutput

public float[] processOutput(ai.djl.translate.TranslatorContext ctx,
 ai.djl.ndarray.NDList list)

Specified by:

processOutput in interface ai.djl.translate.PostProcessor<float[]>

batchProcessOutput

public List<float[]> batchProcessOutput(ai.djl.translate.TranslatorContext ctx,
 ai.djl.ndarray.NDList list)

Specified by:

batchProcessOutput in interface ai.djl.translate.Translator<ai.djl.util.StringPair,float[]>

builder

public static CrossEncoderTranslator.Builder builder(HuggingFaceTokenizer tokenizer)

Creates a builder to build a CrossEncoderTranslator.

Parameters:

tokenizer - the tokenizer

Returns:

a new builder

builder

public static CrossEncoderTranslator.Builder builder(HuggingFaceTokenizer tokenizer,
 Map<String,?> arguments)

Creates a builder to build a CrossEncoderTranslator.

Parameters:

tokenizer - the tokenizer

arguments - the models' arguments

Returns:

a new builder