程序包 dev.langchain4j.model.language

接口 TokenCountEstimator

public interface TokenCountEstimator
Represents an interface for estimating the count of tokens in various text types such as a text, prompt, text segment, etc. This can be useful when it's necessary to know in advance the cost of processing a specified text by the LLM.

  • 方法概要

    修饰符和类型
    方法
    说明
    default int
    estimateTokenCount(TextSegment textSegment)
    Estimates the count of tokens in the given text segment.
    default int
    estimateTokenCount(Prompt prompt)
    Estimates the count of tokens in the given prompt.
    int
    estimateTokenCount(String text)
    Estimates the count of tokens in the given text.

  • 方法详细资料

    • estimateTokenCount

      int estimateTokenCount(String text)
      Estimates the count of tokens in the given text.
      参数:
      text - the text.
      返回:
      the estimated count of tokens.

    • estimateTokenCount

      default int estimateTokenCount(Prompt prompt)
      Estimates the count of tokens in the given prompt.
      参数:
      prompt - the prompt.
      返回:
      the estimated count of tokens.

    • estimateTokenCount

      default int estimateTokenCount(TextSegment textSegment)
      Estimates the count of tokens in the given text segment.

      The metadata will not be included in the estimate.

      参数:
      textSegment - the text segment.
      返回:
      the estimated count of tokens.