Interface CountTokensRequest.Builder

  • Method Details

    • modelId

      The unique identifier or ARN of the foundation model to use for token counting. Each model processes tokens differently, so the token count is specific to the model you specify.

      Parameters:
      modelId - The unique identifier or ARN of the foundation model to use for token counting. Each model processes tokens differently, so the token count is specific to the model you specify.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • input

      The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an InvokeModel or Converse request:

      • For InvokeModel requests, provide the request body in the invokeModel field

      • For Converse requests, provide the messages and system content in the converse field

      The input format must be compatible with the model specified in the modelId parameter.

      Parameters:
      input - The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an InvokeModel or Converse request:

      • For InvokeModel requests, provide the request body in the invokeModel field

      • For Converse requests, provide the messages and system content in the converse field

      The input format must be compatible with the model specified in the modelId parameter.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • input

      The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an InvokeModel or Converse request:

      • For InvokeModel requests, provide the request body in the invokeModel field

      • For Converse requests, provide the messages and system content in the converse field

      The input format must be compatible with the model specified in the modelId parameter.

      This is a convenience method that creates an instance of the CountTokensInput.Builder avoiding the need to create one manually via CountTokensInput.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to input(CountTokensInput).

      Parameters:
      input - a consumer that will call methods on CountTokensInput.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • overrideConfiguration

      CountTokensRequest.Builder overrideConfiguration(AwsRequestOverrideConfiguration overrideConfiguration)
      Description copied from interface: AwsRequest.Builder
      Add an optional request override configuration.
      Specified by:
      overrideConfiguration in interface AwsRequest.Builder
      Parameters:
      overrideConfiguration - The override configuration.
      Returns:
      This object for method chaining.
    • overrideConfiguration

      Description copied from interface: AwsRequest.Builder
      Add an optional request override configuration.
      Specified by:
      overrideConfiguration in interface AwsRequest.Builder
      Parameters:
      builderConsumer - A Consumer to which an empty AwsRequestOverrideConfiguration.Builder will be given.
      Returns:
      This object for method chaining.