Interface TextAIPromptInferenceConfiguration.Builder

All Superinterfaces:

Buildable, CopyableBuilder<TextAIPromptInferenceConfiguration.Builder,TextAIPromptInferenceConfiguration>, SdkBuilder<TextAIPromptInferenceConfiguration.Builder,TextAIPromptInferenceConfiguration>, SdkPojo

Enclosing class:

TextAIPromptInferenceConfiguration

@Mutable
@NotThreadSafe
public static interface TextAIPromptInferenceConfiguration.Builder
extends SdkPojo, CopyableBuilder<TextAIPromptInferenceConfiguration.Builder,TextAIPromptInferenceConfiguration>

Method Summary

Modifier and Type	Method	Description
TextAIPromptInferenceConfiguration.Builder	maxTokensToSample(Integer maxTokensToSample)	The maximum number of tokens to generate in the response.
TextAIPromptInferenceConfiguration.Builder	temperature(Float temperature)	The temperature setting for controlling randomness in the generated response.
TextAIPromptInferenceConfiguration.Builder	topK(Integer topK)	The top-K sampling parameter for token selection.
TextAIPromptInferenceConfiguration.Builder	topP(Float topP)	The top-P sampling parameter for nucleus sampling.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

temperature

TextAIPromptInferenceConfiguration.Builder temperature(Float temperature)

The temperature setting for controlling randomness in the generated response.

Parameters:

temperature - The temperature setting for controlling randomness in the generated response.

Returns:

Returns a reference to this object so that method calls can be chained together.

topP

TextAIPromptInferenceConfiguration.Builder topP(Float topP)

The top-P sampling parameter for nucleus sampling.

Parameters:

topP - The top-P sampling parameter for nucleus sampling.

Returns:

Returns a reference to this object so that method calls can be chained together.

topK

TextAIPromptInferenceConfiguration.Builder topK(Integer topK)

The top-K sampling parameter for token selection.

Parameters:

topK - The top-K sampling parameter for token selection.

Returns:

Returns a reference to this object so that method calls can be chained together.

maxTokensToSample

TextAIPromptInferenceConfiguration.Builder maxTokensToSample(Integer maxTokensToSample)

The maximum number of tokens to generate in the response.

Parameters:

maxTokensToSample - The maximum number of tokens to generate in the response.

Returns:

Returns a reference to this object so that method calls can be chained together.