Interface EvaluationSummary.Builder
- All Superinterfaces:
Buildable
,CopyableBuilder<EvaluationSummary.Builder,
,EvaluationSummary> SdkBuilder<EvaluationSummary.Builder,
,EvaluationSummary> SdkPojo
- Enclosing class:
EvaluationSummary
-
Method Summary
Modifier and TypeMethodDescriptionapplicationType
(String applicationType) Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).applicationType
(ApplicationType applicationType) Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).creationTime
(Instant creationTime) The time the evaluation job was created.customMetricsEvaluatorModelIdentifiers
(String... customMetricsEvaluatorModelIdentifiers) The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.customMetricsEvaluatorModelIdentifiers
(Collection<String> customMetricsEvaluatorModelIdentifiers) The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.evaluationTaskTypes
(Collection<EvaluationTaskType> evaluationTaskTypes) The type of task for model evaluation.evaluationTaskTypes
(EvaluationTaskType... evaluationTaskTypes) The type of task for model evaluation.evaluationTaskTypesWithStrings
(String... evaluationTaskTypes) The type of task for model evaluation.evaluationTaskTypesWithStrings
(Collection<String> evaluationTaskTypes) The type of task for model evaluation.evaluatorModelIdentifiers
(String... evaluatorModelIdentifiers) The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.evaluatorModelIdentifiers
(Collection<String> evaluatorModelIdentifiers) The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.default EvaluationSummary.Builder
inferenceConfigSummary
(Consumer<EvaluationInferenceConfigSummary.Builder> inferenceConfigSummary) Identifies the models, Knowledge Bases, or other RAG sources evaluated in a model or Knowledge Base evaluation job.inferenceConfigSummary
(EvaluationInferenceConfigSummary inferenceConfigSummary) Identifies the models, Knowledge Bases, or other RAG sources evaluated in a model or Knowledge Base evaluation job.The Amazon Resource Name (ARN) of the evaluation job.The name for the evaluation job.Specifies whether the evaluation job is automated or human-based.jobType
(EvaluationJobType jobType) Specifies whether the evaluation job is automated or human-based.modelIdentifiers
(String... modelIdentifiers) Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummarymodelIdentifiers
(Collection<String> modelIdentifiers) Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryragIdentifiers
(String... ragIdentifiers) Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryragIdentifiers
(Collection<String> ragIdentifiers) Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryThe current status of the evaluation job.status
(EvaluationJobStatus status) The current status of the evaluation job.Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copy
Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, build
Methods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFieldNameToField, sdkFields
-
Method Details
-
jobArn
The Amazon Resource Name (ARN) of the evaluation job.
- Parameters:
jobArn
- The Amazon Resource Name (ARN) of the evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
jobName
The name for the evaluation job.
- Parameters:
jobName
- The name for the evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
status
The current status of the evaluation job.
- Parameters:
status
- The current status of the evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
status
The current status of the evaluation job.
- Parameters:
status
- The current status of the evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
creationTime
The time the evaluation job was created.
- Parameters:
creationTime
- The time the evaluation job was created.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
jobType
Specifies whether the evaluation job is automated or human-based.
- Parameters:
jobType
- Specifies whether the evaluation job is automated or human-based.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
jobType
Specifies whether the evaluation job is automated or human-based.
- Parameters:
jobType
- Specifies whether the evaluation job is automated or human-based.- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
evaluationTaskTypesWithStrings
The type of task for model evaluation.
- Parameters:
evaluationTaskTypes
- The type of task for model evaluation.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
evaluationTaskTypesWithStrings
The type of task for model evaluation.
- Parameters:
evaluationTaskTypes
- The type of task for model evaluation.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
evaluationTaskTypes
The type of task for model evaluation.
- Parameters:
evaluationTaskTypes
- The type of task for model evaluation.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
evaluationTaskTypes
The type of task for model evaluation.
- Parameters:
evaluationTaskTypes
- The type of task for model evaluation.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
modelIdentifiers
Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryThe Amazon Resource Names (ARNs) of the model(s) used for the evaluation job.
- Parameters:
modelIdentifiers
- The Amazon Resource Names (ARNs) of the model(s) used for the evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
modelIdentifiers
Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryThe Amazon Resource Names (ARNs) of the model(s) used for the evaluation job.
- Parameters:
modelIdentifiers
- The Amazon Resource Names (ARNs) of the model(s) used for the evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
ragIdentifiers
Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryThe Amazon Resource Names (ARNs) of the knowledge base resources used for a knowledge base evaluation job.
- Parameters:
ragIdentifiers
- The Amazon Resource Names (ARNs) of the knowledge base resources used for a knowledge base evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
ragIdentifiers
Deprecated.Inference identifiers should be retrieved from the inferenceConfigSummaryThe Amazon Resource Names (ARNs) of the knowledge base resources used for a knowledge base evaluation job.
- Parameters:
ragIdentifiers
- The Amazon Resource Names (ARNs) of the knowledge base resources used for a knowledge base evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
evaluatorModelIdentifiers
The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.
- Parameters:
evaluatorModelIdentifiers
- The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
evaluatorModelIdentifiers
The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.
- Parameters:
evaluatorModelIdentifiers
- The Amazon Resource Names (ARNs) of the models used to compute the metrics for a knowledge base evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
customMetricsEvaluatorModelIdentifiers
EvaluationSummary.Builder customMetricsEvaluatorModelIdentifiers(Collection<String> customMetricsEvaluatorModelIdentifiers) The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.
- Parameters:
customMetricsEvaluatorModelIdentifiers
- The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
customMetricsEvaluatorModelIdentifiers
EvaluationSummary.Builder customMetricsEvaluatorModelIdentifiers(String... customMetricsEvaluatorModelIdentifiers) The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.
- Parameters:
customMetricsEvaluatorModelIdentifiers
- The Amazon Resource Names (ARNs) of the models used to compute custom metrics in an Amazon Bedrock evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
inferenceConfigSummary
EvaluationSummary.Builder inferenceConfigSummary(EvaluationInferenceConfigSummary inferenceConfigSummary) Identifies the models, Knowledge Bases, or other RAG sources evaluated in a model or Knowledge Base evaluation job.
- Parameters:
inferenceConfigSummary
- Identifies the models, Knowledge Bases, or other RAG sources evaluated in a model or Knowledge Base evaluation job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
inferenceConfigSummary
default EvaluationSummary.Builder inferenceConfigSummary(Consumer<EvaluationInferenceConfigSummary.Builder> inferenceConfigSummary) Identifies the models, Knowledge Bases, or other RAG sources evaluated in a model or Knowledge Base evaluation job.
This is a convenience method that creates an instance of theEvaluationInferenceConfigSummary.Builder
avoiding the need to create one manually viaEvaluationInferenceConfigSummary.builder()
.When the
Consumer
completes,SdkBuilder.build()
is called immediately and its result is passed toinferenceConfigSummary(EvaluationInferenceConfigSummary)
.- Parameters:
inferenceConfigSummary
- a consumer that will call methods onEvaluationInferenceConfigSummary.Builder
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
applicationType
Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).
- Parameters:
applicationType
- Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
applicationType
Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).
- Parameters:
applicationType
- Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-