Interface AsyncInferenceClientConfig.Builder
- All Superinterfaces:
Buildable,CopyableBuilder<AsyncInferenceClientConfig.Builder,,AsyncInferenceClientConfig> SdkBuilder<AsyncInferenceClientConfig.Builder,,AsyncInferenceClientConfig> SdkPojo
- Enclosing class:
AsyncInferenceClientConfig
public static interface AsyncInferenceClientConfig.Builder
extends SdkPojo, CopyableBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>
-
Method Summary
Modifier and TypeMethodDescriptionmaxConcurrentInvocationsPerInstance(Integer maxConcurrentInvocationsPerInstance) The maximum number of concurrent requests sent by the SageMaker client to the model container.Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copyMethods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, buildMethods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFields
-
Method Details
-
maxConcurrentInvocationsPerInstance
AsyncInferenceClientConfig.Builder maxConcurrentInvocationsPerInstance(Integer maxConcurrentInvocationsPerInstance) The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.
- Parameters:
maxConcurrentInvocationsPerInstance- The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-