Interface InferenceComponentSchedulingConfig.Builder
- All Superinterfaces:
Buildable,CopyableBuilder<InferenceComponentSchedulingConfig.Builder,,InferenceComponentSchedulingConfig> SdkBuilder<InferenceComponentSchedulingConfig.Builder,,InferenceComponentSchedulingConfig> SdkPojo
- Enclosing class:
InferenceComponentSchedulingConfig
-
Method Summary
Modifier and TypeMethodDescriptionavailabilityZoneBalance(Consumer<InferenceComponentAvailabilityZoneBalance.Builder> availabilityZoneBalance) Configuration for balancing inference component copies across Availability Zones.availabilityZoneBalance(InferenceComponentAvailabilityZoneBalance availabilityZoneBalance) Configuration for balancing inference component copies across Availability Zones.placementStrategy(String placementStrategy) The strategy for placing inference component copies across available instances.placementStrategy(InferenceComponentPlacementStrategy placementStrategy) The strategy for placing inference component copies across available instances.Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copyMethods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, buildMethods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFieldNameToField, sdkFields
-
Method Details
-
placementStrategy
The strategy for placing inference component copies across available instances. If you also set
AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.- SPREAD
-
Distributes copies evenly across available instances for better resilience.
- BINPACK
-
Packs copies onto fewer instances to optimize resource utilization.
- Parameters:
placementStrategy- The strategy for placing inference component copies across available instances. If you also setAvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.- SPREAD
-
Distributes copies evenly across available instances for better resilience.
- BINPACK
-
Packs copies onto fewer instances to optimize resource utilization.
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
placementStrategy
InferenceComponentSchedulingConfig.Builder placementStrategy(InferenceComponentPlacementStrategy placementStrategy) The strategy for placing inference component copies across available instances. If you also set
AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.- SPREAD
-
Distributes copies evenly across available instances for better resilience.
- BINPACK
-
Packs copies onto fewer instances to optimize resource utilization.
- Parameters:
placementStrategy- The strategy for placing inference component copies across available instances. If you also setAvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.- SPREAD
-
Distributes copies evenly across available instances for better resilience.
- BINPACK
-
Packs copies onto fewer instances to optimize resource utilization.
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
availabilityZoneBalance
InferenceComponentSchedulingConfig.Builder availabilityZoneBalance(InferenceComponentAvailabilityZoneBalance availabilityZoneBalance) Configuration for balancing inference component copies across Availability Zones.
- Parameters:
availabilityZoneBalance- Configuration for balancing inference component copies across Availability Zones.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
availabilityZoneBalance
default InferenceComponentSchedulingConfig.Builder availabilityZoneBalance(Consumer<InferenceComponentAvailabilityZoneBalance.Builder> availabilityZoneBalance) Configuration for balancing inference component copies across Availability Zones.
This is a convenience method that creates an instance of theInferenceComponentAvailabilityZoneBalance.Builderavoiding the need to create one manually viaInferenceComponentAvailabilityZoneBalance.builder().When the
Consumercompletes,SdkBuilder.build()is called immediately and its result is passed toavailabilityZoneBalance(InferenceComponentAvailabilityZoneBalance).- Parameters:
availabilityZoneBalance- a consumer that will call methods onInferenceComponentAvailabilityZoneBalance.Builder- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-