Interface InferenceComponentSchedulingConfig.Builder

All Superinterfaces:

Buildable, CopyableBuilder<InferenceComponentSchedulingConfig.Builder,InferenceComponentSchedulingConfig>, SdkBuilder<InferenceComponentSchedulingConfig.Builder,InferenceComponentSchedulingConfig>, SdkPojo

Enclosing class:

InferenceComponentSchedulingConfig

@Mutable
@NotThreadSafe
public static interface InferenceComponentSchedulingConfig.Builder
extends SdkPojo, CopyableBuilder<InferenceComponentSchedulingConfig.Builder,InferenceComponentSchedulingConfig>

Method Summary

Modifier and Type	Method	Description
default InferenceComponentSchedulingConfig.Builder	availabilityZoneBalance(Consumer<InferenceComponentAvailabilityZoneBalance.Builder> availabilityZoneBalance)	Configuration for balancing inference component copies across Availability Zones.
InferenceComponentSchedulingConfig.Builder	availabilityZoneBalance(InferenceComponentAvailabilityZoneBalance availabilityZoneBalance)	Configuration for balancing inference component copies across Availability Zones.
InferenceComponentSchedulingConfig.Builder	placementStrategy(String placementStrategy)	The strategy for placing inference component copies across available instances.
InferenceComponentSchedulingConfig.Builder	placementStrategy(InferenceComponentPlacementStrategy placementStrategy)	The strategy for placing inference component copies across available instances.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

placementStrategy

InferenceComponentSchedulingConfig.Builder placementStrategy(String placementStrategy)

The strategy for placing inference component copies across available instances. If you also set AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.

SPREAD

Distributes copies evenly across available instances for better resilience.

BINPACK

Packs copies onto fewer instances to optimize resource utilization.

Parameters:

placementStrategy - The strategy for placing inference component copies across available instances. If you also set AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.

SPREAD

Distributes copies evenly across available instances for better resilience.

BINPACK

Packs copies onto fewer instances to optimize resource utilization.

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• InferenceComponentPlacementStrategy
• InferenceComponentPlacementStrategy

placementStrategy

InferenceComponentSchedulingConfig.Builder placementStrategy(InferenceComponentPlacementStrategy placementStrategy)

The strategy for placing inference component copies across available instances. If you also set AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.

SPREAD

Distributes copies evenly across available instances for better resilience.

BINPACK

Packs copies onto fewer instances to optimize resource utilization.

Parameters:

placementStrategy - The strategy for placing inference component copies across available instances. If you also set AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.

SPREAD

Distributes copies evenly across available instances for better resilience.

BINPACK

Packs copies onto fewer instances to optimize resource utilization.

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• InferenceComponentPlacementStrategy
• InferenceComponentPlacementStrategy

availabilityZoneBalance

InferenceComponentSchedulingConfig.Builder availabilityZoneBalance(InferenceComponentAvailabilityZoneBalance availabilityZoneBalance)

Configuration for balancing inference component copies across Availability Zones.

Parameters:

availabilityZoneBalance - Configuration for balancing inference component copies across Availability Zones.

Returns:

Returns a reference to this object so that method calls can be chained together.

availabilityZoneBalance

default InferenceComponentSchedulingConfig.Builder availabilityZoneBalance(Consumer<InferenceComponentAvailabilityZoneBalance.Builder> availabilityZoneBalance)

Configuration for balancing inference component copies across Availability Zones.

This is a convenience method that creates an instance of the InferenceComponentAvailabilityZoneBalance.Builder avoiding the need to create one manually via InferenceComponentAvailabilityZoneBalance.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to availabilityZoneBalance(InferenceComponentAvailabilityZoneBalance).

Parameters:

availabilityZoneBalance - a consumer that will call methods on InferenceComponentAvailabilityZoneBalance.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• availabilityZoneBalance(InferenceComponentAvailabilityZoneBalance)