sagemaker/aws.sdk.kotlin.services.sagemaker.model/InferenceComponentComputeResourceRequirements/Builder

Builder

class Builder

Properties

maxMemoryRequiredInMb

var maxMemoryRequiredInMb: Int?

The maximum MB of memory to allocate to run a model that you assign to an inference component.

minMemoryRequiredInMb

var minMemoryRequiredInMb: Int?

The minimum MB of memory to allocate to run a model that you assign to an inference component.

numberOfAcceleratorDevicesRequired

var numberOfAcceleratorDevicesRequired: Float?

The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and Amazon Web Services Inferentia.

numberOfCpuCoresRequired

var numberOfCpuCoresRequired: Float?

The number of CPU cores to allocate to run a model that you assign to an inference component.