sagemaker/aws.sdk.kotlin.services.sagemaker.model/InferenceComponentComputeResourceRequirements

InferenceComponentComputeResourceRequirements

class InferenceComponentComputeResourceRequirements

Defines the compute resources to allocate to run a model that you assign to an inference component. These resources include CPU cores, accelerators, and memory.

Types

Builder

class Builder

Companion

object Companion

Properties

maxMemoryRequiredInMb

val maxMemoryRequiredInMb: Int?

The maximum MB of memory to allocate to run a model that you assign to an inference component.

minMemoryRequiredInMb

val minMemoryRequiredInMb: Int?

The minimum MB of memory to allocate to run a model that you assign to an inference component.

numberOfAcceleratorDevicesRequired

val numberOfAcceleratorDevicesRequired: Float?

The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and Amazon Web Services Inferentia.

numberOfCpuCoresRequired

val numberOfCpuCoresRequired: Float?

The number of CPU cores to allocate to run a model that you assign to an inference component.

Functions

copy

inline fun copy(block: InferenceComponentComputeResourceRequirements.Builder.() -> Unit = {}): InferenceComponentComputeResourceRequirements

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String