AWS SDK for C++  1.9.129
AWS SDK for C++
Public Member Functions | List of all members
Aws::SageMaker::Model::MultiModelConfig Class Reference

#include <MultiModelConfig.h>

Public Member Functions

 MultiModelConfig ()
 
 MultiModelConfig (Aws::Utils::Json::JsonView jsonValue)
 
MultiModelConfigoperator= (Aws::Utils::Json::JsonView jsonValue)
 
Aws::Utils::Json::JsonValue Jsonize () const
 
const ModelCacheSettingGetModelCacheSetting () const
 
bool ModelCacheSettingHasBeenSet () const
 
void SetModelCacheSetting (const ModelCacheSetting &value)
 
void SetModelCacheSetting (ModelCacheSetting &&value)
 
MultiModelConfigWithModelCacheSetting (const ModelCacheSetting &value)
 
MultiModelConfigWithModelCacheSetting (ModelCacheSetting &&value)
 

Detailed Description

Specifies additional configuration for hosting multi-model endpoints.

See Also:

AWS API Reference

Definition at line 32 of file MultiModelConfig.h.

Constructor & Destructor Documentation

◆ MultiModelConfig() [1/2]

Aws::SageMaker::Model::MultiModelConfig::MultiModelConfig ( )

◆ MultiModelConfig() [2/2]

Aws::SageMaker::Model::MultiModelConfig::MultiModelConfig ( Aws::Utils::Json::JsonView  jsonValue)

Member Function Documentation

◆ GetModelCacheSetting()

const ModelCacheSetting& Aws::SageMaker::Model::MultiModelConfig::GetModelCacheSetting ( ) const
inline

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Definition at line 50 of file MultiModelConfig.h.

◆ Jsonize()

Aws::Utils::Json::JsonValue Aws::SageMaker::Model::MultiModelConfig::Jsonize ( ) const

◆ ModelCacheSettingHasBeenSet()

bool Aws::SageMaker::Model::MultiModelConfig::ModelCacheSettingHasBeenSet ( ) const
inline

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Definition at line 61 of file MultiModelConfig.h.

◆ operator=()

MultiModelConfig& Aws::SageMaker::Model::MultiModelConfig::operator= ( Aws::Utils::Json::JsonView  jsonValue)

◆ SetModelCacheSetting() [1/2]

void Aws::SageMaker::Model::MultiModelConfig::SetModelCacheSetting ( const ModelCacheSetting value)
inline

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Definition at line 72 of file MultiModelConfig.h.

◆ SetModelCacheSetting() [2/2]

void Aws::SageMaker::Model::MultiModelConfig::SetModelCacheSetting ( ModelCacheSetting &&  value)
inline

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Definition at line 83 of file MultiModelConfig.h.

◆ WithModelCacheSetting() [1/2]

MultiModelConfig& Aws::SageMaker::Model::MultiModelConfig::WithModelCacheSetting ( const ModelCacheSetting value)
inline

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Definition at line 94 of file MultiModelConfig.h.

◆ WithModelCacheSetting() [2/2]

MultiModelConfig& Aws::SageMaker::Model::MultiModelConfig::WithModelCacheSetting ( ModelCacheSetting &&  value)
inline

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Definition at line 105 of file MultiModelConfig.h.


The documentation for this class was generated from the following file: