Class MultiModelConfig
- All Implemented Interfaces:
Serializable
,SdkPojo
,ToCopyableBuilder<MultiModelConfig.Builder,
MultiModelConfig>
Specifies additional configuration for hosting multi-model endpoints.
- See Also:
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionstatic MultiModelConfig.Builder
builder()
final boolean
final boolean
equalsBySdkFields
(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.final <T> Optional
<T> getValueForField
(String fieldName, Class<T> clazz) final int
hashCode()
final ModelCacheSetting
Whether to cache models for a multi-model endpoint.final String
Whether to cache models for a multi-model endpoint.static Class
<? extends MultiModelConfig.Builder> Take this object and create a builder that contains all of the current property values of this object.final String
toString()
Returns a string representation of this object.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
modelCacheSetting
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled
.If the service returns an enum value that is not available in the current SDK version,
modelCacheSetting
will returnModelCacheSetting.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available frommodelCacheSettingAsString()
.- Returns:
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so
that a model does not have to be loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a large number of models that are each
invoked infrequently, the endpoint might perform better if you disable model caching. To disable model
caching, set the value of this parameter to
Disabled
. - See Also:
-
modelCacheSettingAsString
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to
Disabled
.If the service returns an enum value that is not available in the current SDK version,
modelCacheSetting
will returnModelCacheSetting.UNKNOWN_TO_SDK_VERSION
. The raw value returned by the service is available frommodelCacheSettingAsString()
.- Returns:
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so
that a model does not have to be loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a large number of models that are each
invoked infrequently, the endpoint might perform better if you disable model caching. To disable model
caching, set the value of this parameter to
Disabled
. - See Also:
-
toBuilder
Description copied from interface:ToCopyableBuilder
Take this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilder
in interfaceToCopyableBuilder<MultiModelConfig.Builder,
MultiModelConfig> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
public final int hashCode() -
equals
-
equalsBySdkFields
Description copied from interface:SdkPojo
Indicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojo
class, and is generated based on a service model.If an
SdkPojo
class does not have any inherited fields,equalsBySdkFields
andequals
are essentially the same.- Specified by:
equalsBySdkFields
in interfaceSdkPojo
- Parameters:
obj
- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value. -
getValueForField
-
sdkFields
-