Class ModelSpeculativeDecodingConfig

java.lang.Object
software.amazon.awssdk.services.sagemaker.model.ModelSpeculativeDecodingConfig
All Implemented Interfaces:
Serializable, SdkPojo, ToCopyableBuilder<ModelSpeculativeDecodingConfig.Builder,ModelSpeculativeDecodingConfig>
@Generated("software.amazon.awssdk:codegen") public final class ModelSpeculativeDecodingConfig extends Object implements SdkPojo, Serializable, ToCopyableBuilder<ModelSpeculativeDecodingConfig.Builder,ModelSpeculativeDecodingConfig>

Settings for the model speculative decoding technique that's applied by a model optimization job.

See Also:

  • Method Details

    • technique

      public final ModelSpeculativeDecodingTechnique technique()

      The speculative decoding technique to apply during model optimization.

      If the service returns an enum value that is not available in the current SDK version, technique will return ModelSpeculativeDecodingTechnique.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from techniqueAsString().

      Returns:
      The speculative decoding technique to apply during model optimization.
      See Also:

    • techniqueAsString

      public final String techniqueAsString()

      The speculative decoding technique to apply during model optimization.

      If the service returns an enum value that is not available in the current SDK version, technique will return ModelSpeculativeDecodingTechnique.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from techniqueAsString().

      Returns:
      The speculative decoding technique to apply during model optimization.
      See Also:

    • trainingDataSource

      public final ModelSpeculativeDecodingTrainingDataSource trainingDataSource()

      The location of the training data to use for speculative decoding. The data must be formatted as ShareGPT, OpenAI Completions or OpenAI Chat Completions. The input can also be unencrypted captured data from a SageMaker endpoint as long as the endpoint uses one of the above formats.

      Returns:
      The location of the training data to use for speculative decoding. The data must be formatted as ShareGPT, OpenAI Completions or OpenAI Chat Completions. The input can also be unencrypted captured data from a SageMaker endpoint as long as the endpoint uses one of the above formats.

    • toBuilder

      public ModelSpeculativeDecodingConfig.Builder toBuilder()
      Description copied from interface: ToCopyableBuilder
      Take this object and create a builder that contains all of the current property values of this object.
      Specified by:
      toBuilder in interface ToCopyableBuilder<ModelSpeculativeDecodingConfig.Builder,ModelSpeculativeDecodingConfig>
      Returns:
      a builder for type T

    • builder

      public static ModelSpeculativeDecodingConfig.Builder builder()

    • serializableBuilderClass

      public static Class<? extends ModelSpeculativeDecodingConfig.Builder> serializableBuilderClass()

    • hashCode

      public final int hashCode()
      Overrides:
      hashCode in class Object

    • equals

      public final boolean equals(Object obj)
      Overrides:
      equals in class Object

    • equalsBySdkFields

      public final boolean equalsBySdkFields(Object obj)
      Description copied from interface: SdkPojo
      Indicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in an SdkPojo class, and is generated based on a service model.

      If an SdkPojo class does not have any inherited fields, equalsBySdkFields and equals are essentially the same.

      Specified by:
      equalsBySdkFields in interface SdkPojo
      Parameters:
      obj - the object to be compared with
      Returns:
      true if the other object equals to this object by sdk fields, false otherwise.

    • toString

      public final String toString()
      Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
      Overrides:
      toString in class Object

    • getValueForField

      public final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz)

    • sdkFields

      public final List<SdkField<?>> sdkFields()
      Specified by:
      sdkFields in interface SdkPojo
      Returns:
      List of SdkField in this POJO. May be empty list but should never be null.

    • sdkFieldNameToField

      public final Map<String,SdkField<?>> sdkFieldNameToField()
      Specified by:
      sdkFieldNameToField in interface SdkPojo
      Returns:
      The mapping between the field name and its corresponding field.