Class DataIntegrationFlowDatasetOptions

java.lang.Object
software.amazon.awssdk.services.supplychain.model.DataIntegrationFlowDatasetOptions
All Implemented Interfaces:
Serializable, SdkPojo, ToCopyableBuilder<DataIntegrationFlowDatasetOptions.Builder,DataIntegrationFlowDatasetOptions>
@Generated("software.amazon.awssdk:codegen") public final class DataIntegrationFlowDatasetOptions extends Object implements SdkPojo, Serializable, ToCopyableBuilder<DataIntegrationFlowDatasetOptions.Builder,DataIntegrationFlowDatasetOptions>

The dataset options used in dataset source and target configurations.

See Also:

  • Method Details

    • loadType

      public final DataIntegrationFlowLoadType loadType()

      The target dataset's data load type. This only affects how source S3 files are selected in the S3-to-dataset flow.

      • REPLACE - Target dataset will get replaced with the new file added under the source s3 prefix.

      • INCREMENTAL - Target dataset will get updated with the up-to-date content under S3 prefix incorporating any file additions or removals there.

      If the service returns an enum value that is not available in the current SDK version, loadType will return DataIntegrationFlowLoadType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from loadTypeAsString().

      Returns:
      The target dataset's data load type. This only affects how source S3 files are selected in the S3-to-dataset flow.

      • REPLACE - Target dataset will get replaced with the new file added under the source s3 prefix.

      • INCREMENTAL - Target dataset will get updated with the up-to-date content under S3 prefix incorporating any file additions or removals there.

      See Also:

    • loadTypeAsString

      public final String loadTypeAsString()

      The target dataset's data load type. This only affects how source S3 files are selected in the S3-to-dataset flow.

      • REPLACE - Target dataset will get replaced with the new file added under the source s3 prefix.

      • INCREMENTAL - Target dataset will get updated with the up-to-date content under S3 prefix incorporating any file additions or removals there.

      If the service returns an enum value that is not available in the current SDK version, loadType will return DataIntegrationFlowLoadType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from loadTypeAsString().

      Returns:
      The target dataset's data load type. This only affects how source S3 files are selected in the S3-to-dataset flow.

      • REPLACE - Target dataset will get replaced with the new file added under the source s3 prefix.

      • INCREMENTAL - Target dataset will get updated with the up-to-date content under S3 prefix incorporating any file additions or removals there.

      See Also:

    • dedupeRecords

      public final Boolean dedupeRecords()

      The option to perform deduplication on data records sharing same primary key values. If disabled, transformed data with duplicate primary key values will ingest into dataset, for datasets within asc namespace, such duplicates will cause ingestion fail. If enabled without dedupeStrategy, deduplication is done by retaining a random data record among those sharing the same primary key values. If enabled with dedupeStragtegy, the deduplication is done following the strategy.

      Note that target dataset may have partition configured, when dedupe is enabled, it only dedupe against primary keys and retain only one record out of those duplicates regardless of its partition status.

      Returns:
      The option to perform deduplication on data records sharing same primary key values. If disabled, transformed data with duplicate primary key values will ingest into dataset, for datasets within asc namespace, such duplicates will cause ingestion fail. If enabled without dedupeStrategy, deduplication is done by retaining a random data record among those sharing the same primary key values. If enabled with dedupeStragtegy, the deduplication is done following the strategy.

      Note that target dataset may have partition configured, when dedupe is enabled, it only dedupe against primary keys and retain only one record out of those duplicates regardless of its partition status.

    • dedupeStrategy

      public final DataIntegrationFlowDedupeStrategy dedupeStrategy()

      The deduplication strategy to dedupe the data records sharing same primary key values of the target dataset. This strategy only applies to target dataset with primary keys and with dedupeRecords option enabled. If transformed data still got duplicates after the dedupeStrategy evaluation, a random data record is chosen to be retained.

      Returns:
      The deduplication strategy to dedupe the data records sharing same primary key values of the target dataset. This strategy only applies to target dataset with primary keys and with dedupeRecords option enabled. If transformed data still got duplicates after the dedupeStrategy evaluation, a random data record is chosen to be retained.

    • toBuilder

      public DataIntegrationFlowDatasetOptions.Builder toBuilder()
      Description copied from interface: ToCopyableBuilder
      Take this object and create a builder that contains all of the current property values of this object.
      Specified by:
      toBuilder in interface ToCopyableBuilder<DataIntegrationFlowDatasetOptions.Builder,DataIntegrationFlowDatasetOptions>
      Returns:
      a builder for type T

    • builder

      public static DataIntegrationFlowDatasetOptions.Builder builder()

    • serializableBuilderClass

      public static Class<? extends DataIntegrationFlowDatasetOptions.Builder> serializableBuilderClass()

    • hashCode

      public final int hashCode()
      Overrides:
      hashCode in class Object

    • equals

      public final boolean equals(Object obj)
      Overrides:
      equals in class Object

    • equalsBySdkFields

      public final boolean equalsBySdkFields(Object obj)
      Description copied from interface: SdkPojo
      Indicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in an SdkPojo class, and is generated based on a service model.

      If an SdkPojo class does not have any inherited fields, equalsBySdkFields and equals are essentially the same.

      Specified by:
      equalsBySdkFields in interface SdkPojo
      Parameters:
      obj - the object to be compared with
      Returns:
      true if the other object equals to this object by sdk fields, false otherwise.

    • toString

      public final String toString()
      Returns a string representation of this object. This is useful for testing and debugging. Sensitive data will be redacted from this string using a placeholder value.
      Overrides:
      toString in class Object

    • getValueForField

      public final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz)

    • sdkFields

      public final List<SdkField<?>> sdkFields()
      Specified by:
      sdkFields in interface SdkPojo
      Returns:
      List of SdkField in this POJO. May be empty list but should never be null.

    • sdkFieldNameToField

      public final Map<String,SdkField<?>> sdkFieldNameToField()
      Specified by:
      sdkFieldNameToField in interface SdkPojo
      Returns:
      The mapping between the field name and its corresponding field.