Interface S3IcebergDirectTarget.Builder

All Superinterfaces:
Buildable, CopyableBuilder<S3IcebergDirectTarget.Builder,S3IcebergDirectTarget>, SdkBuilder<S3IcebergDirectTarget.Builder,S3IcebergDirectTarget>, SdkPojo
Enclosing class:
S3IcebergDirectTarget
@Mutable @NotThreadSafe public static interface S3IcebergDirectTarget.Builder extends SdkPojo, CopyableBuilder<S3IcebergDirectTarget.Builder,S3IcebergDirectTarget>

  • Method Details

    • name

      S3IcebergDirectTarget.Builder name(String name)

      Specifies the unique identifier for the Iceberg target node in your data pipeline.

      Parameters:
      name - Specifies the unique identifier for the Iceberg target node in your data pipeline.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • inputs

      S3IcebergDirectTarget.Builder inputs(Collection<String> inputs)

      Defines the single input source that provides data to this Iceberg target.

      Parameters:
      inputs - Defines the single input source that provides data to this Iceberg target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • inputs

      S3IcebergDirectTarget.Builder inputs(String... inputs)

      Defines the single input source that provides data to this Iceberg target.

      Parameters:
      inputs - Defines the single input source that provides data to this Iceberg target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • partitionKeys

      S3IcebergDirectTarget.Builder partitionKeys(Collection<? extends Collection<String>> partitionKeys)

      Specifies the columns used to partition the Iceberg table data in S3.

      Parameters:
      partitionKeys - Specifies the columns used to partition the Iceberg table data in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • partitionKeys

      S3IcebergDirectTarget.Builder partitionKeys(Collection<String>... partitionKeys)

      Specifies the columns used to partition the Iceberg table data in S3.

      Parameters:
      partitionKeys - Specifies the columns used to partition the Iceberg table data in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • path

      S3IcebergDirectTarget.Builder path(String path)

      Defines the S3 location where the Iceberg table data will be stored.

      Parameters:
      path - Defines the S3 location where the Iceberg table data will be stored.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • format

      S3IcebergDirectTarget.Builder format(String format)

      Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

      Parameters:
      format - Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • format

      S3IcebergDirectTarget.Builder format(TargetFormat format)

      Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

      Parameters:
      format - Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • additionalOptions

      S3IcebergDirectTarget.Builder additionalOptions(Map<String,String> additionalOptions)

      Provides additional configuration options for customizing the Iceberg table behavior.

      Parameters:
      additionalOptions - Provides additional configuration options for customizing the Iceberg table behavior.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • schemaChangePolicy

      S3IcebergDirectTarget.Builder schemaChangePolicy(DirectSchemaChangePolicy schemaChangePolicy)

      Defines how schema changes are handled when writing data to the Iceberg table.

      Parameters:
      schemaChangePolicy - Defines how schema changes are handled when writing data to the Iceberg table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • schemaChangePolicy

      default S3IcebergDirectTarget.Builder schemaChangePolicy(Consumer<DirectSchemaChangePolicy.Builder> schemaChangePolicy)

      Defines how schema changes are handled when writing data to the Iceberg table.

      This is a convenience method that creates an instance of the DirectSchemaChangePolicy.Builder avoiding the need to create one manually via DirectSchemaChangePolicy.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to schemaChangePolicy(DirectSchemaChangePolicy).

      Parameters:
      schemaChangePolicy - a consumer that will call methods on DirectSchemaChangePolicy.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • compression

      S3IcebergDirectTarget.Builder compression(String compression)

      Specifies the compression codec used for Iceberg table files in S3.

      Parameters:
      compression - Specifies the compression codec used for Iceberg table files in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • compression

      S3IcebergDirectTarget.Builder compression(IcebergTargetCompressionType compression)

      Specifies the compression codec used for Iceberg table files in S3.

      Parameters:
      compression - Specifies the compression codec used for Iceberg table files in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:

    • numberTargetPartitions

      S3IcebergDirectTarget.Builder numberTargetPartitions(String numberTargetPartitions)

      Sets the number of target partitions for distributing Iceberg table files across S3.

      Parameters:
      numberTargetPartitions - Sets the number of target partitions for distributing Iceberg table files across S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.