Interface S3IcebergDirectTarget.Builder

  • Method Details

    • name

      Specifies the unique identifier for the Iceberg target node in your data pipeline.

      Parameters:
      name - Specifies the unique identifier for the Iceberg target node in your data pipeline.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputs

      Defines the single input source that provides data to this Iceberg target.

      Parameters:
      inputs - Defines the single input source that provides data to this Iceberg target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputs

      Defines the single input source that provides data to this Iceberg target.

      Parameters:
      inputs - Defines the single input source that provides data to this Iceberg target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • partitionKeys

      S3IcebergDirectTarget.Builder partitionKeys(Collection<? extends Collection<String>> partitionKeys)

      Specifies the columns used to partition the Iceberg table data in S3.

      Parameters:
      partitionKeys - Specifies the columns used to partition the Iceberg table data in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • partitionKeys

      S3IcebergDirectTarget.Builder partitionKeys(Collection<String>... partitionKeys)

      Specifies the columns used to partition the Iceberg table data in S3.

      Parameters:
      partitionKeys - Specifies the columns used to partition the Iceberg table data in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • path

      Defines the S3 location where the Iceberg table data will be stored.

      Parameters:
      path - Defines the S3 location where the Iceberg table data will be stored.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • format

      Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

      Parameters:
      format - Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • format

      Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

      Parameters:
      format - Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • additionalOptions

      S3IcebergDirectTarget.Builder additionalOptions(Map<String,String> additionalOptions)

      Provides additional configuration options for customizing the Iceberg table behavior.

      Parameters:
      additionalOptions - Provides additional configuration options for customizing the Iceberg table behavior.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaChangePolicy

      S3IcebergDirectTarget.Builder schemaChangePolicy(DirectSchemaChangePolicy schemaChangePolicy)

      Defines how schema changes are handled when writing data to the Iceberg table.

      Parameters:
      schemaChangePolicy - Defines how schema changes are handled when writing data to the Iceberg table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaChangePolicy

      default S3IcebergDirectTarget.Builder schemaChangePolicy(Consumer<DirectSchemaChangePolicy.Builder> schemaChangePolicy)

      Defines how schema changes are handled when writing data to the Iceberg table.

      This is a convenience method that creates an instance of the DirectSchemaChangePolicy.Builder avoiding the need to create one manually via DirectSchemaChangePolicy.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to schemaChangePolicy(DirectSchemaChangePolicy).

      Parameters:
      schemaChangePolicy - a consumer that will call methods on DirectSchemaChangePolicy.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • autoDataQuality

      S3IcebergDirectTarget.Builder autoDataQuality(AutoDataQuality autoDataQuality)
      Sets the value of the AutoDataQuality property for this object.
      Parameters:
      autoDataQuality - The new value for the AutoDataQuality property for this object.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • autoDataQuality

      default S3IcebergDirectTarget.Builder autoDataQuality(Consumer<AutoDataQuality.Builder> autoDataQuality)
      Sets the value of the AutoDataQuality property for this object. This is a convenience method that creates an instance of the AutoDataQuality.Builder avoiding the need to create one manually via AutoDataQuality.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to autoDataQuality(AutoDataQuality).

      Parameters:
      autoDataQuality - a consumer that will call methods on AutoDataQuality.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • compression

      S3IcebergDirectTarget.Builder compression(String compression)

      Specifies the compression codec used for Iceberg table files in S3.

      Parameters:
      compression - Specifies the compression codec used for Iceberg table files in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • compression

      Specifies the compression codec used for Iceberg table files in S3.

      Parameters:
      compression - Specifies the compression codec used for Iceberg table files in S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • numberTargetPartitions

      S3IcebergDirectTarget.Builder numberTargetPartitions(String numberTargetPartitions)

      Sets the number of target partitions for distributing Iceberg table files across S3.

      Parameters:
      numberTargetPartitions - Sets the number of target partitions for distributing Iceberg table files across S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • outputSchemas

      S3IcebergDirectTarget.Builder outputSchemas(Collection<GlueSchema> outputSchemas)

      Specifies the data schema for the S3 Iceberg direct target.

      Parameters:
      outputSchemas - Specifies the data schema for the S3 Iceberg direct target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • outputSchemas

      S3IcebergDirectTarget.Builder outputSchemas(GlueSchema... outputSchemas)

      Specifies the data schema for the S3 Iceberg direct target.

      Parameters:
      outputSchemas - Specifies the data schema for the S3 Iceberg direct target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • outputSchemas

      S3IcebergDirectTarget.Builder outputSchemas(Consumer<GlueSchema.Builder>... outputSchemas)

      Specifies the data schema for the S3 Iceberg direct target.

      This is a convenience method that creates an instance of the GlueSchema.Builder avoiding the need to create one manually via GlueSchema.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to outputSchemas(List<GlueSchema>).

      Parameters:
      outputSchemas - a consumer that will call methods on GlueSchema.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: